-- Logs begin at Wed 2022-08-24 04:02:44 UTC, end at Wed 2022-08-24 05:16:20 UTC. -- Aug 24 04:32:50.798657 dv-cinder-854264-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 04:32:50.813011 dv-cinder-854264-1-smb devstack@keystone.service[93398]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 04:32:50.816246 dv-cinder-854264-1-smb devstack@keystone.service[93398]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 04:32:50 2022] *** Aug 24 04:32:50.816246 dv-cinder-854264-1-smb devstack@keystone.service[93398]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 04:32:50.816246 dv-cinder-854264-1-smb devstack@keystone.service[93398]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 04:32:50.816246 dv-cinder-854264-1-smb devstack@keystone.service[93398]: nodename: dv-cinder-854264-1-smb Aug 24 04:32:50.816246 dv-cinder-854264-1-smb devstack@keystone.service[93398]: machine: x86_64 Aug 24 04:32:50.816246 dv-cinder-854264-1-smb devstack@keystone.service[93398]: clock source: unix Aug 24 04:32:50.816246 dv-cinder-854264-1-smb devstack@keystone.service[93398]: pcre jit disabled Aug 24 04:32:50.816246 dv-cinder-854264-1-smb devstack@keystone.service[93398]: detected number of CPU cores: 4 Aug 24 04:32:50.816246 dv-cinder-854264-1-smb devstack@keystone.service[93398]: current working directory: / Aug 24 04:32:50.816246 dv-cinder-854264-1-smb devstack@keystone.service[93398]: detected binary path: /usr/bin/uwsgi-core Aug 24 04:32:50.816246 dv-cinder-854264-1-smb devstack@keystone.service[93398]: your processes number limit is 47680 Aug 24 04:32:50.816246 dv-cinder-854264-1-smb devstack@keystone.service[93398]: your memory page size is 4096 bytes Aug 24 04:32:50.816246 dv-cinder-854264-1-smb devstack@keystone.service[93398]: detected max file descriptor number: 2048 Aug 24 04:32:50.816246 dv-cinder-854264-1-smb devstack@keystone.service[93398]: lock engine: pthread robust mutexes Aug 24 04:32:50.818370 dv-cinder-854264-1-smb devstack@keystone.service[93398]: thunder lock: enabled Aug 24 04:32:50.818370 dv-cinder-854264-1-smb devstack@keystone.service[93398]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 04:32:50.818370 dv-cinder-854264-1-smb devstack@keystone.service[93398]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 04:32:50.891244 dv-cinder-854264-1-smb devstack@keystone.service[93398]: Python main interpreter initialized at 0x55fc505789c0 Aug 24 04:32:50.891244 dv-cinder-854264-1-smb devstack@keystone.service[93398]: python threads support enabled Aug 24 04:32:50.891244 dv-cinder-854264-1-smb devstack@keystone.service[93398]: your server socket listen backlog is limited to 100 connections Aug 24 04:32:50.891244 dv-cinder-854264-1-smb devstack@keystone.service[93398]: your mercy for graceful operations on workers is 90 seconds Aug 24 04:32:50.891838 dv-cinder-854264-1-smb devstack@keystone.service[93398]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 04:32:50.891838 dv-cinder-854264-1-smb devstack@keystone.service[93398]: *** Operational MODE: preforking *** Aug 24 04:32:50.892353 dv-cinder-854264-1-smb devstack@keystone.service[93398]: *** uWSGI is running in multiple interpreter mode *** Aug 24 04:32:50.892353 dv-cinder-854264-1-smb devstack@keystone.service[93398]: spawned uWSGI master process (pid: 93398) Aug 24 04:32:50.892649 dv-cinder-854264-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 04:32:50.896713 dv-cinder-854264-1-smb devstack@keystone.service[93398]: spawned uWSGI worker 1 (pid: 93411, cores: 1) Aug 24 04:32:50.896713 dv-cinder-854264-1-smb devstack@keystone.service[93398]: spawned uWSGI worker 2 (pid: 93412, cores: 1) Aug 24 04:32:50.896713 dv-cinder-854264-1-smb devstack@keystone.service[93398]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 04:32:57.399798 dv-cinder-854264-1-smb devstack@keystone.service[93411]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:32:57.399798 dv-cinder-854264-1-smb devstack@keystone.service[93411]: from cryptography.utils import int_from_bytes Aug 24 04:32:57.401063 dv-cinder-854264-1-smb devstack@keystone.service[93411]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:32:57.401063 dv-cinder-854264-1-smb devstack@keystone.service[93411]: from cryptography.utils import int_from_bytes Aug 24 04:32:57.503228 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 04:32:57.503516 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 04:32:57.503880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] command line args: [] {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 04:32:57.504390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 04:32:57.505353 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ================================================================================ {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 04:32:57.505869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] admin_token = **** {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.506578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] config_dir = [] {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.506940 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.507295 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] config_source = [] {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.507645 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] debug = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.508025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.509932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.509932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.509932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.509932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.510395 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] list_limit = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.510654 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] log_config_append = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.510884 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.511162 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] log_dir = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.511494 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] log_file = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.511943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.512432 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.512902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.513368 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.513743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.514081 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.514538 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.515006 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.515467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.515920 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.516354 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.516799 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.517280 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.517795 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.518324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.519254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.94/identity {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.519638 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] publish_errors = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.520074 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.522095 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.522501 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.522998 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.523458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.523901 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] standard_threads = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.524346 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.524823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.525162 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.525541 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] use_journal = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.525882 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] use_json = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.526201 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] use_stderr = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.526516 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] use_syslog = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.526969 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:57.527479 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.527951 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.528465 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.528923 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.529394 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.529899 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.530376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.530841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.531314 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.531790 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.532263 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.532746 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.533205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.533710 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.534150 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.534593 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.535033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.535535 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.536834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.537630 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.538108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.538607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.539075 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.539763 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.540244 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.540694 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.541141 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.541628 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.542091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.542575 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.543065 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.543485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.543897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.544382 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.544848 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.545302 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.545819 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.546266 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.546726 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.547183 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.547606 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.548030 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.548453 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.548865 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.549340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.549872 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.550330 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.550806 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.551259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.552356 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.552807 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.553276 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.553778 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.554245 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.554682 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.555100 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.555528 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.555989 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.556435 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.556922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.557394 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.557881 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.558325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.558823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.559275 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.559682 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.560125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.560576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.561084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.561571 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.562048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.562527 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.562948 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.563393 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.563854 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.564389 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.564892 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.565466 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.565941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.566522 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.567717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.568239 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.568735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.569298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.569898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.570398 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.570997 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.571462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.571939 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.572392 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.572847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.573312 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.573804 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.574251 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.574711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.575185 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.575635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.576430 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.576898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.577375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.577878 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.578359 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.578860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.579327 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.579777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] auth.external = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.580224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.580754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.581194 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.581698 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] auth.password = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.582152 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] auth.token = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.582580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.583536 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.584098 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.584452 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.584822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.585224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.585692 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.586140 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] credential.caching = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.586625 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.587088 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.587567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.588010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.588486 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.588930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.589569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.590048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.590484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.590955 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.591490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.591958 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.592457 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.592911 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.593447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.593880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] federation.caching = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.594338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.594818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.595283 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.595696 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.596156 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.596600 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.597094 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.597601 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.598088 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.598544 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.599036 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.599777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] identity.caching = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.600261 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.600744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.601210 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.601701 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.602177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.602616 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.603063 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.603534 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.604144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.604444 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.604898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.605361 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.605856 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.606333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.606797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.607230 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.607720 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.608218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.608665 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.609111 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.609597 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.610056 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.610495 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.610931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.611389 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.611864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.612341 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.612782 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.613252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.613770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.615197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.615700 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.616182 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.616618 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.617082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.617560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.618021 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.618487 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.619205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.619677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.620116 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.620985 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.621097 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.621639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.622081 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.622549 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.622999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.623467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.623923 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.624382 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.624830 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.user = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.625294 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.625816 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.626264 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.626743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.627219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.627672 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.628127 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.628582 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.629031 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.629536 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.630508 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.631182 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.631683 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.632158 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.632624 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.641786 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.641786 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.641786 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.641786 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.641786 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.641786 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.641786 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.641786 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.641786 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.642753 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.642753 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.642753 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.642753 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.642753 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.642753 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.642753 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.642753 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.642753 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.644139 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.644139 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.644139 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.644139 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] resource.caching = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.644139 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.644139 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.644139 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.645017 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.645017 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.645318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.647092 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.647557 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.648016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.648412 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] role.caching = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.648895 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] role.driver = sql {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.649337 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.649916 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.650303 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.650785 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.651254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.651725 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.652202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.652679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.653155 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.653646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.654124 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.654589 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.655082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.655561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.656324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.656768 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.657249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.657755 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.658238 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.658744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.659213 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.659713 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.660184 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.660635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.661123 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.661604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.662054 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.662535 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.663030 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.663495 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.663945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.664649 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.665082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.665568 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] token.caching = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.666029 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.666494 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.666967 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.667454 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.667924 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.668348 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.668828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.669295 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.669797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.670244 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.670654 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.671073 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.671522 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.672002 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.672444 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.672901 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.673490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.673986 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] database.connection = **** {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.674361 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.674636 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.674938 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.675205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.675462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.675718 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.675971 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.676460 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.677243 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.677733 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.678197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.678646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.679117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.679575 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.680048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.680563 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.680996 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.681552 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:57.681847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 04:32:57.743844 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:57.744251 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:57.744655 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:57.762251 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:57.818334 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:57.818729 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:57.934419 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:58.033936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:58.034310 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:58.287998 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:58.288391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:58.288787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:58.289172 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:58.289816 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:58.290168 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:58.334070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:58.334456 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:58.334867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:58.335220 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:58.335600 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:58.335974 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:58.336365 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:58.359442 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:58.384333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:58.384750 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:58.385143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:58.385591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:58.385961 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:58.386345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:58.386713 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:58.419356 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.420297 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 04:32:58.420297 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.420654 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 04:32:58.421062 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.421574 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.422508 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.422979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.443340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.443945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.444340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.444795 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.459905 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:58.465749 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:58.466260 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.466802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.467244 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.467744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.468173 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.468623 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.469092 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.469829 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.470281 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.470693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.518469 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.522057 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:58.522574 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.532055 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:58.532570 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.533071 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.544915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:58.545346 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.553827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:58.554281 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.554781 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.555275 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.555765 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.556254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.556739 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.557225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.591145 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.591647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.599790 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:58.606425 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.606984 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.616284 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:58.622723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:58.629395 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.630641 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.631429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.631573 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.632024 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.632542 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.665986 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:58.666527 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.666996 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.667461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.681769 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.684971 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.685497 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.691412 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:58.691927 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.692971 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.693520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.694034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.717090 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:58.717827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.718328 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.718827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.719333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.719829 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.720348 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.731269 dv-cinder-854264-1-smb devstack@keystone.service[93412]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:32:58.731269 dv-cinder-854264-1-smb devstack@keystone.service[93412]: from cryptography.utils import int_from_bytes Aug 24 04:32:58.732229 dv-cinder-854264-1-smb devstack@keystone.service[93412]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:32:58.732229 dv-cinder-854264-1-smb devstack@keystone.service[93412]: from cryptography.utils import int_from_bytes Aug 24 04:32:58.752123 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:58.758941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:58.764739 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.767672 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.770732 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:58.771213 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.771731 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.784931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.788461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:58.794824 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.795436 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.795857 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.796354 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.813774 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:58.814325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.814833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.823618 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 04:32:58.823938 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 04:32:58.825255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] command line args: [] {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 04:32:58.825255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 04:32:58.825255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ================================================================================ {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 04:32:58.825764 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] admin_token = **** {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.825958 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] config_dir = [] {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.826626 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.826965 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] config_source = [] {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.827513 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] debug = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.827902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.828368 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.828698 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.829192 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.829695 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.830133 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] list_limit = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.830467 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] log_config_append = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.830812 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.830961 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:58.831132 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] log_dir = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.831322 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.831466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] log_file = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.831791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.831939 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.832263 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.832422 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.833083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.833241 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.833376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.833543 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.833703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.833835 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.834099 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.834317 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.834477 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.834776 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.834967 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.835307 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.835475 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.835768 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.835904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.836218 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.836369 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.836669 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.836827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.837136 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.837283 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:58.837631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.838164 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.839093 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.94/identity {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.839434 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] publish_errors = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.839871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.840307 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.840643 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.841115 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.841595 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.842050 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] standard_threads = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.842480 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.842953 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.843286 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.843629 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] use_journal = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.843966 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] use_json = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.844299 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] use_stderr = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.844637 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] use_syslog = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.845093 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:32:58.845620 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.846184 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.846551 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.847008 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.847475 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.847933 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.848447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.848959 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.849506 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.849982 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.850677 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.851123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.851599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.852068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.852543 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.853013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.853493 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.854030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.854516 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.855158 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.855577 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.856074 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.856566 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.857040 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.857566 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.858012 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.858451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.858896 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.859343 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.859805 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.860284 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.860729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.861220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.861690 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.862170 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.862665 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.863104 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.863552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.864543 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.865027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.865499 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.865941 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.866509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.866760 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.867024 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.867299 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.867547 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.867797 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.868041 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.868290 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.868533 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.868795 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.869030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.869273 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.869539 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.869778 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.870019 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.870356 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.870678 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.871038 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.871369 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.871704 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.872036 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.872396 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.872735 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.873060 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.873396 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.873795 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.874188 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.874564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.874969 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.875345 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.875678 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.876071 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.876461 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.876807 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.877164 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.877657 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.877999 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.878333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.878666 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.879112 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.880403 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.880644 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.881033 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.881507 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.881850 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.882218 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.882556 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.882890 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.883287 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.883680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.884034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.884418 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.884803 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.885163 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.885551 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.885890 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.886220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.886581 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.886917 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.887266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.887622 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.887968 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.888299 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] auth.external = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.888626 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.889020 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.889346 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.889702 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] auth.password = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.890071 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] auth.token = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.890417 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.890748 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.891093 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.891431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.891775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.892116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.892450 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.892780 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] credential.caching = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.893125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.893509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.893853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.894184 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.894532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.894866 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.895756 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.896103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.896436 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.896781 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.897267 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.897636 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.897992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.898333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.898687 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.899017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] federation.caching = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.899359 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.899700 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.900042 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.900368 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.900710 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.901044 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.901467 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.901777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.902125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.902456 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.902821 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.903151 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] identity.caching = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.903507 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.903851 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.904182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.904513 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.904861 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.905186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.905568 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.905914 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.906263 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.906585 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.906908 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.907101 dv-cinder-854264-1-smb devstack@keystone.service[93411]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x55fc505789c0 pid: 93411 (default app) Aug 24 04:32:58.907308 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.907658 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.908003 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.908390 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.908773 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.909116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.909530 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.909869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.910200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.910525 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.911808 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.912068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.912376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.912716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.913052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.913445 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.913770 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.914056 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168026e4-3047-4fa7-8ce4-6b07acd7610b None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:58.914586 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.914757 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168026e4-3047-4fa7-8ce4-6b07acd7610b None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:58.914899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.915180 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168026e4-3047-4fa7-8ce4-6b07acd7610b None None] PATH_INFO: `/v3` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:58.915325 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.915590 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.915938 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.916269 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.916605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.916930 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.917303 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.917685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.918026 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.918360 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.918693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.919043 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.919420 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.919753 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.920081 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.920427 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.920771 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.921126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.921518 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.922145 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.922331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.user = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.922797 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.922953 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1/1] 10.222.0.94 () {50 vars in 791 bytes} [Wed Aug 24 04:32:58 2022] GET /identity/v3/ => generated 255 bytes in 15 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:32:58.923255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.923771 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.924145 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.924490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.925026 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.925257 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.925677 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.926097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.927065 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.927515 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.927867 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.928253 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.928640 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.929162 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.929602 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.929970 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.930303 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.930657 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.931026 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.931397 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.931788 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.932094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.932434 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.932793 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.933120 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.934062 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.934481 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.934784 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.935035 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.935284 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.935532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.935796 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.936047 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.936367 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.936625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.936897 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] resource.caching = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.937159 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.937457 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.937827 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.938656 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.939071 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.939506 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.939935 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.940323 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.940618 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.940866 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] role.caching = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.941153 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] role.driver = sql {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.941393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.941823 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.943501 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.943934 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.944369 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.944805 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.945182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.945544 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.945871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.946186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.946506 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.946827 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.947147 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.947513 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.948087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.948452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.948825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.949199 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.949663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.950098 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.950493 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.950933 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.951360 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.951957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.952118 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.952452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.952792 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.953148 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.953590 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.954030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.954689 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.954971 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.955253 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.955542 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] token.caching = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.955950 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.956377 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.957006 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.957383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.958256 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.958621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.958994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.959461 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.959893 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.960397 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.960746 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.961079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.961662 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.961939 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.962329 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.962694 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.963164 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.963628 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] database.connection = **** {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.964024 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.964323 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.964657 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.964945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.965281 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.965738 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.966127 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.966450 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.966818 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.967167 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.967590 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.967992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.968406 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.968739 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.969071 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.969536 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.969939 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.970309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:32:58.970552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 04:32:59.008460 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.008824 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.009055 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.023095 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.048347 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.048578 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.111670 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.179701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.180059 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.263943 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.264252 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.264632 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.265028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.265306 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.265586 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.285088 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.285502 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.285781 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.286179 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.286503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.286733 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.287007 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.301826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.420214 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.420478 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.420737 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.421050 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.421389 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.421666 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.422006 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:32:59.435545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.435851 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 04:32:59.436277 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.436608 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 04:32:59.436957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.437227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.437536 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.437870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.450459 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.450734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.451018 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.451308 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.460915 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:59.465062 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:59.465499 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.465869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.466245 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.466607 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.466941 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.467279 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.467625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.468043 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.468525 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.468891 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.500356 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.501951 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:59.502236 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.507980 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:59.508393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.508763 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.517825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:59.518141 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.524620 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:59.524925 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.525231 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.525651 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.525977 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.526350 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.526629 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.527092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.551157 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.552082 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.557726 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:59.562694 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.563225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.569906 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:59.574462 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:59.578262 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.578582 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.579002 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.579478 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.579883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.580150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.604450 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:59.604901 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.605355 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.605689 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.615718 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.618200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.618544 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.624989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:59.625492 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.625902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.626238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.626653 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.645450 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:59.645938 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.646403 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.646900 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.647370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.647761 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.648171 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.674254 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:59.678586 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:59.684502 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.688615 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.691624 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:59.692156 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.693155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.706137 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.709469 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:59.715485 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.716022 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.716536 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.717030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.734437 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:59.735401 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.735574 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.750203 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:32:59.750704 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.751207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.751711 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.752200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.752677 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.753186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.753715 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.754434 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.755462 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.755958 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.756461 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.756933 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.757387 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:32:59.839526 dv-cinder-854264-1-smb devstack@keystone.service[93412]: WSGI app 0 (mountpoint='') ready in 9 seconds on interpreter 0x55fc505789c0 pid: 93412 (default app) Aug 24 04:33:07.971697 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062a243-a8de-4998-bb6e-6e035ba6a931 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:07.972483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062a243-a8de-4998-bb6e-6e035ba6a931 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:07.972630 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062a243-a8de-4998-bb6e-6e035ba6a931 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:07.975263 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 2/2] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:33:07.997937 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73081cc-2fda-4a71-82c0-f0ac91b91a94 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:07.998751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73081cc-2fda-4a71-82c0-f0ac91b91a94 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:07.998887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73081cc-2fda-4a71-82c0-f0ac91b91a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:08.166054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: INFO dbcounter [None req-e73081cc-2fda-4a71-82c0-f0ac91b91a94 None None] Registered counter for database keystone Aug 24 04:33:08.203802 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG oslo_db.sqlalchemy.engines [None req-e73081cc-2fda-4a71-82c0-f0ac91b91a94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93412) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:33:08.215800 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writer thread running {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:33:08.575493 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG passlib.handlers.bcrypt [None req-e73081cc-2fda-4a71-82c0-f0ac91b91a94 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93412) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 04:33:08.576285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG passlib.handlers.bcrypt [None req-e73081cc-2fda-4a71-82c0-f0ac91b91a94 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93412) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 04:33:08.650963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-e73081cc-2fda-4a71-82c0-f0ac91b91a94 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:08.654165 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-e73081cc-2fda-4a71-82c0-f0ac91b91a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:08.932873 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1/3] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 941 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 04:33:09.679458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062a243-a8de-4998-bb6e-6e035ba6a931 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:09.756721 dv-cinder-854264-1-smb devstack@keystone.service[93411]: INFO dbcounter [None req-8062a243-a8de-4998-bb6e-6e035ba6a931 None None] Registered counter for database keystone Aug 24 04:33:09.787145 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG oslo_db.sqlalchemy.engines [None req-8062a243-a8de-4998-bb6e-6e035ba6a931 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93411) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:33:09.804368 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writer thread running {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:33:09.980718 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062a243-a8de-4998-bb6e-6e035ba6a931 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:09.988230 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89528a2c-7044-4355-a084-27e7c620a527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:09.989357 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89528a2c-7044-4355-a084-27e7c620a527 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:09.989859 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89528a2c-7044-4355-a084-27e7c620a527 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:09.990340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89528a2c-7044-4355-a084-27e7c620a527 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:10.007026 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89528a2c-7044-4355-a084-27e7c620a527 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:10.121672 dv-cinder-854264-1-smb devstack@keystone.service[93411]: WARNING keystone.common.rbac_enforcer.enforcer [None req-89528a2c-7044-4355-a084-27e7c620a527 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 04:33:10.122235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89528a2c-7044-4355-a084-27e7c620a527 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:10.141779 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 3/4] 10.222.0.94 () {58 vars in 1324 bytes} [Wed Aug 24 04:33:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:33:10.152884 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73081cc-2fda-4a71-82c0-f0ac91b91a94 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:10.182247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73081cc-2fda-4a71-82c0-f0ac91b91a94 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:10.190438 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9333ff8-4afc-48c6-ae0b-026ad6e5e127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:10.193064 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9333ff8-4afc-48c6-ae0b-026ad6e5e127 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:10.193587 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9333ff8-4afc-48c6-ae0b-026ad6e5e127 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:10.194078 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9333ff8-4afc-48c6-ae0b-026ad6e5e127 admin admin] PATH_INFO: `/v3/projects/dde3279595394b269fd2ccc96531ea28` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:10.197110 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9333ff8-4afc-48c6-ae0b-026ad6e5e127 admin admin] RBAC: Authorizing `identity:get_project(project_id=dde3279595394b269fd2ccc96531ea28)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:10.310587 dv-cinder-854264-1-smb devstack@keystone.service[93412]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c9333ff8-4afc-48c6-ae0b-026ad6e5e127 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 04:33:10.311139 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9333ff8-4afc-48c6-ae0b-026ad6e5e127 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:10.319672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 2/5] 10.222.0.94 () {56 vars in 1207 bytes} [Wed Aug 24 04:33:10 2022] GET /identity/v3/projects/dde3279595394b269fd2ccc96531ea28 => generated 344 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:13.605690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20b640-a926-409c-832d-f0088d74bca7 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:13.606572 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20b640-a926-409c-832d-f0088d74bca7 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:13.606721 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20b640-a926-409c-832d-f0088d74bca7 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:13.617541 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 4/6] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:13 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:33:13.628499 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfac70-99dd-430d-bc1d-9825f85ad5ab None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:13.629380 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfac70-99dd-430d-bc1d-9825f85ad5ab None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:13.629569 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfac70-99dd-430d-bc1d-9825f85ad5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:13.668183 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-10dfac70-99dd-430d-bc1d-9825f85ad5ab None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:13.671085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-10dfac70-99dd-430d-bc1d-9825f85ad5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:13.686124 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 3/7] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 04:33:14.066551 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20b640-a926-409c-832d-f0088d74bca7 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:14.081387 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20b640-a926-409c-832d-f0088d74bca7 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:14.087077 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df77b0-5aa3-420d-9396-a289cb51b4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:14.087815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df77b0-5aa3-420d-9396-a289cb51b4ee admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:14.088169 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df77b0-5aa3-420d-9396-a289cb51b4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:14.088494 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df77b0-5aa3-420d-9396-a289cb51b4ee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:14.099553 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df77b0-5aa3-420d-9396-a289cb51b4ee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:14.101939 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df77b0-5aa3-420d-9396-a289cb51b4ee admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:14.113288 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 5/8] 10.222.0.94 () {58 vars in 1324 bytes} [Wed Aug 24 04:33:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:33:14.120284 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfac70-99dd-430d-bc1d-9825f85ad5ab None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:14.131214 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfac70-99dd-430d-bc1d-9825f85ad5ab None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:14.136322 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0818b0-02f3-4d00-a1a8-7a358b0adb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:14.137040 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0818b0-02f3-4d00-a1a8-7a358b0adb88 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:14.137362 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0818b0-02f3-4d00-a1a8-7a358b0adb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:14.137733 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0818b0-02f3-4d00-a1a8-7a358b0adb88 admin admin] PATH_INFO: `/v3/users/4df458c2526a46c5a13d982659afe50c` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:14.139273 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0818b0-02f3-4d00-a1a8-7a358b0adb88 admin admin] RBAC: Authorizing `identity:get_user(user_id=4df458c2526a46c5a13d982659afe50c)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:14.141547 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0818b0-02f3-4d00-a1a8-7a358b0adb88 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:14.143567 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 4/9] 10.222.0.94 () {56 vars in 1198 bytes} [Wed Aug 24 04:33:14 2022] GET /identity/v3/users/4df458c2526a46c5a13d982659afe50c => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:16.886869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fe3e3-f7c4-4989-8101-2ab31a08e997 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:16.887635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fe3e3-f7c4-4989-8101-2ab31a08e997 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:16.887852 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fe3e3-f7c4-4989-8101-2ab31a08e997 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:16.890737 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 6/10] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:33:16.901277 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa22f28-8d76-448c-83ef-594c6ccf007f None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:16.902093 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa22f28-8d76-448c-83ef-594c6ccf007f None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:16.902298 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa22f28-8d76-448c-83ef-594c6ccf007f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:16.936072 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-4fa22f28-8d76-448c-83ef-594c6ccf007f None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:16.938337 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-4fa22f28-8d76-448c-83ef-594c6ccf007f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:17.055240 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 5/11] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:33:17.141658 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6073e4-03f9-4577-b2b6-6e926589759c None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:17.142088 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6073e4-03f9-4577-b2b6-6e926589759c None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:17.142459 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6073e4-03f9-4577-b2b6-6e926589759c None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:17.144567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 7/12] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:33:17.151594 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f5d4a-894f-496c-b54c-e4508d3ef1e1 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:17.152072 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f5d4a-894f-496c-b54c-e4508d3ef1e1 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:17.152291 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f5d4a-894f-496c-b54c-e4508d3ef1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:17.174514 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-8d6f5d4a-894f-496c-b54c-e4508d3ef1e1 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:17.176095 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-8d6f5d4a-894f-496c-b54c-e4508d3ef1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:17.200174 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:17.306866 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 6/13] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:33:17.455894 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6073e4-03f9-4577-b2b6-6e926589759c None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:17.696242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f5d4a-894f-496c-b54c-e4508d3ef1e1 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:17.762220 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6073e4-03f9-4577-b2b6-6e926589759c None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:17.822514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024c61c-c797-4ac9-b91a-529dcc4a21c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:17.823255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024c61c-c797-4ac9-b91a-529dcc4a21c2 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:17.823609 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024c61c-c797-4ac9-b91a-529dcc4a21c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:17.823968 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024c61c-c797-4ac9-b91a-529dcc4a21c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:17.875490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f5d4a-894f-496c-b54c-e4508d3ef1e1 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:17.891129 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:17.933229 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024c61c-c797-4ac9-b91a-529dcc4a21c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:17.934990 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024c61c-c797-4ac9-b91a-529dcc4a21c2 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:17.947459 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9aaa8-6002-48b4-bf5f-466aad6dafdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:17.948639 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9aaa8-6002-48b4-bf5f-466aad6dafdd None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:17.949134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9aaa8-6002-48b4-bf5f-466aad6dafdd None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:17.949664 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9aaa8-6002-48b4-bf5f-466aad6dafdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:17.975075 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9aaa8-6002-48b4-bf5f-466aad6dafdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:33:17.993010 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-0de9aaa8-6002-48b4-bf5f-466aad6dafdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:33:17.993010 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:33:17.993010 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:33:17.993010 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:33:17.993010 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:33:17.993010 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:33:17.993010 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:33:17.993010 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:33:17.993010 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:33:17.993010 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:33:17.993010 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:33:17.993010 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:33:17.993010 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:33:17.993010 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:33:17.993010 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:33:17.993010 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:33:17.994749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:33:17.994749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:33:17.994749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:33:17.994749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:33:17.994749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:33:17.994749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:33:17.994749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:33:17.994749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:33:17.994749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:33:17.994749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:33:17.994749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:33:17.994749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:33:17.994749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:33:17.994749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:33:17.994749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:33:17.994749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:33:17.996242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:33:17.996242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:33:17.996242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:33:17.996242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:33:17.996242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:33:17.996242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:33:17.996242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:33:17.996242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:33:17.996242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:33:17.996242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:33:17.996242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:33:17.996242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:33:17.996242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 7/14] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:33:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:33:18.005856 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9aaa8-6002-48b4-bf5f-466aad6dafdd None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:18.036963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:18.102868 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 8/15] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:33:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:33:18.112001 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024c61c-c797-4ac9-b91a-529dcc4a21c2 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:18.207038 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9aaa8-6002-48b4-bf5f-466aad6dafdd None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:18.259114 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a536d1f-0e43-4bea-ab81-45b72df70c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:18.259731 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:18.259999 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a536d1f-0e43-4bea-ab81-45b72df70c35 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:18.260402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a536d1f-0e43-4bea-ab81-45b72df70c35 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:18.261030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a536d1f-0e43-4bea-ab81-45b72df70c35 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:18.261934 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a536d1f-0e43-4bea-ab81-45b72df70c35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:33:18.262388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a536d1f-0e43-4bea-ab81-45b72df70c35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:18.265042 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a536d1f-0e43-4bea-ab81-45b72df70c35 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:18.289620 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 8/16] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:33:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:33:18.298944 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a536d1f-0e43-4bea-ab81-45b72df70c35 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:18.309985 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024c61c-c797-4ac9-b91a-529dcc4a21c2 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:18.377225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016e789-e507-4deb-8e92-d0f0d2e06b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:18.378790 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016e789-e507-4deb-8e92-d0f0d2e06b72 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:18.382289 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016e789-e507-4deb-8e92-d0f0d2e06b72 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:18.382289 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016e789-e507-4deb-8e92-d0f0d2e06b72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:18.416267 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016e789-e507-4deb-8e92-d0f0d2e06b72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:18.418048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:18.419144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016e789-e507-4deb-8e92-d0f0d2e06b72 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:18.454794 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a536d1f-0e43-4bea-ab81-45b72df70c35 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:18.455233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-b016e789-e507-4deb-8e92-d0f0d2e06b72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:33:18.455233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:33:18.455233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:33:18.455233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:33:18.455233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:33:18.455233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:33:18.455233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:33:18.455233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:33:18.455233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:33:18.455233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:33:18.455233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:33:18.455233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:33:18.455233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:33:18.455233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:33:18.455233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:33:18.455233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:33:18.456771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:33:18.456771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:33:18.456771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:33:18.456771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:33:18.456771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:33:18.456771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:33:18.456771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:33:18.456771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:33:18.456771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:33:18.456771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:33:18.456771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:33:18.456771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:33:18.456771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:33:18.456771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:33:18.456771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:33:18.456771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:33:18.456771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:33:18.458879 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:33:18.458879 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:33:18.458879 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:33:18.458879 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 9/17] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:33:18.468063 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016e789-e507-4deb-8e92-d0f0d2e06b72 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:18.512546 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94eee0c-ce3f-4445-8594-73658ca08198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:18.513687 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94eee0c-ce3f-4445-8594-73658ca08198 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:18.514188 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94eee0c-ce3f-4445-8594-73658ca08198 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:18.514681 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94eee0c-ce3f-4445-8594-73658ca08198 None admin] PATH_INFO: `/v3/users/4df458c2526a46c5a13d982659afe50c` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:18.516903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94eee0c-ce3f-4445-8594-73658ca08198 None admin] RBAC: Authorizing `identity:get_user(user_id=4df458c2526a46c5a13d982659afe50c)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:18.520966 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94eee0c-ce3f-4445-8594-73658ca08198 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:18.529490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 9/18] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:33:18 2022] GET /identity/v3/users/4df458c2526a46c5a13d982659afe50c => generated 247 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:33:18.531294 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94eee0c-ce3f-4445-8594-73658ca08198 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:18.630791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016e789-e507-4deb-8e92-d0f0d2e06b72 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:18.665565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:18.678724 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c2248-db6f-44a8-9739-11685f9ee6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:18.679510 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c2248-db6f-44a8-9739-11685f9ee6f5 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:18.679946 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c2248-db6f-44a8-9739-11685f9ee6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:18.680387 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c2248-db6f-44a8-9739-11685f9ee6f5 None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:18.681500 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c2248-db6f-44a8-9739-11685f9ee6f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:33:18.681975 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c2248-db6f-44a8-9739-11685f9ee6f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:18.684496 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c2248-db6f-44a8-9739-11685f9ee6f5 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:18.711052 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 10/19] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:33:18.739397 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94eee0c-ce3f-4445-8594-73658ca08198 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:18.813672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3334b21-cdc5-4b37-9541-6d09f1e77bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:18.814888 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3334b21-cdc5-4b37-9541-6d09f1e77bf1 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:18.815407 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3334b21-cdc5-4b37-9541-6d09f1e77bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:18.815887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3334b21-cdc5-4b37-9541-6d09f1e77bf1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:18.819051 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3334b21-cdc5-4b37-9541-6d09f1e77bf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:18.821933 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3334b21-cdc5-4b37-9541-6d09f1e77bf1 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:18.824933 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 10/20] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:33:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:18.835878 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c2248-db6f-44a8-9739-11685f9ee6f5 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:19.050312 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c2248-db6f-44a8-9739-11685f9ee6f5 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:19.128971 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c01b3-dbe1-4f1d-9db9-b747a21b5bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:19.130978 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c01b3-dbe1-4f1d-9db9-b747a21b5bbb None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:19.131537 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c01b3-dbe1-4f1d-9db9-b747a21b5bbb None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:19.131967 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c01b3-dbe1-4f1d-9db9-b747a21b5bbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:19.133392 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c01b3-dbe1-4f1d-9db9-b747a21b5bbb None admin] RBAC: Adding query filter params (role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2, scope.domain.id=default, user.id=4df458c2526a46c5a13d982659afe50c) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:33:19.133953 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c01b3-dbe1-4f1d-9db9-b747a21b5bbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:19.136881 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c01b3-dbe1-4f1d-9db9-b747a21b5bbb None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:19.155619 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 11/21] 10.222.0.94 () {56 vars in 1322 bytes} [Wed Aug 24 04:33:18 2022] GET /identity/v3/role_assignments?user.id=4df458c2526a46c5a13d982659afe50c&scope.domain.id=default&role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 233 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:33:23.388141 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e023eff-2c7c-4109-a8fe-e48032dcf4f0 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:23.389914 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e023eff-2c7c-4109-a8fe-e48032dcf4f0 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:23.390726 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e023eff-2c7c-4109-a8fe-e48032dcf4f0 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:23.393644 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 11/22] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:33:23.404278 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382f60d-8b37-458c-beec-45c0a1cd0c3b None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:23.405968 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382f60d-8b37-458c-beec-45c0a1cd0c3b None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:23.406828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382f60d-8b37-458c-beec-45c0a1cd0c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:23.450899 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG passlib.handlers.bcrypt [None req-d382f60d-8b37-458c-beec-45c0a1cd0c3b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93411) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 04:33:23.452091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG passlib.handlers.bcrypt [None req-d382f60d-8b37-458c-beec-45c0a1cd0c3b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93411) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 04:33:23.508274 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-d382f60d-8b37-458c-beec-45c0a1cd0c3b None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:23.511413 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-d382f60d-8b37-458c-beec-45c0a1cd0c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:23.640065 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:23.694307 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 12/23] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:33:23.747315 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e73a3-0948-4c1b-bd51-b11cb83a89c7 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:23.747793 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e73a3-0948-4c1b-bd51-b11cb83a89c7 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:23.748261 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e73a3-0948-4c1b-bd51-b11cb83a89c7 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:23.755508 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 12/24] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:23 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:33:23.765691 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee5e3b-f521-4435-93f0-e3eb3c847370 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:23.766736 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee5e3b-f521-4435-93f0-e3eb3c847370 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:23.767499 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee5e3b-f521-4435-93f0-e3eb3c847370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:23.787488 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643143e-5d89-4417-9e99-98967a1b6448 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:23.788167 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643143e-5d89-4417-9e99-98967a1b6448 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:23.788682 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643143e-5d89-4417-9e99-98967a1b6448 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:23.790597 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 13/25] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:33:23.811003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-48ee5e3b-f521-4435-93f0-e3eb3c847370 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:23.813197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-48ee5e3b-f521-4435-93f0-e3eb3c847370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:23.822306 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02994132-8054-4a4c-9c3f-4cfea316e123 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:23.823090 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02994132-8054-4a4c-9c3f-4cfea316e123 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:23.823685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02994132-8054-4a4c-9c3f-4cfea316e123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:23.872992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-02994132-8054-4a4c-9c3f-4cfea316e123 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:23.875389 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-02994132-8054-4a4c-9c3f-4cfea316e123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:23.901550 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:23.954279 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 13/26] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:33:24.056575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 14/27] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:33:24.366396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee5e3b-f521-4435-93f0-e3eb3c847370 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:24.495591 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5780b9-5edb-4d27-ab31-3b3659e25d6d None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:24.496836 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5780b9-5edb-4d27-ab31-3b3659e25d6d None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:24.497480 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5780b9-5edb-4d27-ab31-3b3659e25d6d None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:24.500160 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 15/28] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:33:24.519550 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5780b9-5edb-4d27-ab31-3b3659e25d6d None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:24.655618 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee5e3b-f521-4435-93f0-e3eb3c847370 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:24.677806 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:24.744679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5780b9-5edb-4d27-ab31-3b3659e25d6d None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:24.756460 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ab21a-61c4-41e0-bafb-0ce79a195e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:24.757657 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ab21a-61c4-41e0-bafb-0ce79a195e57 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:24.758391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ab21a-61c4-41e0-bafb-0ce79a195e57 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:24.759006 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ab21a-61c4-41e0-bafb-0ce79a195e57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:24.784170 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ab21a-61c4-41e0-bafb-0ce79a195e57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:33:24.796323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-a41ab21a-61c4-41e0-bafb-0ce79a195e57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:33:24.796323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:33:24.796323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:33:24.796323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:33:24.796323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:33:24.796323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:33:24.796323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:33:24.796323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:33:24.796323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:33:24.796323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:33:24.796323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:33:24.796323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:33:24.796323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:33:24.796323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:33:24.796323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:33:24.796323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:33:24.798225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:33:24.798225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:33:24.798225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:33:24.798225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:33:24.798225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:33:24.798225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:33:24.798225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:33:24.798225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:33:24.798225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:33:24.798225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:33:24.798225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:33:24.798225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:33:24.798225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:33:24.798225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:33:24.798225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:33:24.798225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:33:24.799754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:33:24.799754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:33:24.799754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:33:24.799754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:33:24.799754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:33:24.799754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:33:24.799754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:33:24.799754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:33:24.799754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:33:24.799754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:33:24.799754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:33:24.799754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:33:24.802947 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 14/29] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:33:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 435 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:33:24.803945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c5074-0433-45fa-985e-033e58c0f69a None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:24.805258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c5074-0433-45fa-985e-033e58c0f69a None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:24.805826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c5074-0433-45fa-985e-033e58c0f69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:24.818480 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9ce97-b3b8-4072-8021-820211950662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:24.819459 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9ce97-b3b8-4072-8021-820211950662 None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:24.819965 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9ce97-b3b8-4072-8021-820211950662 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:24.820374 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9ce97-b3b8-4072-8021-820211950662 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:24.821640 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9ce97-b3b8-4072-8021-820211950662 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:24.824305 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9ce97-b3b8-4072-8021-820211950662 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:24.842790 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-c10c5074-0433-45fa-985e-033e58c0f69a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:24.845149 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-c10c5074-0433-45fa-985e-033e58c0f69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:24.851578 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:24.999179 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 15/30] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:33:25.001747 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5689378-a074-4d25-911c-cc7b2405ec57 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:25.002020 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5689378-a074-4d25-911c-cc7b2405ec57 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:25.002478 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5689378-a074-4d25-911c-cc7b2405ec57 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:25.005715 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 16/31] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:33:25.007235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5689378-a074-4d25-911c-cc7b2405ec57 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:25.070491 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 16/32] 10.222.0.94 () {60 vars in 1131 bytes} [Wed Aug 24 04:33:24 2022] POST /identity/v3/roles => generated 225 bytes in 552 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:33:25.072175 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9ce97-b3b8-4072-8021-820211950662 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:25.337247 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:25.345393 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5689378-a074-4d25-911c-cc7b2405ec57 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:25.415534 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9ce97-b3b8-4072-8021-820211950662 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:25.424067 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fe111-c61a-490d-97f4-8d9567e7f365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:25.425327 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fe111-c61a-490d-97f4-8d9567e7f365 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:25.426500 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fe111-c61a-490d-97f4-8d9567e7f365 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:25.427017 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fe111-c61a-490d-97f4-8d9567e7f365 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:25.454545 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3fe111-c61a-490d-97f4-8d9567e7f365 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:25.458202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3fe111-c61a-490d-97f4-8d9567e7f365 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:25.492889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-bb3fe111-c61a-490d-97f4-8d9567e7f365 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:33:25.492889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:33:25.492889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:33:25.492889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:33:25.492889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:33:25.492889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:33:25.492889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:33:25.492889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:33:25.492889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:33:25.492889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:33:25.492889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:33:25.492889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:33:25.492889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:33:25.492889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:33:25.492889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:33:25.492889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:33:25.494762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:33:25.494762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:33:25.494762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:33:25.494762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:33:25.494762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:33:25.494762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:33:25.494762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:33:25.494762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:33:25.494762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:33:25.494762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:33:25.494762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:33:25.494762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:33:25.494762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:33:25.494762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:33:25.494762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:33:25.494762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:33:25.494762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:33:25.496312 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:33:25.496312 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:33:25.496312 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:33:25.496312 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 17/33] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 488 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:33:25.496312 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40764c63-70fd-4cac-9037-4fca03517825 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:25.496312 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40764c63-70fd-4cac-9037-4fca03517825 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:25.496950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40764c63-70fd-4cac-9037-4fca03517825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:25.498357 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b82662-5661-4cd4-8245-fd7e1a58619a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:25.500356 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b82662-5661-4cd4-8245-fd7e1a58619a None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:25.501196 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b82662-5661-4cd4-8245-fd7e1a58619a None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:25.501909 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b82662-5661-4cd4-8245-fd7e1a58619a None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:25.503592 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b82662-5661-4cd4-8245-fd7e1a58619a None admin] RBAC: Adding query filter params (name=admin) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:33:25.504671 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b82662-5661-4cd4-8245-fd7e1a58619a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:25.507723 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b82662-5661-4cd4-8245-fd7e1a58619a None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:25.522284 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-40764c63-70fd-4cac-9037-4fca03517825 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:25.523647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-40764c63-70fd-4cac-9037-4fca03517825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:25.526503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 17/34] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:33:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:25.529460 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd639763-f0a3-4d83-bfbf-11097f92ad6a None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:25.529460 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd639763-f0a3-4d83-bfbf-11097f92ad6a None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:25.529802 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd639763-f0a3-4d83-bfbf-11097f92ad6a None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:25.532936 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 18/35] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:33:25.534598 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd639763-f0a3-4d83-bfbf-11097f92ad6a None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:25.650647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 18/36] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:33:25.651720 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40764c63-70fd-4cac-9037-4fca03517825 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:25.674695 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:25.771235 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd639763-f0a3-4d83-bfbf-11097f92ad6a None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:25.826988 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:25.843178 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f6899-09ae-4491-833f-c1bac89284f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:25.844399 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f6899-09ae-4491-833f-c1bac89284f2 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:25.844916 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f6899-09ae-4491-833f-c1bac89284f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:25.845460 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f6899-09ae-4491-833f-c1bac89284f2 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:25.846605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f6899-09ae-4491-833f-c1bac89284f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:33:25.847174 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f6899-09ae-4491-833f-c1bac89284f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:25.850172 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f6899-09ae-4491-833f-c1bac89284f2 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:25.860656 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40764c63-70fd-4cac-9037-4fca03517825 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:25.874317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 19/37] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:25.881255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743c20a-e692-4d51-84b0-55a499732d27 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:25.881738 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743c20a-e692-4d51-84b0-55a499732d27 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:25.882274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743c20a-e692-4d51-84b0-55a499732d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:25.915933 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-8743c20a-e692-4d51-84b0-55a499732d27 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:25.918708 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-8743c20a-e692-4d51-84b0-55a499732d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:25.935778 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009834b5-aa3b-460e-b04b-2157952a220c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:25.937626 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009834b5-aa3b-460e-b04b-2157952a220c None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:25.938164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009834b5-aa3b-460e-b04b-2157952a220c None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:25.938531 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009834b5-aa3b-460e-b04b-2157952a220c None admin] PATH_INFO: `/v3/users/4df458c2526a46c5a13d982659afe50c` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:25.942502 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009834b5-aa3b-460e-b04b-2157952a220c None admin] RBAC: Authorizing `identity:get_user(user_id=4df458c2526a46c5a13d982659afe50c)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:25.945223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009834b5-aa3b-460e-b04b-2157952a220c None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:25.948116 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 19/38] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:33:25 2022] GET /identity/v3/users/4df458c2526a46c5a13d982659afe50c => generated 247 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:25.949537 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009834b5-aa3b-460e-b04b-2157952a220c None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:26.077452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 20/39] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:33:26.077452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743c20a-e692-4d51-84b0-55a499732d27 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:26.185521 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009834b5-aa3b-460e-b04b-2157952a220c None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:26.206079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:26.257043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94946ca-9c7d-4b1c-bf08-3928a7323cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:26.258165 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94946ca-9c7d-4b1c-bf08-3928a7323cb9 None admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:26.258732 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94946ca-9c7d-4b1c-bf08-3928a7323cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:26.259125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94946ca-9c7d-4b1c-bf08-3928a7323cb9 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:26.260758 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94946ca-9c7d-4b1c-bf08-3928a7323cb9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:26.263215 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94946ca-9c7d-4b1c-bf08-3928a7323cb9 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:26.287717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743c20a-e692-4d51-84b0-55a499732d27 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:26.366693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebe4db-a0e8-4627-86a6-4d69a3cad2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:26.367700 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebe4db-a0e8-4627-86a6-4d69a3cad2ee None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:26.368016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebe4db-a0e8-4627-86a6-4d69a3cad2ee None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:26.368290 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebe4db-a0e8-4627-86a6-4d69a3cad2ee None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:26.368975 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebe4db-a0e8-4627-86a6-4d69a3cad2ee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:26.371049 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebe4db-a0e8-4627-86a6-4d69a3cad2ee None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:26.443355 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 21/40] 10.222.0.94 () {60 vars in 1141 bytes} [Wed Aug 24 04:33:26 2022] POST /identity/v3/projects => generated 301 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:33:26.444477 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebe4db-a0e8-4627-86a6-4d69a3cad2ee None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:26.499306 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 20/41] 10.222.0.94 () {60 vars in 1131 bytes} [Wed Aug 24 04:33:25 2022] POST /identity/v3/roles => generated 219 bytes in 551 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:33:26.501319 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94946ca-9c7d-4b1c-bf08-3928a7323cb9 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:26.533576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:26.697719 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebe4db-a0e8-4627-86a6-4d69a3cad2ee None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:26.703975 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:26.778186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbf318-4248-40de-908f-62c241df427f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:26.779891 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbf318-4248-40de-908f-62c241df427f None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:26.780367 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbf318-4248-40de-908f-62c241df427f None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:26.780822 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbf318-4248-40de-908f-62c241df427f None admin] PATH_INFO: `/v3/domains/default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:26.782991 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdbf318-4248-40de-908f-62c241df427f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:26.784887 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94946ca-9c7d-4b1c-bf08-3928a7323cb9 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:26.787044 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdbf318-4248-40de-908f-62c241df427f None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:26.789974 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 22/42] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:33:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:26.791429 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbf318-4248-40de-908f-62c241df427f None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:26.870765 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fde750-1a8b-4289-b1cb-ea13af75489f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:26.871961 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fde750-1a8b-4289-b1cb-ea13af75489f None admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:26.872520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fde750-1a8b-4289-b1cb-ea13af75489f None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:26.873072 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fde750-1a8b-4289-b1cb-ea13af75489f None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:26.874508 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fde750-1a8b-4289-b1cb-ea13af75489f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:26.879346 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fde750-1a8b-4289-b1cb-ea13af75489f None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:26.908579 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 21/43] 10.222.0.94 () {60 vars in 1131 bytes} [Wed Aug 24 04:33:26 2022] POST /identity/v3/roles => generated 223 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:33:26.911766 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fde750-1a8b-4289-b1cb-ea13af75489f None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:27.036709 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbf318-4248-40de-908f-62c241df427f None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:27.078660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:27.110551 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64ba4a-b6c1-4dce-b151-3ac5b7def6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:27.111741 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64ba4a-b6c1-4dce-b151-3ac5b7def6bf None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:27.112263 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64ba4a-b6c1-4dce-b151-3ac5b7def6bf None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:27.112754 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64ba4a-b6c1-4dce-b151-3ac5b7def6bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:27.115654 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64ba4a-b6c1-4dce-b151-3ac5b7def6bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:27.118678 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64ba4a-b6c1-4dce-b151-3ac5b7def6bf None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:27.122006 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 23/44] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:33:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:27.132623 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64ba4a-b6c1-4dce-b151-3ac5b7def6bf None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:27.159794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fde750-1a8b-4289-b1cb-ea13af75489f None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:27.228024 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:27.244813 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076d03b-1bb7-488f-a57e-67c1b372eed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:27.246580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076d03b-1bb7-488f-a57e-67c1b372eed1 None admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:27.247631 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076d03b-1bb7-488f-a57e-67c1b372eed1 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:27.247631 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076d03b-1bb7-488f-a57e-67c1b372eed1 None admin] PATH_INFO: `/v3/domains/default/users/4df458c2526a46c5a13d982659afe50c/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:27.251687 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076d03b-1bb7-488f-a57e-67c1b372eed1 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4df458c2526a46c5a13d982659afe50c, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:27.255196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076d03b-1bb7-488f-a57e-67c1b372eed1 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:27.280857 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 22/45] 10.222.0.94 () {58 vars in 1361 bytes} [Wed Aug 24 04:33:26 2022] PUT /identity/v3/domains/default/users/4df458c2526a46c5a13d982659afe50c/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:33:27.361451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64ba4a-b6c1-4dce-b151-3ac5b7def6bf None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:27.435657 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9876b-81cb-48df-b108-267049601b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:27.436720 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9876b-81cb-48df-b108-267049601b94 None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:27.437225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9876b-81cb-48df-b108-267049601b94 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:27.437714 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9876b-81cb-48df-b108-267049601b94 None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:27.438869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9876b-81cb-48df-b108-267049601b94 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:27.442346 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9876b-81cb-48df-b108-267049601b94 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:27.493509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 24/46] 10.222.0.94 () {60 vars in 1141 bytes} [Wed Aug 24 04:33:27 2022] POST /identity/v3/projects => generated 312 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:33:30.459566 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c87d9a-843e-4bce-985e-845a0b4d1f55 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:30.460422 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c87d9a-843e-4bce-985e-845a0b4d1f55 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:30.460422 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c87d9a-843e-4bce-985e-845a0b4d1f55 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:30.462522 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 23/47] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:33:30.469669 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60692d-898a-47fb-ac44-15f66f0fd9ed None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:30.470423 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60692d-898a-47fb-ac44-15f66f0fd9ed None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:30.470423 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60692d-898a-47fb-ac44-15f66f0fd9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:30.491742 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-1b60692d-898a-47fb-ac44-15f66f0fd9ed None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:30.493113 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-1b60692d-898a-47fb-ac44-15f66f0fd9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:30.581928 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 25/48] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:33:30.869904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c87d9a-843e-4bce-985e-845a0b4d1f55 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:30.934310 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05436674-527c-4723-9b62-bfaa948daa5c None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:30.934680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05436674-527c-4723-9b62-bfaa948daa5c None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:30.935185 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05436674-527c-4723-9b62-bfaa948daa5c None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:30.937936 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 26/49] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:33:30.949469 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f6bc7-658b-451f-996f-b53ee20888a0 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:30.950257 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f6bc7-658b-451f-996f-b53ee20888a0 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:30.950470 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f6bc7-658b-451f-996f-b53ee20888a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:30.979870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-943f6bc7-658b-451f-996f-b53ee20888a0 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:30.982150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-943f6bc7-658b-451f-996f-b53ee20888a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:31.007701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:31.028490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c87d9a-843e-4bce-985e-845a0b4d1f55 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:31.081471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:31.092865 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca11095-7e84-4ced-a756-60cd8c246711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:31.093750 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca11095-7e84-4ced-a756-60cd8c246711 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:31.094139 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca11095-7e84-4ced-a756-60cd8c246711 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:31.094550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca11095-7e84-4ced-a756-60cd8c246711 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:31.105800 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 27/50] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:33:31.109855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca11095-7e84-4ced-a756-60cd8c246711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:33:31.115197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-aca11095-7e84-4ced-a756-60cd8c246711 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:33:31.115197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:33:31.115197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:33:31.115197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:33:31.115197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:33:31.115197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:33:31.115197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:33:31.115197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:33:31.115197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:33:31.115197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:33:31.115197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:33:31.115197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:33:31.115197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:33:31.115197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:33:31.115197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:33:31.115197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:33:31.116827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:33:31.116827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:33:31.116827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:33:31.116827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:33:31.116827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:33:31.116827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:33:31.116827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:33:31.116827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:33:31.116827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:33:31.116827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:33:31.116827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:33:31.116827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:33:31.116827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:33:31.116827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:33:31.116827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:33:31.116827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:33:31.118592 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:33:31.118592 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:33:31.118592 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:33:31.118592 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:33:31.118592 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:33:31.118592 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:33:31.118592 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:33:31.118592 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:33:31.118592 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:33:31.118592 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:33:31.118592 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:33:31.118592 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:33:31.118592 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 24/51] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:33:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:33:31.124666 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f6bc7-658b-451f-996f-b53ee20888a0 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:31.255221 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f6bc7-658b-451f-996f-b53ee20888a0 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:31.482766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a165c-7ff9-44ea-bd66-c68403b3048d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:31.483716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a165c-7ff9-44ea-bd66-c68403b3048d None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:31.484242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a165c-7ff9-44ea-bd66-c68403b3048d None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:31.484712 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a165c-7ff9-44ea-bd66-c68403b3048d None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:31.486185 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a165c-7ff9-44ea-bd66-c68403b3048d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:33:31.486625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a165c-7ff9-44ea-bd66-c68403b3048d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:31.490952 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a165c-7ff9-44ea-bd66-c68403b3048d None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:31.508381 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 28/52] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:33:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:33:31.515474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca11095-7e84-4ced-a756-60cd8c246711 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:31.550600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a165c-7ff9-44ea-bd66-c68403b3048d None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:31.581085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:31.701213 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca11095-7e84-4ced-a756-60cd8c246711 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:31.732017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a165c-7ff9-44ea-bd66-c68403b3048d None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:31.755492 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705d522-eaa0-44dd-ad94-c926b8461fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:31.756453 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705d522-eaa0-44dd-ad94-c926b8461fda None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:31.756907 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705d522-eaa0-44dd-ad94-c926b8461fda None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:31.757375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705d522-eaa0-44dd-ad94-c926b8461fda None admin] PATH_INFO: `/v3/users/4df458c2526a46c5a13d982659afe50c` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:31.759775 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705d522-eaa0-44dd-ad94-c926b8461fda None admin] RBAC: Authorizing `identity:get_user(user_id=4df458c2526a46c5a13d982659afe50c)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:31.763038 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705d522-eaa0-44dd-ad94-c926b8461fda None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:31.766775 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 25/53] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:33:31 2022] GET /identity/v3/users/4df458c2526a46c5a13d982659afe50c => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:31.775955 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705d522-eaa0-44dd-ad94-c926b8461fda None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:31.802277 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533343d-a24c-40b4-9018-ca831aa2b6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:31.803448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533343d-a24c-40b4-9018-ca831aa2b6e7 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:31.803971 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533343d-a24c-40b4-9018-ca831aa2b6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:31.804478 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533343d-a24c-40b4-9018-ca831aa2b6e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:31.806816 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533343d-a24c-40b4-9018-ca831aa2b6e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:31.809743 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533343d-a24c-40b4-9018-ca831aa2b6e7 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:31.812858 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 29/54] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:33:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:33:31.820439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533343d-a24c-40b4-9018-ca831aa2b6e7 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:31.880796 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:31.955649 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705d522-eaa0-44dd-ad94-c926b8461fda None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:31.971033 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:32.006122 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71349760-8006-4687-94e9-5ddc3a6e3edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:32.006837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71349760-8006-4687-94e9-5ddc3a6e3edb None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:32.007208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71349760-8006-4687-94e9-5ddc3a6e3edb None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:32.007583 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71349760-8006-4687-94e9-5ddc3a6e3edb None admin] PATH_INFO: `/v3/domains/default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:32.009048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71349760-8006-4687-94e9-5ddc3a6e3edb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:32.010748 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71349760-8006-4687-94e9-5ddc3a6e3edb None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:32.012645 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 26/55] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:33:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:33:32.015032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533343d-a24c-40b4-9018-ca831aa2b6e7 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:32.019414 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71349760-8006-4687-94e9-5ddc3a6e3edb None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:32.089977 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91960d6-5cee-497b-a1e0-d36a4ff1735a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:32.091026 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91960d6-5cee-497b-a1e0-d36a4ff1735a None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:32.091488 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91960d6-5cee-497b-a1e0-d36a4ff1735a None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:32.091944 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91960d6-5cee-497b-a1e0-d36a4ff1735a None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:32.092906 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91960d6-5cee-497b-a1e0-d36a4ff1735a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:32.095535 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91960d6-5cee-497b-a1e0-d36a4ff1735a None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:32.139284 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 30/56] 10.222.0.94 () {60 vars in 1140 bytes} [Wed Aug 24 04:33:31 2022] POST /identity/v3/projects => generated 298 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:33:32.203173 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71349760-8006-4687-94e9-5ddc3a6e3edb None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:32.261545 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:32.280908 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc10cb-d2ca-4093-9a28-7c2606409544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:32.282057 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc10cb-d2ca-4093-9a28-7c2606409544 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:32.282556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc10cb-d2ca-4093-9a28-7c2606409544 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:32.283058 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc10cb-d2ca-4093-9a28-7c2606409544 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:32.284500 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc10cb-d2ca-4093-9a28-7c2606409544 None admin] RBAC: Adding query filter params (role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2, scope.domain.id=default, user.id=4df458c2526a46c5a13d982659afe50c) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:33:32.285777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc10cb-d2ca-4093-9a28-7c2606409544 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:32.288479 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc10cb-d2ca-4093-9a28-7c2606409544 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:32.299995 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 27/57] 10.222.0.94 () {56 vars in 1322 bytes} [Wed Aug 24 04:33:32 2022] GET /identity/v3/role_assignments?user.id=4df458c2526a46c5a13d982659afe50c&scope.domain.id=default&role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 530 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:33:34.344182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58433c4-ee6e-49ac-9d0f-b9ded9018c6d None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:34.345035 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58433c4-ee6e-49ac-9d0f-b9ded9018c6d None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:34.345182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58433c4-ee6e-49ac-9d0f-b9ded9018c6d None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:34.349629 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 31/58] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:33:34.355859 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ea84e-3ac1-4506-a226-6313d2d0806a None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:34.356679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ea84e-3ac1-4506-a226-6313d2d0806a None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:34.356679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ea84e-3ac1-4506-a226-6313d2d0806a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:34.491646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-c93ea84e-3ac1-4506-a226-6313d2d0806a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:34.493344 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-c93ea84e-3ac1-4506-a226-6313d2d0806a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:34.577189 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 28/59] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:33:34.861251 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58433c4-ee6e-49ac-9d0f-b9ded9018c6d None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:34.994858 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58433c4-ee6e-49ac-9d0f-b9ded9018c6d None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:35.068658 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f88d6-948d-40e4-96a3-4ba652aa724a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:35.069727 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f88d6-948d-40e4-96a3-4ba652aa724a None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:35.070150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f88d6-948d-40e4-96a3-4ba652aa724a None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:35.070624 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f88d6-948d-40e4-96a3-4ba652aa724a None admin] PATH_INFO: `/v3/domains/default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:35.072917 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f88d6-948d-40e4-96a3-4ba652aa724a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:35.076133 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f88d6-948d-40e4-96a3-4ba652aa724a None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:35.079433 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 32/60] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:33:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:35.089352 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ea84e-3ac1-4506-a226-6313d2d0806a None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:35.275465 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ea84e-3ac1-4506-a226-6313d2d0806a None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:35.306251 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:35.326202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa92da-a680-4c88-976e-1aa2253f44e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:35.326931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa92da-a680-4c88-976e-1aa2253f44e7 None admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:35.327260 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa92da-a680-4c88-976e-1aa2253f44e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:35.327583 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa92da-a680-4c88-976e-1aa2253f44e7 None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:35.328395 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa92da-a680-4c88-976e-1aa2253f44e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:35.330083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa92da-a680-4c88-976e-1aa2253f44e7 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:35.366566 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 29/61] 10.222.0.94 () {60 vars in 1132 bytes} [Wed Aug 24 04:33:35 2022] POST /identity/v3/users => generated 275 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:33:40.763876 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849614f8-c142-42b9-b2a7-0839a7e2d9f9 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:40.764640 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849614f8-c142-42b9-b2a7-0839a7e2d9f9 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:40.764816 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849614f8-c142-42b9-b2a7-0839a7e2d9f9 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:40.767478 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 33/62] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:33:40.776956 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a25110-1a2a-44f9-8f68-683116e9bc52 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:40.777761 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a25110-1a2a-44f9-8f68-683116e9bc52 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:40.778096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a25110-1a2a-44f9-8f68-683116e9bc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:40.815565 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce3bf0-0574-47f1-ba98-8a5df18803c6 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:40.816603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce3bf0-0574-47f1-ba98-8a5df18803c6 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:40.817798 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce3bf0-0574-47f1-ba98-8a5df18803c6 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:40.820342 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 34/63] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:33:40.825524 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-02a25110-1a2a-44f9-8f68-683116e9bc52 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:40.825524 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-02a25110-1a2a-44f9-8f68-683116e9bc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:40.831254 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421403f-7bc3-4bd4-951e-c48caf54ba72 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:40.833791 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421403f-7bc3-4bd4-951e-c48caf54ba72 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:40.834613 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421403f-7bc3-4bd4-951e-c48caf54ba72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:40.857995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:40.899481 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-7421403f-7bc3-4bd4-951e-c48caf54ba72 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:40.901702 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-7421403f-7bc3-4bd4-951e-c48caf54ba72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:41.095250 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 30/64] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:33:41.111155 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2c936-6fc2-496c-b493-ab67a7720b72 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:41.111951 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2c936-6fc2-496c-b493-ab67a7720b72 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:41.112674 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2c936-6fc2-496c-b493-ab67a7720b72 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:41.116198 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 31/65] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:33:41.125895 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b965e0f-efe2-4cc1-9a71-01c0139beef3 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:41.126724 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b965e0f-efe2-4cc1-9a71-01c0139beef3 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:41.127409 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b965e0f-efe2-4cc1-9a71-01c0139beef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:41.139133 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 35/66] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:33:41.192695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-0b965e0f-efe2-4cc1-9a71-01c0139beef3 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:41.195510 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-0b965e0f-efe2-4cc1-9a71-01c0139beef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:41.351487 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 32/67] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:33:41.417321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5a30a-d578-4bbb-b971-51e327bdaedf None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:41.418344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5a30a-d578-4bbb-b971-51e327bdaedf None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:41.419070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5a30a-d578-4bbb-b971-51e327bdaedf None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:41.421779 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 36/68] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:33:41.431788 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8687d-4b5d-46a8-8e99-9fbcd4fd9cab None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:41.432684 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8687d-4b5d-46a8-8e99-9fbcd4fd9cab None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:41.433440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8687d-4b5d-46a8-8e99-9fbcd4fd9cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:41.474413 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-b0b8687d-4b5d-46a8-8e99-9fbcd4fd9cab None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:41.477014 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-b0b8687d-4b5d-46a8-8e99-9fbcd4fd9cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:41.558705 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:41.624429 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5a30a-d578-4bbb-b971-51e327bdaedf None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:41.670993 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 33/69] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:33:41.682934 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8687d-4b5d-46a8-8e99-9fbcd4fd9cab None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:41.869605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8687d-4b5d-46a8-8e99-9fbcd4fd9cab None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:41.878955 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5a30a-d578-4bbb-b971-51e327bdaedf None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:41.927320 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:41.932520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842b14d-518a-411b-b838-11a6f1733e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:41.933138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842b14d-518a-411b-b838-11a6f1733e61 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:41.933458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842b14d-518a-411b-b838-11a6f1733e61 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:41.933718 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842b14d-518a-411b-b838-11a6f1733e61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:41.937946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df99b5d-ef15-4ca4-b711-74680a620922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:41.939022 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df99b5d-ef15-4ca4-b711-74680a620922 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:41.939497 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df99b5d-ef15-4ca4-b711-74680a620922 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:41.939955 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df99b5d-ef15-4ca4-b711-74680a620922 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:41.948565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842b14d-518a-411b-b838-11a6f1733e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:33:41.954714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-a842b14d-518a-411b-b838-11a6f1733e61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:33:41.954714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:33:41.954714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:33:41.954714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:33:41.954714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:33:41.954714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:33:41.954714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:33:41.954714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:33:41.954714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:33:41.954714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:33:41.954714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:33:41.954714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:33:41.954714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:33:41.954714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:33:41.954714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:33:41.954714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:33:41.956462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:33:41.956462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:33:41.956462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:33:41.956462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:33:41.956462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:33:41.956462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:33:41.956462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:33:41.956462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:33:41.956462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:33:41.956462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:33:41.956462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:33:41.956462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:33:41.956462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:33:41.956462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:33:41.956462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:33:41.956462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:33:41.957869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:33:41.957869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:33:41.957869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:33:41.957869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:33:41.957869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:33:41.957869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:33:41.957869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:33:41.957869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:33:41.957869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:33:41.957869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:33:41.957869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:33:41.957869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:33:41.957869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 34/70] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:33:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:33:41.957869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb8f9d-545d-426b-8919-d99fe35b401c None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:41.959061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb8f9d-545d-426b-8919-d99fe35b401c None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:41.959061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb8f9d-545d-426b-8919-d99fe35b401c None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:41.960566 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 35/71] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:33:41.961741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb8f9d-545d-426b-8919-d99fe35b401c None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:41.966077 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df99b5d-ef15-4ca4-b711-74680a620922 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:33:41.977331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-3df99b5d-ef15-4ca4-b711-74680a620922 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:33:41.977331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:33:41.977331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:33:41.977331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:33:41.977331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:33:41.977331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:33:41.977331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:33:41.977331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:33:41.977331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:33:41.977331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:33:41.977331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:33:41.977331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:33:41.977331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:33:41.977331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:33:41.977331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:33:41.977331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:33:41.978922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:33:41.978922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:33:41.978922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:33:41.978922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:33:41.978922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:33:41.978922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:33:41.978922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:33:41.978922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:33:41.978922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:33:41.978922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:33:41.978922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:33:41.978922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:33:41.978922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:33:41.978922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:33:41.978922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:33:41.978922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:33:41.980384 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:33:41.980384 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:33:41.980384 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:33:41.980384 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:33:41.980384 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:33:41.980384 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:33:41.980384 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:33:41.980384 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:33:41.980384 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:33:41.980384 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:33:41.980384 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:33:41.980384 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:33:41.984360 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 37/72] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:33:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:33:41.987289 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df99b5d-ef15-4ca4-b711-74680a620922 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:42.022086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:42.141603 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb8f9d-545d-426b-8919-d99fe35b401c None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:42.154754 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df99b5d-ef15-4ca4-b711-74680a620922 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:42.190140 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e03c32-d77c-412a-812f-d0fc666f909d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:42.190903 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e03c32-d77c-412a-812f-d0fc666f909d None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:42.191184 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e03c32-d77c-412a-812f-d0fc666f909d None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:42.191497 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e03c32-d77c-412a-812f-d0fc666f909d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:42.204288 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e03c32-d77c-412a-812f-d0fc666f909d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:33:42.207501 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9457b8-e1d5-4f85-b197-1e099e7a8ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:42.208548 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9457b8-e1d5-4f85-b197-1e099e7a8ecc None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:42.209079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9457b8-e1d5-4f85-b197-1e099e7a8ecc None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:42.209597 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9457b8-e1d5-4f85-b197-1e099e7a8ecc None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:42.209717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-a8e03c32-d77c-412a-812f-d0fc666f909d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:33:42.209717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:33:42.209717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:33:42.209717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:33:42.209717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:33:42.209717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:33:42.209717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:33:42.209717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:33:42.209717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:33:42.209717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:33:42.209717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:33:42.209717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:33:42.209717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:33:42.209717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:33:42.209717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:33:42.209717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:33:42.210620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:33:42.210620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:33:42.210620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:33:42.210620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:33:42.210620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:33:42.210620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:33:42.210620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:33:42.210620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:33:42.210620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:33:42.210620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:33:42.210620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:33:42.210620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:33:42.210620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:33:42.210620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:33:42.210620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:33:42.210620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:33:42.211400 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:33:42.211400 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:33:42.211400 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:33:42.211400 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:33:42.211400 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:33:42.211400 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:33:42.211400 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:33:42.211400 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:33:42.211400 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:33:42.211400 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:33:42.211400 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:33:42.211400 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:33:42.211981 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9457b8-e1d5-4f85-b197-1e099e7a8ecc None admin] RBAC: Adding query filter params (name=member) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:33:42.212055 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 36/73] 10.222.0.94 () {56 vars in 1114 bytes} [Wed Aug 24 04:33:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:33:42.212120 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9457b8-e1d5-4f85-b197-1e099e7a8ecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:42.213021 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9457b8-e1d5-4f85-b197-1e099e7a8ecc None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:42.214725 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043b417-e8f7-475e-a6df-5e936f06dbcc None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:42.215038 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043b417-e8f7-475e-a6df-5e936f06dbcc None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:42.215585 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043b417-e8f7-475e-a6df-5e936f06dbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:42.231385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 38/74] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:33:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:42.231385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9457b8-e1d5-4f85-b197-1e099e7a8ecc None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:42.248366 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-b043b417-e8f7-475e-a6df-5e936f06dbcc None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:42.249800 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-b043b417-e8f7-475e-a6df-5e936f06dbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:42.320998 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:42.381479 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 37/75] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:33:42.386524 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043b417-e8f7-475e-a6df-5e936f06dbcc None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:42.389035 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9457b8-e1d5-4f85-b197-1e099e7a8ecc None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:42.413547 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:42.452426 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f5bf0-4b67-4fe0-a3b0-4f5148459832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:42.453194 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f5bf0-4b67-4fe0-a3b0-4f5148459832 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:42.453560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f5bf0-4b67-4fe0-a3b0-4f5148459832 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:42.453874 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f5bf0-4b67-4fe0-a3b0-4f5148459832 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:42.454813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f5bf0-4b67-4fe0-a3b0-4f5148459832 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:33:42.455190 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f5bf0-4b67-4fe0-a3b0-4f5148459832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:42.458255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f5bf0-4b67-4fe0-a3b0-4f5148459832 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:42.476884 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 39/76] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:33:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:42.482607 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f5bf0-4b67-4fe0-a3b0-4f5148459832 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:42.587237 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043b417-e8f7-475e-a6df-5e936f06dbcc None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:42.657229 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c29315-37ad-4851-855f-4e2534ffd321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:42.658247 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c29315-37ad-4851-855f-4e2534ffd321 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:42.658620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c29315-37ad-4851-855f-4e2534ffd321 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:42.658962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c29315-37ad-4851-855f-4e2534ffd321 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:42.676770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c29315-37ad-4851-855f-4e2534ffd321 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:33:42.684803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-53c29315-37ad-4851-855f-4e2534ffd321 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:33:42.684803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:33:42.684803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:33:42.684803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:33:42.684803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:33:42.684803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:33:42.684803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:33:42.684803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:33:42.684803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:33:42.684803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:33:42.684803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:33:42.684803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:33:42.684803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:33:42.684803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:33:42.684803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:33:42.684803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:33:42.686740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:33:42.686740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:33:42.686740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:33:42.686740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:33:42.686740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:33:42.686740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:33:42.686740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:33:42.686740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:33:42.686740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:33:42.686740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:33:42.686740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:33:42.686740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:33:42.686740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:33:42.686740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:33:42.686740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:33:42.686740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:33:42.689033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:33:42.689033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:33:42.689033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:33:42.689033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:33:42.689033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:33:42.689033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:33:42.689033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:33:42.689033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:33:42.689033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:33:42.689033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:33:42.689033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:33:42.689033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:33:42.689033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 38/77] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:33:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:33:42.689033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c29315-37ad-4851-855f-4e2534ffd321 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:42.709394 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f5bf0-4b67-4fe0-a3b0-4f5148459832 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:42.739951 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:42.771760 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc37a0e-9a0c-4f81-b94a-8b17a6885727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:42.772824 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc37a0e-9a0c-4f81-b94a-8b17a6885727 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:42.773339 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc37a0e-9a0c-4f81-b94a-8b17a6885727 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:42.773883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc37a0e-9a0c-4f81-b94a-8b17a6885727 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:42.775208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc37a0e-9a0c-4f81-b94a-8b17a6885727 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:33:42.775778 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc37a0e-9a0c-4f81-b94a-8b17a6885727 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:42.778320 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc37a0e-9a0c-4f81-b94a-8b17a6885727 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:42.795486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 40/78] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:33:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:42.796989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc37a0e-9a0c-4f81-b94a-8b17a6885727 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:42.832773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:42.872064 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c29315-37ad-4851-855f-4e2534ffd321 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:42.928243 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276d36b-1c44-4970-9140-15ac611d0109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:42.929143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276d36b-1c44-4970-9140-15ac611d0109 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:42.929639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276d36b-1c44-4970-9140-15ac611d0109 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:42.930086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276d36b-1c44-4970-9140-15ac611d0109 None admin] PATH_INFO: `/v3/users/37fda8d07e354fa9ab9472785c33f6e4` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:42.938921 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc37a0e-9a0c-4f81-b94a-8b17a6885727 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:42.960249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276d36b-1c44-4970-9140-15ac611d0109 None admin] RBAC: Authorizing `identity:get_user(user_id=37fda8d07e354fa9ab9472785c33f6e4)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:42.963208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276d36b-1c44-4970-9140-15ac611d0109 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:42.966553 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 39/79] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:33:42 2022] GET /identity/v3/users/37fda8d07e354fa9ab9472785c33f6e4 => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:42.968047 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276d36b-1c44-4970-9140-15ac611d0109 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:43.008218 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901fa91-558f-4ba7-b86c-b3a95ecd3503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:43.008939 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901fa91-558f-4ba7-b86c-b3a95ecd3503 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:43.009241 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901fa91-558f-4ba7-b86c-b3a95ecd3503 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:43.010465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901fa91-558f-4ba7-b86c-b3a95ecd3503 None admin] PATH_INFO: `/v3/users/4df458c2526a46c5a13d982659afe50c` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:43.012478 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901fa91-558f-4ba7-b86c-b3a95ecd3503 None admin] RBAC: Authorizing `identity:get_user(user_id=4df458c2526a46c5a13d982659afe50c)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:43.015342 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901fa91-558f-4ba7-b86c-b3a95ecd3503 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:43.023254 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 41/80] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:33:42 2022] GET /identity/v3/users/4df458c2526a46c5a13d982659afe50c => generated 247 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:43.023254 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901fa91-558f-4ba7-b86c-b3a95ecd3503 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:43.097064 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:43.132444 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276d36b-1c44-4970-9140-15ac611d0109 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:43.179793 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901fa91-558f-4ba7-b86c-b3a95ecd3503 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:43.198260 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd0be4-0e48-4842-90e1-9912d0f2d082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:43.199527 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd0be4-0e48-4842-90e1-9912d0f2d082 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:43.200144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd0be4-0e48-4842-90e1-9912d0f2d082 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:43.200775 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd0be4-0e48-4842-90e1-9912d0f2d082 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:43.202119 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd0be4-0e48-4842-90e1-9912d0f2d082 None admin] RBAC: Adding query filter params (name=member) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:33:43.202694 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd0be4-0e48-4842-90e1-9912d0f2d082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:43.205459 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd0be4-0e48-4842-90e1-9912d0f2d082 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:43.209772 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:43.226094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdc094-75ac-4105-b4da-cf7b3a68d7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:43.226878 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdc094-75ac-4105-b4da-cf7b3a68d7ae None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:43.227245 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdc094-75ac-4105-b4da-cf7b3a68d7ae None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:43.227613 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdc094-75ac-4105-b4da-cf7b3a68d7ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:43.229375 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcdc094-75ac-4105-b4da-cf7b3a68d7ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:43.231142 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcdc094-75ac-4105-b4da-cf7b3a68d7ae None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:43.233310 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 42/81] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:33:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:43.234220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdc094-75ac-4105-b4da-cf7b3a68d7ae None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:43.242082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 40/82] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:33:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:43.242082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd0be4-0e48-4842-90e1-9912d0f2d082 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:43.394893 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd0be4-0e48-4842-90e1-9912d0f2d082 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:43.410980 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdc094-75ac-4105-b4da-cf7b3a68d7ae None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:43.433835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:43.460499 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68321d-755f-4850-95a0-4e60c8da73f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:43.461217 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68321d-755f-4850-95a0-4e60c8da73f2 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:43.461627 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68321d-755f-4850-95a0-4e60c8da73f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:43.461964 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68321d-755f-4850-95a0-4e60c8da73f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:43.467434 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c927867-e6ef-4f9c-af02-519e8059b078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:43.468263 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c927867-e6ef-4f9c-af02-519e8059b078 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:43.468728 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c927867-e6ef-4f9c-af02-519e8059b078 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:43.469087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c927867-e6ef-4f9c-af02-519e8059b078 None admin] PATH_INFO: `/v3/users/37fda8d07e354fa9ab9472785c33f6e4` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:43.470745 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c927867-e6ef-4f9c-af02-519e8059b078 None admin] RBAC: Authorizing `identity:get_user(user_id=37fda8d07e354fa9ab9472785c33f6e4)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:43.472847 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c927867-e6ef-4f9c-af02-519e8059b078 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:43.476142 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 43/83] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:33:43 2022] GET /identity/v3/users/37fda8d07e354fa9ab9472785c33f6e4 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:43.477753 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c927867-e6ef-4f9c-af02-519e8059b078 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:43.555478 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:43.569170 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68321d-755f-4850-95a0-4e60c8da73f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:43.571658 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68321d-755f-4850-95a0-4e60c8da73f2 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:43.646077 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c927867-e6ef-4f9c-af02-519e8059b078 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:43.702293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeea089-d8aa-4d63-ba63-bee75fc08057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:43.703767 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeea089-d8aa-4d63-ba63-bee75fc08057 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:43.704269 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeea089-d8aa-4d63-ba63-bee75fc08057 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:43.704776 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeea089-d8aa-4d63-ba63-bee75fc08057 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:43.748074 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 41/84] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:33:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:33:43.749840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68321d-755f-4850-95a0-4e60c8da73f2 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:43.812520 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:43.836122 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeea089-d8aa-4d63-ba63-bee75fc08057 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:43.838055 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeea089-d8aa-4d63-ba63-bee75fc08057 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:43.906189 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:43.918559 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68321d-755f-4850-95a0-4e60c8da73f2 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:43.981591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8b86f-7702-47d8-a0ba-9789ee0498d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:43.982548 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8b86f-7702-47d8-a0ba-9789ee0498d2 None admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:43.983040 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8b86f-7702-47d8-a0ba-9789ee0498d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:43.983557 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8b86f-7702-47d8-a0ba-9789ee0498d2 None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:43.984809 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8b86f-7702-47d8-a0ba-9789ee0498d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:43.988522 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8b86f-7702-47d8-a0ba-9789ee0498d2 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:44.004730 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 44/85] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:33:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:33:44.007191 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeea089-d8aa-4d63-ba63-bee75fc08057 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:44.026237 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 42/86] 10.222.0.94 () {60 vars in 1132 bytes} [Wed Aug 24 04:33:43 2022] POST /identity/v3/users => generated 289 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:33:44.027124 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8b86f-7702-47d8-a0ba-9789ee0498d2 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:44.171045 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:44.208406 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeea089-d8aa-4d63-ba63-bee75fc08057 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:44.233445 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8b86f-7702-47d8-a0ba-9789ee0498d2 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:44.267013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0b24e-581e-4e39-8b89-b3a503757e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:44.268006 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0b24e-581e-4e39-8b89-b3a503757e8f None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:44.268626 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0b24e-581e-4e39-8b89-b3a503757e8f None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:44.269220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0b24e-581e-4e39-8b89-b3a503757e8f None admin] PATH_INFO: `/v3/users/37fda8d07e354fa9ab9472785c33f6e4` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:44.271037 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0b24e-581e-4e39-8b89-b3a503757e8f None admin] RBAC: Authorizing `identity:get_user(user_id=37fda8d07e354fa9ab9472785c33f6e4)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:44.272654 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0b24e-581e-4e39-8b89-b3a503757e8f None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:44.274530 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 45/87] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:33:44 2022] GET /identity/v3/users/37fda8d07e354fa9ab9472785c33f6e4 => generated 275 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:44.275400 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0b24e-581e-4e39-8b89-b3a503757e8f None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:44.305695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344d8cd-1b1a-46d2-94e8-dd676f215148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:44.306758 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344d8cd-1b1a-46d2-94e8-dd676f215148 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:44.307255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344d8cd-1b1a-46d2-94e8-dd676f215148 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:44.307759 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344d8cd-1b1a-46d2-94e8-dd676f215148 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:44.351283 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:44.445081 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344d8cd-1b1a-46d2-94e8-dd676f215148 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:44.447128 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344d8cd-1b1a-46d2-94e8-dd676f215148 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:44.478263 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0b24e-581e-4e39-8b89-b3a503757e8f None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:44.549053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf37da-ef01-4f48-a981-94a342fe9bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:44.549747 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf37da-ef01-4f48-a981-94a342fe9bdb None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:44.550069 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf37da-ef01-4f48-a981-94a342fe9bdb None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:44.551062 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf37da-ef01-4f48-a981-94a342fe9bdb None admin] PATH_INFO: `/v3/projects/43dfbfd1802b436791f73a286898fd0a` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:44.552370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf37da-ef01-4f48-a981-94a342fe9bdb None admin] RBAC: Authorizing `identity:get_project(project_id=43dfbfd1802b436791f73a286898fd0a)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:44.558085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf37da-ef01-4f48-a981-94a342fe9bdb None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:44.560067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 46/88] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:33:44 2022] GET /identity/v3/projects/43dfbfd1802b436791f73a286898fd0a => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:44.560885 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf37da-ef01-4f48-a981-94a342fe9bdb None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:44.588197 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:44.630757 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 43/89] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:33:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:33:44.631429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344d8cd-1b1a-46d2-94e8-dd676f215148 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:44.687379 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf37da-ef01-4f48-a981-94a342fe9bdb None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:44.697138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:44.756440 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300e2c7-1079-494b-a693-f10ceb575d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:44.757654 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300e2c7-1079-494b-a693-f10ceb575d5f None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:44.758178 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300e2c7-1079-494b-a693-f10ceb575d5f None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:44.758681 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300e2c7-1079-494b-a693-f10ceb575d5f None admin] PATH_INFO: `/v3/projects/43dfbfd1802b436791f73a286898fd0a` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:44.758827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344d8cd-1b1a-46d2-94e8-dd676f215148 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:44.760392 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300e2c7-1079-494b-a693-f10ceb575d5f None admin] RBAC: Authorizing `identity:get_project(project_id=43dfbfd1802b436791f73a286898fd0a)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:44.762051 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300e2c7-1079-494b-a693-f10ceb575d5f None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:44.763901 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 47/90] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:33:44 2022] GET /identity/v3/projects/43dfbfd1802b436791f73a286898fd0a => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:44.764835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300e2c7-1079-494b-a693-f10ceb575d5f None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:44.811100 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2609b9b-78d8-4220-b3e4-9799f81e841c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:44.811638 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2609b9b-78d8-4220-b3e4-9799f81e841c None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:44.811924 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2609b9b-78d8-4220-b3e4-9799f81e841c None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:44.812716 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2609b9b-78d8-4220-b3e4-9799f81e841c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:44.925328 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:44.940762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2609b9b-78d8-4220-b3e4-9799f81e841c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:44.943119 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2609b9b-78d8-4220-b3e4-9799f81e841c None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:44.952588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300e2c7-1079-494b-a693-f10ceb575d5f None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:45.013225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb97893-71c6-4027-93f9-c36c4c5c0c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:45.015184 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb97893-71c6-4027-93f9-c36c4c5c0c6d None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:45.015944 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb97893-71c6-4027-93f9-c36c4c5c0c6d None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:45.016535 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb97893-71c6-4027-93f9-c36c4c5c0c6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:45.018303 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb97893-71c6-4027-93f9-c36c4c5c0c6d None admin] RBAC: Adding query filter params (role.id=1a586b803a1e429f82b85f386d7564fb, scope.project.id=43dfbfd1802b436791f73a286898fd0a, user.id=37fda8d07e354fa9ab9472785c33f6e4) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:33:45.019957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb97893-71c6-4027-93f9-c36c4c5c0c6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:45.022625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb97893-71c6-4027-93f9-c36c4c5c0c6d None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:45.023668 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:45.039359 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 48/91] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:33:44 2022] GET /identity/v3/role_assignments?user.id=37fda8d07e354fa9ab9472785c33f6e4&scope.project.id=43dfbfd1802b436791f73a286898fd0a&role.id=1a586b803a1e429f82b85f386d7564fb => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:45.040923 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb97893-71c6-4027-93f9-c36c4c5c0c6d None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:45.097654 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 44/92] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:33:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:33:45.098728 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2609b9b-78d8-4220-b3e4-9799f81e841c None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:45.236179 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb97893-71c6-4027-93f9-c36c4c5c0c6d None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:45.264873 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2609b9b-78d8-4220-b3e4-9799f81e841c None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:45.310600 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c06054-e77b-407e-ac7b-6f619133000c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:45.311323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c06054-e77b-407e-ac7b-6f619133000c None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:45.311603 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c06054-e77b-407e-ac7b-6f619133000c None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:45.311873 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c06054-e77b-407e-ac7b-6f619133000c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:45.312761 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c06054-e77b-407e-ac7b-6f619133000c None admin] RBAC: Adding query filter params (role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2, scope.project.id=43dfbfd1802b436791f73a286898fd0a, user.id=4df458c2526a46c5a13d982659afe50c) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:33:45.313132 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c06054-e77b-407e-ac7b-6f619133000c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:45.314705 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c06054-e77b-407e-ac7b-6f619133000c None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:45.319688 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c6630-3242-4e97-b97a-c9a9680ba5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:45.320954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c6630-3242-4e97-b97a-c9a9680ba5af None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:45.321751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c6630-3242-4e97-b97a-c9a9680ba5af None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:45.322259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 45/93] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:33:45 2022] GET /identity/v3/role_assignments?user.id=4df458c2526a46c5a13d982659afe50c&scope.project.id=43dfbfd1802b436791f73a286898fd0a&role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:45.322902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c6630-3242-4e97-b97a-c9a9680ba5af None admin] PATH_INFO: `/v3/projects/43dfbfd1802b436791f73a286898fd0a` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:45.323297 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c06054-e77b-407e-ac7b-6f619133000c None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:45.325739 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c6630-3242-4e97-b97a-c9a9680ba5af None admin] RBAC: Authorizing `identity:get_project(project_id=43dfbfd1802b436791f73a286898fd0a)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:45.329062 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c6630-3242-4e97-b97a-c9a9680ba5af None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:45.333155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 49/94] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:33:45 2022] GET /identity/v3/projects/43dfbfd1802b436791f73a286898fd0a => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:45.343340 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c6630-3242-4e97-b97a-c9a9680ba5af None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:45.348790 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:45.416797 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:45.477893 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c06054-e77b-407e-ac7b-6f619133000c None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:45.526020 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40825d62-42c8-4284-89c9-067da21b2c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:45.526691 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40825d62-42c8-4284-89c9-067da21b2c3e None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:45.527287 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40825d62-42c8-4284-89c9-067da21b2c3e None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:45.527593 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40825d62-42c8-4284-89c9-067da21b2c3e None admin] PATH_INFO: `/v3/projects/ef7fcbdab16d42e2ae21a9b09a4fbaf9` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:45.529920 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40825d62-42c8-4284-89c9-067da21b2c3e None admin] RBAC: Authorizing `identity:get_project(project_id=ef7fcbdab16d42e2ae21a9b09a4fbaf9)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:45.531578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40825d62-42c8-4284-89c9-067da21b2c3e None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:45.533776 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 46/95] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:33:45 2022] GET /identity/v3/projects/ef7fcbdab16d42e2ae21a9b09a4fbaf9 => generated 312 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:45.541766 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40825d62-42c8-4284-89c9-067da21b2c3e None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:45.694399 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:45.743172 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c6630-3242-4e97-b97a-c9a9680ba5af None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:45.764224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40825d62-42c8-4284-89c9-067da21b2c3e None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:45.854786 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8afc61-bafa-4a19-9ada-fbc590cba7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:45.855838 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8afc61-bafa-4a19-9ada-fbc590cba7ec None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:45.856330 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8afc61-bafa-4a19-9ada-fbc590cba7ec None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:45.856829 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8afc61-bafa-4a19-9ada-fbc590cba7ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:45.858286 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8afc61-bafa-4a19-9ada-fbc590cba7ec None admin] RBAC: Adding query filter params (role.id=1a586b803a1e429f82b85f386d7564fb, scope.project.id=ef7fcbdab16d42e2ae21a9b09a4fbaf9, user.id=37fda8d07e354fa9ab9472785c33f6e4) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:33:45.858807 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8afc61-bafa-4a19-9ada-fbc590cba7ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:45.861633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8afc61-bafa-4a19-9ada-fbc590cba7ec None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:45.873063 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 47/96] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:33:45 2022] GET /identity/v3/role_assignments?user.id=37fda8d07e354fa9ab9472785c33f6e4&scope.project.id=ef7fcbdab16d42e2ae21a9b09a4fbaf9&role.id=1a586b803a1e429f82b85f386d7564fb => generated 259 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:45.883912 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4404f9-2921-4123-a279-e5857d42ece8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:45.890350 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4404f9-2921-4123-a279-e5857d42ece8 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:45.890972 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4404f9-2921-4123-a279-e5857d42ece8 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:45.891508 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4404f9-2921-4123-a279-e5857d42ece8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:45.893198 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4404f9-2921-4123-a279-e5857d42ece8 None admin] RBAC: Adding query filter params (role.id=f08394a5dbcf4506a17b78b4416f1680, scope.project.id=43dfbfd1802b436791f73a286898fd0a, user.id=37fda8d07e354fa9ab9472785c33f6e4) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:33:45.893948 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4404f9-2921-4123-a279-e5857d42ece8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:45.897177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4404f9-2921-4123-a279-e5857d42ece8 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:45.917311 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 50/97] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:33:45 2022] GET /identity/v3/role_assignments?user.id=37fda8d07e354fa9ab9472785c33f6e4&scope.project.id=43dfbfd1802b436791f73a286898fd0a&role.id=f08394a5dbcf4506a17b78b4416f1680 => generated 259 bytes in 575 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:48.268491 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38e25b-ea00-46a4-9067-6126e20fccb9 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:48.270046 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38e25b-ea00-46a4-9067-6126e20fccb9 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:48.270046 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38e25b-ea00-46a4-9067-6126e20fccb9 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:48.272236 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 48/98] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:33:48.292804 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9926e27-0668-420c-9a90-28341e495468 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:48.293634 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9926e27-0668-420c-9a90-28341e495468 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:48.293929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9926e27-0668-420c-9a90-28341e495468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:48.335231 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-b9926e27-0668-420c-9a90-28341e495468 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:48.337382 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-b9926e27-0668-420c-9a90-28341e495468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:48.518709 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 51/99] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:33:48.749062 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d178b-2b1e-4297-8f85-18ed6b3656c8 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:48.749675 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d178b-2b1e-4297-8f85-18ed6b3656c8 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:48.750175 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d178b-2b1e-4297-8f85-18ed6b3656c8 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:48.753851 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 49/100] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:33:48.771421 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c02ea6-93e7-4795-b318-9746b9873e81 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:48.771831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c02ea6-93e7-4795-b318-9746b9873e81 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:48.772312 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c02ea6-93e7-4795-b318-9746b9873e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:48.811379 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-95c02ea6-93e7-4795-b318-9746b9873e81 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:48.813496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-95c02ea6-93e7-4795-b318-9746b9873e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:48.835381 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:48.988545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 52/101] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:33:49.685166 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d178b-2b1e-4297-8f85-18ed6b3656c8 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:49.937947 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d178b-2b1e-4297-8f85-18ed6b3656c8 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:49.982802 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c02ea6-93e7-4795-b318-9746b9873e81 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:50.042815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66580e-3d9a-486e-8dc9-369ff04842f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:50.043904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66580e-3d9a-486e-8dc9-369ff04842f5 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:50.044386 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66580e-3d9a-486e-8dc9-369ff04842f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:50.044887 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66580e-3d9a-486e-8dc9-369ff04842f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:50.067925 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66580e-3d9a-486e-8dc9-369ff04842f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:33:50.077061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-0b66580e-3d9a-486e-8dc9-369ff04842f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:33:50.077061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:33:50.077061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:33:50.077061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:33:50.077061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:33:50.077061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:33:50.077061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:33:50.077061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:33:50.077061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:33:50.077061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:33:50.077061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:33:50.077061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:33:50.077061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:33:50.077061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:33:50.077061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:33:50.077061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:33:50.078773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:33:50.078773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:33:50.078773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:33:50.078773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:33:50.078773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:33:50.078773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:33:50.078773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:33:50.078773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:33:50.078773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:33:50.078773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:33:50.078773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:33:50.078773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:33:50.078773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:33:50.078773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:33:50.078773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:33:50.078773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:33:50.080180 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:33:50.080180 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:33:50.080180 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:33:50.080180 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:33:50.080180 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:33:50.080180 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:33:50.080180 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:33:50.080180 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:33:50.080180 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:33:50.080180 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:33:50.080180 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:33:50.080180 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:33:50.080180 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 50/102] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:33:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:33:50.090178 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66580e-3d9a-486e-8dc9-369ff04842f5 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:50.114361 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:50.402999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66580e-3d9a-486e-8dc9-369ff04842f5 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:50.404292 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c02ea6-93e7-4795-b318-9746b9873e81 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:50.476127 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ba8ff-b819-4a7a-ae16-3795100c7f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:50.476804 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ba8ff-b819-4a7a-ae16-3795100c7f08 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:50.477172 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ba8ff-b819-4a7a-ae16-3795100c7f08 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:50.477497 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ba8ff-b819-4a7a-ae16-3795100c7f08 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:50.478279 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ba8ff-b819-4a7a-ae16-3795100c7f08 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:33:50.478615 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ba8ff-b819-4a7a-ae16-3795100c7f08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:50.480898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ba8ff-b819-4a7a-ae16-3795100c7f08 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:50.496343 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 51/103] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:33:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:33:50.498342 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a6915-a2dd-49cf-b665-d57226575706 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:50.498885 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a6915-a2dd-49cf-b665-d57226575706 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:50.499361 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a6915-a2dd-49cf-b665-d57226575706 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:50.505501 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 52/104] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:33:50.505501 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a36bff-b9c8-4f2a-bfe5-5134f347ad19 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:50.505880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a36bff-b9c8-4f2a-bfe5-5134f347ad19 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:50.506319 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a36bff-b9c8-4f2a-bfe5-5134f347ad19 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:50.509160 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 53/105] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:33:50.516160 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c34673-26e8-45d5-b279-78480f91355a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:50.516904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a36bff-b9c8-4f2a-bfe5-5134f347ad19 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:50.517102 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c34673-26e8-45d5-b279-78480f91355a None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:50.517444 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c34673-26e8-45d5-b279-78480f91355a None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:50.517886 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c34673-26e8-45d5-b279-78480f91355a None admin] PATH_INFO: `/v3/domains/default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:50.519747 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c34673-26e8-45d5-b279-78480f91355a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:50.521608 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c34673-26e8-45d5-b279-78480f91355a None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:50.523517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 53/106] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:33:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 542 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:50.524960 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2455526-7485-461e-9b00-74614d6888de None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:50.525314 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2455526-7485-461e-9b00-74614d6888de None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:50.525678 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2455526-7485-461e-9b00-74614d6888de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:50.549094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-b2455526-7485-461e-9b00-74614d6888de None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:50.551740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-b2455526-7485-461e-9b00-74614d6888de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:50.558584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:50.653584 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:50.702370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 54/107] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:33:50.706940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72da5c-14c2-479a-9889-65dafe61ea1c None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:50.707522 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72da5c-14c2-479a-9889-65dafe61ea1c None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:50.708276 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72da5c-14c2-479a-9889-65dafe61ea1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:50.744908 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a36bff-b9c8-4f2a-bfe5-5134f347ad19 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:50.778247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-0a72da5c-14c2-479a-9889-65dafe61ea1c None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:50.781338 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-0a72da5c-14c2-479a-9889-65dafe61ea1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:50.857799 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde3216-2e8c-45c7-8c24-18a08300c32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:50.858954 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde3216-2e8c-45c7-8c24-18a08300c32e None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:50.859696 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde3216-2e8c-45c7-8c24-18a08300c32e None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:50.860216 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde3216-2e8c-45c7-8c24-18a08300c32e None admin] PATH_INFO: `/v3/users/34c6b867af5c4bb492a60653f7aa934d` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:50.891190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde3216-2e8c-45c7-8c24-18a08300c32e None admin] RBAC: Authorizing `identity:get_user(user_id=34c6b867af5c4bb492a60653f7aa934d)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:50.895660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde3216-2e8c-45c7-8c24-18a08300c32e None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:50.899662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 54/108] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:33:50 2022] GET /identity/v3/users/34c6b867af5c4bb492a60653f7aa934d => generated 289 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:50.901638 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde3216-2e8c-45c7-8c24-18a08300c32e None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:50.959147 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 55/109] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:33:50.965803 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5dbbc-37d8-4586-b416-c377ebf2945a None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:50.966445 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5dbbc-37d8-4586-b416-c377ebf2945a None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:50.966755 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5dbbc-37d8-4586-b416-c377ebf2945a None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:50.969089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 56/110] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:50 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:33:50.970156 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5dbbc-37d8-4586-b416-c377ebf2945a None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:51.096363 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde3216-2e8c-45c7-8c24-18a08300c32e None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:51.149062 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:51.155036 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:51.173921 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c697dd-1c09-4a80-92e7-35f9e0b94720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:51.176469 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c697dd-1c09-4a80-92e7-35f9e0b94720 None admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:51.177302 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c697dd-1c09-4a80-92e7-35f9e0b94720 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:51.177831 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c697dd-1c09-4a80-92e7-35f9e0b94720 None admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:51.179302 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c697dd-1c09-4a80-92e7-35f9e0b94720 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:51.182260 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c697dd-1c09-4a80-92e7-35f9e0b94720 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:51.229272 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5dbbc-37d8-4586-b416-c377ebf2945a None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:51.243069 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 55/111] 10.222.0.94 () {60 vars in 1141 bytes} [Wed Aug 24 04:33:50 2022] POST /identity/v3/projects => generated 302 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:33:51.243069 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509e32f-5bff-4b1b-948b-b3f349ff75bd None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:51.243069 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509e32f-5bff-4b1b-948b-b3f349ff75bd None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:51.243069 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509e32f-5bff-4b1b-948b-b3f349ff75bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:51.295997 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-e509e32f-5bff-4b1b-948b-b3f349ff75bd None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:51.298820 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e509e32f-5bff-4b1b-948b-b3f349ff75bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:51.330745 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1b4c0-ea0e-4f33-9562-acf441f1c89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:51.332206 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1b4c0-ea0e-4f33-9562-acf441f1c89c None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:51.332892 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1b4c0-ea0e-4f33-9562-acf441f1c89c None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:51.333519 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1b4c0-ea0e-4f33-9562-acf441f1c89c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:51.445986 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 56/112] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:33:51.448954 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88084d57-5ccf-4a80-bd29-f9338bd3d18d None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:51.449566 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88084d57-5ccf-4a80-bd29-f9338bd3d18d None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:51.450137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88084d57-5ccf-4a80-bd29-f9338bd3d18d None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:51.453294 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 57/113] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:33:51.454936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88084d57-5ccf-4a80-bd29-f9338bd3d18d None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:51.518049 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1b4c0-ea0e-4f33-9562-acf441f1c89c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:51.525247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1b4c0-ea0e-4f33-9562-acf441f1c89c None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:51.679557 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:51.723568 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88084d57-5ccf-4a80-bd29-f9338bd3d18d None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:51.750362 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:51.770352 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 57/114] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:33:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 795 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:33:51.772116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e63206-94c4-4372-ab1d-eb553417639a None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:51.772620 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e63206-94c4-4372-ab1d-eb553417639a None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:51.773101 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e63206-94c4-4372-ab1d-eb553417639a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:51.808624 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-61e63206-94c4-4372-ab1d-eb553417639a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:51.811120 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-61e63206-94c4-4372-ab1d-eb553417639a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:51.812575 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b8af6-8beb-4b49-ba09-a5d5328f9a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:51.813725 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b8af6-8beb-4b49-ba09-a5d5328f9a09 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:51.814223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b8af6-8beb-4b49-ba09-a5d5328f9a09 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:51.814923 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b8af6-8beb-4b49-ba09-a5d5328f9a09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:51.838920 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b8af6-8beb-4b49-ba09-a5d5328f9a09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:33:51.847943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-822b8af6-8beb-4b49-ba09-a5d5328f9a09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:33:51.847943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:33:51.847943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:33:51.847943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:33:51.847943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:33:51.847943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:33:51.847943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:33:51.847943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:33:51.847943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:33:51.847943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:33:51.847943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:33:51.847943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:33:51.847943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:33:51.847943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:33:51.847943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:33:51.847943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:33:51.850840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:33:51.850840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:33:51.850840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:33:51.850840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:33:51.850840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:33:51.850840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:33:51.850840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:33:51.850840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:33:51.850840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:33:51.850840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:33:51.850840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:33:51.850840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:33:51.850840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:33:51.850840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:33:51.850840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:33:51.850840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:33:51.853926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:33:51.853926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:33:51.853926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:33:51.853926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:33:51.853926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:33:51.853926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:33:51.853926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:33:51.853926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:33:51.853926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:33:51.853926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:33:51.853926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:33:51.853926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:33:51.853926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 58/115] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:33:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:33:51.853926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b8af6-8beb-4b49-ba09-a5d5328f9a09 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:51.956974 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 58/116] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:33:51.967055 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e63206-94c4-4372-ab1d-eb553417639a None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:52.082957 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b8af6-8beb-4b49-ba09-a5d5328f9a09 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:52.165778 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7529b6-cd67-4fbf-88b5-39caeb7e39b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:52.166970 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7529b6-cd67-4fbf-88b5-39caeb7e39b7 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:52.167478 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7529b6-cd67-4fbf-88b5-39caeb7e39b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:52.167976 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7529b6-cd67-4fbf-88b5-39caeb7e39b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:52.192523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7529b6-cd67-4fbf-88b5-39caeb7e39b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:33:52.196298 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:52.202912 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e63206-94c4-4372-ab1d-eb553417639a None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:52.209999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-8d7529b6-cd67-4fbf-88b5-39caeb7e39b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:33:52.209999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:33:52.209999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:33:52.209999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:33:52.209999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:33:52.209999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:33:52.209999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:33:52.209999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:33:52.209999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:33:52.209999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:33:52.209999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:33:52.209999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:33:52.209999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:33:52.209999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:33:52.209999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:33:52.209999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:33:52.212595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:33:52.212595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:33:52.212595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:33:52.212595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:33:52.212595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:33:52.212595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:33:52.212595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:33:52.212595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:33:52.212595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:33:52.212595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:33:52.212595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:33:52.212595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:33:52.212595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:33:52.212595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:33:52.212595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:33:52.212595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:33:52.214486 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:33:52.214486 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:33:52.214486 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:33:52.214486 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:33:52.214486 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:33:52.214486 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:33:52.214486 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:33:52.214486 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:33:52.214486 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:33:52.214486 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:33:52.214486 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:33:52.214486 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:33:52.219701 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 59/117] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:33:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:33:52.222404 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7529b6-cd67-4fbf-88b5-39caeb7e39b7 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:52.295918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:52.298094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c497d2-c227-4567-b400-8cfb3fb584e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:52.300639 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c497d2-c227-4567-b400-8cfb3fb584e6 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:52.300639 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c497d2-c227-4567-b400-8cfb3fb584e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:52.301870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c497d2-c227-4567-b400-8cfb3fb584e6 None admin] PATH_INFO: `/v3/projects/43dfbfd1802b436791f73a286898fd0a` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:52.306075 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c497d2-c227-4567-b400-8cfb3fb584e6 None admin] RBAC: Authorizing `identity:get_project(project_id=43dfbfd1802b436791f73a286898fd0a)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:52.312523 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c497d2-c227-4567-b400-8cfb3fb584e6 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:52.317617 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 59/118] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:33:51 2022] GET /identity/v3/projects/43dfbfd1802b436791f73a286898fd0a => generated 298 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:52.319775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c497d2-c227-4567-b400-8cfb3fb584e6 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:52.485645 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7529b6-cd67-4fbf-88b5-39caeb7e39b7 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:52.555615 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c497d2-c227-4567-b400-8cfb3fb584e6 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:52.573672 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51606dfb-1932-4efa-928d-4a9d28ddee46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:52.574895 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51606dfb-1932-4efa-928d-4a9d28ddee46 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:52.575407 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51606dfb-1932-4efa-928d-4a9d28ddee46 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:52.575916 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51606dfb-1932-4efa-928d-4a9d28ddee46 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:52.577214 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51606dfb-1932-4efa-928d-4a9d28ddee46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:33:52.577808 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51606dfb-1932-4efa-928d-4a9d28ddee46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:52.580607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51606dfb-1932-4efa-928d-4a9d28ddee46 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:52.605880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 60/119] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:33:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:52.605880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51606dfb-1932-4efa-928d-4a9d28ddee46 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:52.635917 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d1059-3f35-4c61-b30a-e4db15c0e13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:52.637037 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d1059-3f35-4c61-b30a-e4db15c0e13e None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:52.637598 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d1059-3f35-4c61-b30a-e4db15c0e13e None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:52.638135 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d1059-3f35-4c61-b30a-e4db15c0e13e None admin] PATH_INFO: `/v3/roles/member` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:52.664556 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d1059-3f35-4c61-b30a-e4db15c0e13e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:33:52.676881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-014d1059-3f35-4c61-b30a-e4db15c0e13e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:33:52.676881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:33:52.676881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:33:52.676881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:33:52.676881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:33:52.676881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:33:52.676881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:33:52.676881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:33:52.676881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:33:52.676881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:33:52.676881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:33:52.676881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:33:52.676881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:33:52.676881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:33:52.676881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:33:52.676881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:33:52.678614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:33:52.678614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:33:52.678614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:33:52.678614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:33:52.678614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:33:52.678614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:33:52.678614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:33:52.678614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:33:52.678614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:33:52.678614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:33:52.678614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:33:52.678614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:33:52.678614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:33:52.678614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:33:52.678614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:33:52.678614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:33:52.679997 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:33:52.679997 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:33:52.679997 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:33:52.679997 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:33:52.679997 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:33:52.679997 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:33:52.679997 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:33:52.679997 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:33:52.679997 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:33:52.679997 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:33:52.679997 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:33:52.679997 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:33:52.687704 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 60/120] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:33:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:33:52.689448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d1059-3f35-4c61-b30a-e4db15c0e13e None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:52.755907 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:52.803669 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:52.824498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51606dfb-1932-4efa-928d-4a9d28ddee46 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:52.899038 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1186aa-9a5b-4e0d-b819-a16ac3e5d48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:52.900141 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1186aa-9a5b-4e0d-b819-a16ac3e5d48c None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:52.900649 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1186aa-9a5b-4e0d-b819-a16ac3e5d48c None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:52.901167 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1186aa-9a5b-4e0d-b819-a16ac3e5d48c None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:52.902563 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1186aa-9a5b-4e0d-b819-a16ac3e5d48c None admin] RBAC: Adding query filter params (name=member) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:33:52.903142 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1186aa-9a5b-4e0d-b819-a16ac3e5d48c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:52.905973 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1186aa-9a5b-4e0d-b819-a16ac3e5d48c None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:52.924272 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 61/121] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:33:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:52.926189 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d1059-3f35-4c61-b30a-e4db15c0e13e None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:52.926482 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1186aa-9a5b-4e0d-b819-a16ac3e5d48c None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:53.000545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1e417-e949-47ba-8bd5-5988e1fc6233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:53.001680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1e417-e949-47ba-8bd5-5988e1fc6233 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:53.002197 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1e417-e949-47ba-8bd5-5988e1fc6233 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:53.002690 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1e417-e949-47ba-8bd5-5988e1fc6233 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:53.004360 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1e417-e949-47ba-8bd5-5988e1fc6233 None admin] RBAC: Adding query filter params (role.id=28bafe05b4a44e89a89bdd6806d44ac5, scope.project.id=43dfbfd1802b436791f73a286898fd0a, user.id=34c6b867af5c4bb492a60653f7aa934d) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:33:53.004854 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1e417-e949-47ba-8bd5-5988e1fc6233 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:53.007866 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1e417-e949-47ba-8bd5-5988e1fc6233 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:53.019349 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 61/122] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:33:52 2022] GET /identity/v3/role_assignments?user.id=34c6b867af5c4bb492a60653f7aa934d&scope.project.id=43dfbfd1802b436791f73a286898fd0a&role.id=28bafe05b4a44e89a89bdd6806d44ac5 => generated 259 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:53.020923 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1e417-e949-47ba-8bd5-5988e1fc6233 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:53.171791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1186aa-9a5b-4e0d-b819-a16ac3e5d48c None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:53.254799 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32603a38-fba5-4bba-9772-adf57b576011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:53.256586 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32603a38-fba5-4bba-9772-adf57b576011 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:53.257751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:53.258873 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32603a38-fba5-4bba-9772-adf57b576011 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:53.260728 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32603a38-fba5-4bba-9772-adf57b576011 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:53.278514 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1e417-e949-47ba-8bd5-5988e1fc6233 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:53.291811 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32603a38-fba5-4bba-9772-adf57b576011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:33:53.303762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-32603a38-fba5-4bba-9772-adf57b576011 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:33:53.303762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:33:53.303762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:33:53.303762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:33:53.303762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:33:53.303762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:33:53.303762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:33:53.303762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:33:53.303762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:33:53.303762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:33:53.303762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:33:53.303762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:33:53.303762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:33:53.303762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:33:53.303762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:33:53.303762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:33:53.305440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:33:53.305440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:33:53.305440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:33:53.305440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:33:53.305440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:33:53.305440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:33:53.305440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:33:53.305440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:33:53.305440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:33:53.305440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:33:53.305440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:33:53.305440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:33:53.305440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:33:53.305440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:33:53.305440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:33:53.305440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:33:53.306979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:33:53.306979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:33:53.306979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:33:53.306979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:33:53.306979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:33:53.306979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:33:53.306979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:33:53.306979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:33:53.306979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:33:53.306979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:33:53.306979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:33:53.306979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:33:53.306979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 62/123] 10.222.0.94 () {56 vars in 1114 bytes} [Wed Aug 24 04:33:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:33:53.308946 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32603a38-fba5-4bba-9772-adf57b576011 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:53.360622 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b6866-ecc1-4165-87aa-f7762d746529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:53.364239 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b6866-ecc1-4165-87aa-f7762d746529 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:53.365239 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b6866-ecc1-4165-87aa-f7762d746529 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:53.366035 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b6866-ecc1-4165-87aa-f7762d746529 None admin] PATH_INFO: `/v3/users/4df458c2526a46c5a13d982659afe50c` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:53.369009 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b6866-ecc1-4165-87aa-f7762d746529 None admin] RBAC: Authorizing `identity:get_user(user_id=4df458c2526a46c5a13d982659afe50c)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:53.370026 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:53.373488 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b6866-ecc1-4165-87aa-f7762d746529 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:53.379409 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 62/124] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:33:53 2022] GET /identity/v3/users/4df458c2526a46c5a13d982659afe50c => generated 247 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:53.382029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b6866-ecc1-4165-87aa-f7762d746529 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:53.557379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32603a38-fba5-4bba-9772-adf57b576011 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:53.620195 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b6866-ecc1-4165-87aa-f7762d746529 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:53.649109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f644a7-bf8d-4105-a46f-648204049fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:53.650227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f644a7-bf8d-4105-a46f-648204049fdb None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:53.650518 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f644a7-bf8d-4105-a46f-648204049fdb None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:53.650831 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f644a7-bf8d-4105-a46f-648204049fdb None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:53.651836 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f644a7-bf8d-4105-a46f-648204049fdb None admin] RBAC: Adding query filter params (name=member) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:33:53.652164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f644a7-bf8d-4105-a46f-648204049fdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:53.654117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f644a7-bf8d-4105-a46f-648204049fdb None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:53.674163 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 63/125] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:33:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:53.687201 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f644a7-bf8d-4105-a46f-648204049fdb None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:53.707447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dac49-86e9-4660-9584-06b2734eb014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:53.708684 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dac49-86e9-4660-9584-06b2734eb014 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:53.709201 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dac49-86e9-4660-9584-06b2734eb014 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:53.709802 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dac49-86e9-4660-9584-06b2734eb014 None admin] PATH_INFO: `/v3/users/37fda8d07e354fa9ab9472785c33f6e4` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:53.712258 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8dac49-86e9-4660-9584-06b2734eb014 None admin] RBAC: Authorizing `identity:get_user(user_id=37fda8d07e354fa9ab9472785c33f6e4)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:53.715189 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8dac49-86e9-4660-9584-06b2734eb014 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:53.718935 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 63/126] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:33:53 2022] GET /identity/v3/users/37fda8d07e354fa9ab9472785c33f6e4 => generated 275 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:53.720579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dac49-86e9-4660-9584-06b2734eb014 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:53.798911 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:53.898386 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:53.959379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f644a7-bf8d-4105-a46f-648204049fdb None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:53.974224 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dac49-86e9-4660-9584-06b2734eb014 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:54.050559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfe550-1a20-43a4-9b9e-353ac3d734e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:54.051708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc0ab0-d313-4837-b7e3-3cac8d16eb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:54.052656 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc0ab0-d313-4837-b7e3-3cac8d16eb4f None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:54.053149 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc0ab0-d313-4837-b7e3-3cac8d16eb4f None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:54.053358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfe550-1a20-43a4-9b9e-353ac3d734e0 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:54.053698 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc0ab0-d313-4837-b7e3-3cac8d16eb4f None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:54.054320 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfe550-1a20-43a4-9b9e-353ac3d734e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:54.055039 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc0ab0-d313-4837-b7e3-3cac8d16eb4f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:33:54.055245 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfe550-1a20-43a4-9b9e-353ac3d734e0 None admin] PATH_INFO: `/v3/projects/43dfbfd1802b436791f73a286898fd0a` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:54.055585 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc0ab0-d313-4837-b7e3-3cac8d16eb4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:54.058292 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc0ab0-d313-4837-b7e3-3cac8d16eb4f None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:54.058738 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cfe550-1a20-43a4-9b9e-353ac3d734e0 None admin] RBAC: Authorizing `identity:get_project(project_id=43dfbfd1802b436791f73a286898fd0a)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:54.062491 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cfe550-1a20-43a4-9b9e-353ac3d734e0 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:54.067128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 64/127] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:33:53 2022] GET /identity/v3/projects/43dfbfd1802b436791f73a286898fd0a => generated 298 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:54.068993 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfe550-1a20-43a4-9b9e-353ac3d734e0 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:54.076894 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 64/128] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:33:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:54.086480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc0ab0-d313-4837-b7e3-3cac8d16eb4f None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:54.281575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:54.296313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfe550-1a20-43a4-9b9e-353ac3d734e0 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:54.326013 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc0ab0-d313-4837-b7e3-3cac8d16eb4f None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:54.371908 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518a763-0f5b-4821-9857-763fe3e783ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:54.373257 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518a763-0f5b-4821-9857-763fe3e783ea None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:54.373979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518a763-0f5b-4821-9857-763fe3e783ea None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:54.374489 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518a763-0f5b-4821-9857-763fe3e783ea None admin] PATH_INFO: `/v3/users/37fda8d07e354fa9ab9472785c33f6e4` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:54.377144 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518a763-0f5b-4821-9857-763fe3e783ea None admin] RBAC: Authorizing `identity:get_user(user_id=37fda8d07e354fa9ab9472785c33f6e4)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:54.381933 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518a763-0f5b-4821-9857-763fe3e783ea None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:54.385868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 65/129] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:33:54 2022] GET /identity/v3/users/37fda8d07e354fa9ab9472785c33f6e4 => generated 275 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:54.387118 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518a763-0f5b-4821-9857-763fe3e783ea None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:54.414116 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d16f27-55e3-4872-8378-78f5d6fdeedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:54.415272 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d16f27-55e3-4872-8378-78f5d6fdeedb None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:54.415787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d16f27-55e3-4872-8378-78f5d6fdeedb None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:54.416272 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d16f27-55e3-4872-8378-78f5d6fdeedb None admin] PATH_INFO: `/v3/projects/43dfbfd1802b436791f73a286898fd0a` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:54.419661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d16f27-55e3-4872-8378-78f5d6fdeedb None admin] RBAC: Authorizing `identity:get_project(project_id=43dfbfd1802b436791f73a286898fd0a)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:54.423519 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d16f27-55e3-4872-8378-78f5d6fdeedb None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:54.427560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 65/130] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:33:54 2022] GET /identity/v3/projects/43dfbfd1802b436791f73a286898fd0a => generated 298 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:54.429325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d16f27-55e3-4872-8378-78f5d6fdeedb None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:54.452395 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:54.634467 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518a763-0f5b-4821-9857-763fe3e783ea None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:54.708540 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d16f27-55e3-4872-8378-78f5d6fdeedb None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:54.720999 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c38a0-ac77-40ec-ba8d-730dbb0d03ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:54.722868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c38a0-ac77-40ec-ba8d-730dbb0d03ba None admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:54.723368 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c38a0-ac77-40ec-ba8d-730dbb0d03ba None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:54.723864 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c38a0-ac77-40ec-ba8d-730dbb0d03ba None admin] PATH_INFO: `/v3/projects/43dfbfd1802b436791f73a286898fd0a/users/4df458c2526a46c5a13d982659afe50c/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:54.727786 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c38a0-ac77-40ec-ba8d-730dbb0d03ba None admin] RBAC: Authorizing `identity:create_grant(project_id=43dfbfd1802b436791f73a286898fd0a, user_id=4df458c2526a46c5a13d982659afe50c, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:54.730681 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c38a0-ac77-40ec-ba8d-730dbb0d03ba None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:54.762871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 66/131] 10.222.0.94 () {58 vars in 1439 bytes} [Wed Aug 24 04:33:54 2022] PUT /identity/v3/projects/43dfbfd1802b436791f73a286898fd0a/users/4df458c2526a46c5a13d982659afe50c/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:33:54.764555 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c38a0-ac77-40ec-ba8d-730dbb0d03ba None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:54.789659 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa90fc6-7613-46d3-84af-6e611e4fa811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:54.791337 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa90fc6-7613-46d3-84af-6e611e4fa811 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:54.792161 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa90fc6-7613-46d3-84af-6e611e4fa811 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:54.792964 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa90fc6-7613-46d3-84af-6e611e4fa811 None admin] PATH_INFO: `/v3/users/37fda8d07e354fa9ab9472785c33f6e4` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:54.795689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa90fc6-7613-46d3-84af-6e611e4fa811 None admin] RBAC: Authorizing `identity:get_user(user_id=37fda8d07e354fa9ab9472785c33f6e4)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:54.799077 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa90fc6-7613-46d3-84af-6e611e4fa811 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:54.809495 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 66/132] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:33:54 2022] GET /identity/v3/users/37fda8d07e354fa9ab9472785c33f6e4 => generated 275 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:54.809495 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa90fc6-7613-46d3-84af-6e611e4fa811 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:54.832421 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:54.985705 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:54.997331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c38a0-ac77-40ec-ba8d-730dbb0d03ba None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:55.046814 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa90fc6-7613-46d3-84af-6e611e4fa811 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:55.073473 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e3d83-a166-4c17-9cc3-4db5e480f410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:55.073473 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e3d83-a166-4c17-9cc3-4db5e480f410 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:55.073473 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e3d83-a166-4c17-9cc3-4db5e480f410 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:55.073473 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e3d83-a166-4c17-9cc3-4db5e480f410 None admin] PATH_INFO: `/v3/projects/ef7fcbdab16d42e2ae21a9b09a4fbaf9` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:55.079075 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e3d83-a166-4c17-9cc3-4db5e480f410 None admin] RBAC: Authorizing `identity:get_project(project_id=ef7fcbdab16d42e2ae21a9b09a4fbaf9)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:55.083025 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e3d83-a166-4c17-9cc3-4db5e480f410 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:55.087925 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 67/133] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:33:54 2022] GET /identity/v3/projects/ef7fcbdab16d42e2ae21a9b09a4fbaf9 => generated 312 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:55.098035 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689dc5a-b25e-48d0-86fa-21cdf38d7689 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:55.099202 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689dc5a-b25e-48d0-86fa-21cdf38d7689 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:55.100040 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689dc5a-b25e-48d0-86fa-21cdf38d7689 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:55.103630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 68/134] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:55 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:33:55.105856 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689dc5a-b25e-48d0-86fa-21cdf38d7689 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:55.127132 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fadfa9-9500-4700-9a00-4200655d3e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:55.128463 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fadfa9-9500-4700-9a00-4200655d3e3e None admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:55.128976 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fadfa9-9500-4700-9a00-4200655d3e3e None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:55.129526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fadfa9-9500-4700-9a00-4200655d3e3e None admin] PATH_INFO: `/v3/projects/43dfbfd1802b436791f73a286898fd0a/users/37fda8d07e354fa9ab9472785c33f6e4/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:55.133828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fadfa9-9500-4700-9a00-4200655d3e3e None admin] RBAC: Authorizing `identity:create_grant(project_id=43dfbfd1802b436791f73a286898fd0a, user_id=37fda8d07e354fa9ab9472785c33f6e4, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:55.137045 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fadfa9-9500-4700-9a00-4200655d3e3e None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:55.170733 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 67/135] 10.222.0.94 () {58 vars in 1439 bytes} [Wed Aug 24 04:33:54 2022] PUT /identity/v3/projects/43dfbfd1802b436791f73a286898fd0a/users/37fda8d07e354fa9ab9472785c33f6e4/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:33:55.173319 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fadfa9-9500-4700-9a00-4200655d3e3e None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:55.428813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:55.462816 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689dc5a-b25e-48d0-86fa-21cdf38d7689 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:55.533780 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fadfa9-9500-4700-9a00-4200655d3e3e None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:55.546781 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202c3ff-8f96-4b51-9f62-ae522f12154e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:55.547902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202c3ff-8f96-4b51-9f62-ae522f12154e None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:55.548417 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202c3ff-8f96-4b51-9f62-ae522f12154e None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:55.548886 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202c3ff-8f96-4b51-9f62-ae522f12154e None admin] PATH_INFO: `/v3/projects/43dfbfd1802b436791f73a286898fd0a` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:55.551621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202c3ff-8f96-4b51-9f62-ae522f12154e None admin] RBAC: Authorizing `identity:get_project(project_id=43dfbfd1802b436791f73a286898fd0a)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:55.554619 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202c3ff-8f96-4b51-9f62-ae522f12154e None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:55.558539 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 69/136] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:33:55 2022] GET /identity/v3/projects/43dfbfd1802b436791f73a286898fd0a => generated 298 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:55.560884 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d7ac6-c93a-40e6-8de0-2def36b2eed2 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:55.561395 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d7ac6-c93a-40e6-8de0-2def36b2eed2 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:55.561923 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d7ac6-c93a-40e6-8de0-2def36b2eed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:55.596506 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-c76d7ac6-c93a-40e6-8de0-2def36b2eed2 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:55.599459 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-c76d7ac6-c93a-40e6-8de0-2def36b2eed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:55.617670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58ff3a-8da9-4b84-b4da-dc46281dcb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:55.618898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58ff3a-8da9-4b84-b4da-dc46281dcb35 None admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:55.619386 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58ff3a-8da9-4b84-b4da-dc46281dcb35 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:55.619976 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58ff3a-8da9-4b84-b4da-dc46281dcb35 None admin] PATH_INFO: `/v3/projects/ef7fcbdab16d42e2ae21a9b09a4fbaf9/users/37fda8d07e354fa9ab9472785c33f6e4/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:55.626890 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58ff3a-8da9-4b84-b4da-dc46281dcb35 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef7fcbdab16d42e2ae21a9b09a4fbaf9, user_id=37fda8d07e354fa9ab9472785c33f6e4, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:55.630875 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58ff3a-8da9-4b84-b4da-dc46281dcb35 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:55.640150 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:55.683283 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 68/137] 10.222.0.94 () {58 vars in 1439 bytes} [Wed Aug 24 04:33:55 2022] PUT /identity/v3/projects/ef7fcbdab16d42e2ae21a9b09a4fbaf9/users/37fda8d07e354fa9ab9472785c33f6e4/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:33:55.689474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58ff3a-8da9-4b84-b4da-dc46281dcb35 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:55.801714 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 70/138] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:33:56.027679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58ff3a-8da9-4b84-b4da-dc46281dcb35 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:56.112197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d095470-a3c6-4bb4-bba5-9ea63a479f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:56.114058 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d095470-a3c6-4bb4-bba5-9ea63a479f4e None admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:56.115026 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d095470-a3c6-4bb4-bba5-9ea63a479f4e None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:56.115791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d095470-a3c6-4bb4-bba5-9ea63a479f4e None admin] PATH_INFO: `/v3/projects/43dfbfd1802b436791f73a286898fd0a/users/37fda8d07e354fa9ab9472785c33f6e4/roles/f08394a5dbcf4506a17b78b4416f1680` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:56.124974 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d095470-a3c6-4bb4-bba5-9ea63a479f4e None admin] RBAC: Authorizing `identity:create_grant(project_id=43dfbfd1802b436791f73a286898fd0a, user_id=37fda8d07e354fa9ab9472785c33f6e4, role_id=f08394a5dbcf4506a17b78b4416f1680)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:56.128536 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d095470-a3c6-4bb4-bba5-9ea63a479f4e None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:56.162414 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 69/139] 10.222.0.94 () {58 vars in 1439 bytes} [Wed Aug 24 04:33:55 2022] PUT /identity/v3/projects/43dfbfd1802b436791f73a286898fd0a/users/37fda8d07e354fa9ab9472785c33f6e4/roles/f08394a5dbcf4506a17b78b4416f1680 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:33:56.673108 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d7ac6-c93a-40e6-8de0-2def36b2eed2 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:56.899159 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:56.907461 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d7ac6-c93a-40e6-8de0-2def36b2eed2 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:56.984577 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0af9b5-2afc-42a5-9a91-6034af86bcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:56.985633 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0af9b5-2afc-42a5-9a91-6034af86bcd6 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:56.986083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0af9b5-2afc-42a5-9a91-6034af86bcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:56.986550 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0af9b5-2afc-42a5-9a91-6034af86bcd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:56.989481 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0af9b5-2afc-42a5-9a91-6034af86bcd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:56.992325 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0af9b5-2afc-42a5-9a91-6034af86bcd6 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:56.996126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 71/140] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:33:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:57.008596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d095470-a3c6-4bb4-bba5-9ea63a479f4e None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:57.052049 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768a6de-8b72-4680-a586-de14e933f47c None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:57.052548 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768a6de-8b72-4680-a586-de14e933f47c None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:57.053037 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768a6de-8b72-4680-a586-de14e933f47c None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:57.055633 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 72/141] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:33:57.091539 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd550ac-79ed-4e4f-88d7-e771ba1e080a None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:57.092001 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd550ac-79ed-4e4f-88d7-e771ba1e080a None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:57.092500 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd550ac-79ed-4e4f-88d7-e771ba1e080a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:57.151267 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-fcd550ac-79ed-4e4f-88d7-e771ba1e080a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:57.153917 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-fcd550ac-79ed-4e4f-88d7-e771ba1e080a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:57.154187 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:57.291411 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d095470-a3c6-4bb4-bba5-9ea63a479f4e None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:57.391351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086e6dc-b33e-4b57-a48e-a69e0029246d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:57.392360 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086e6dc-b33e-4b57-a48e-a69e0029246d None admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:57.392791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086e6dc-b33e-4b57-a48e-a69e0029246d None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:57.395543 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 73/142] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:33:57.397676 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086e6dc-b33e-4b57-a48e-a69e0029246d None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:57.398826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086e6dc-b33e-4b57-a48e-a69e0029246d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:57.401815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086e6dc-b33e-4b57-a48e-a69e0029246d None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:57.445213 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 70/143] 10.222.0.94 () {60 vars in 1132 bytes} [Wed Aug 24 04:33:57 2022] POST /identity/v3/users => generated 283 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:33:58.053460 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd550ac-79ed-4e4f-88d7-e771ba1e080a None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:58.261502 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:58.290063 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd550ac-79ed-4e4f-88d7-e771ba1e080a None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:58.373130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437bc5f-6f8d-4941-8382-13462bd9004c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:58.374168 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437bc5f-6f8d-4941-8382-13462bd9004c None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:58.374718 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437bc5f-6f8d-4941-8382-13462bd9004c None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:58.375182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437bc5f-6f8d-4941-8382-13462bd9004c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:58.407143 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437bc5f-6f8d-4941-8382-13462bd9004c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:33:58.417016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-6437bc5f-6f8d-4941-8382-13462bd9004c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:33:58.417016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:33:58.417016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:33:58.417016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:33:58.417016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:33:58.417016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:33:58.417016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:33:58.417016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:33:58.417016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:33:58.417016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:33:58.417016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:33:58.417016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:33:58.417016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:33:58.417016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:33:58.417016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:33:58.417016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:33:58.418817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:33:58.418817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:33:58.418817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:33:58.418817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:33:58.418817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:33:58.418817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:33:58.418817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:33:58.418817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:33:58.418817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:33:58.418817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:33:58.418817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:33:58.418817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:33:58.418817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:33:58.418817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:33:58.418817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:33:58.418817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:33:58.421187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:33:58.421187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:33:58.421187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:33:58.421187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:33:58.421187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:33:58.421187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:33:58.421187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:33:58.421187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:33:58.421187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:33:58.421187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:33:58.421187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:33:58.421187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:33:58.421187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 74/144] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:33:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:33:58.430215 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086e6dc-b33e-4b57-a48e-a69e0029246d None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:58.670800 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086e6dc-b33e-4b57-a48e-a69e0029246d None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:58.706821 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:58.772490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3c782-9e0f-4759-9059-6f87b552c18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:58.773629 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3c782-9e0f-4759-9059-6f87b552c18a None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:58.774145 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3c782-9e0f-4759-9059-6f87b552c18a None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:58.774620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3c782-9e0f-4759-9059-6f87b552c18a None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:58.775648 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3c782-9e0f-4759-9059-6f87b552c18a None admin] RBAC: Adding query filter params (name=reader) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:33:58.776156 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3c782-9e0f-4759-9059-6f87b552c18a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:58.778970 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3c782-9e0f-4759-9059-6f87b552c18a None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:58.804483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 71/145] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:33:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:58.811901 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437bc5f-6f8d-4941-8382-13462bd9004c None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:59.013771 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437bc5f-6f8d-4941-8382-13462bd9004c None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:59.071579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a7ff3-3241-4233-9a39-69765fba26ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:59.072517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a7ff3-3241-4233-9a39-69765fba26ca None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:59.072892 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a7ff3-3241-4233-9a39-69765fba26ca None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:59.073006 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a7ff3-3241-4233-9a39-69765fba26ca None admin] PATH_INFO: `/v3/users/34c6b867af5c4bb492a60653f7aa934d` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:59.074491 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a7ff3-3241-4233-9a39-69765fba26ca None admin] RBAC: Authorizing `identity:get_user(user_id=34c6b867af5c4bb492a60653f7aa934d)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:59.076252 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a7ff3-3241-4233-9a39-69765fba26ca None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:59.078593 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 75/146] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:33:58 2022] GET /identity/v3/users/34c6b867af5c4bb492a60653f7aa934d => generated 289 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:59.087173 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3c782-9e0f-4759-9059-6f87b552c18a None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:59.214942 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc14d14-b70f-4dd1-98a5-2f317351af30 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:59.215910 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc14d14-b70f-4dd1-98a5-2f317351af30 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:59.216712 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc14d14-b70f-4dd1-98a5-2f317351af30 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:59.225989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 76/147] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:33:59 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:33:59.234588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e430c7c-bbf6-4c74-83c8-505a882ae46d None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:59.235126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e430c7c-bbf6-4c74-83c8-505a882ae46d None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:59.235626 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e430c7c-bbf6-4c74-83c8-505a882ae46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:59.266390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3c782-9e0f-4759-9059-6f87b552c18a None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:59.300103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-9e430c7c-bbf6-4c74-83c8-505a882ae46d None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:59.302463 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-9e430c7c-bbf6-4c74-83c8-505a882ae46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:59.344501 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:59.363072 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2cb83-efa3-48e4-a933-3fb74e98f5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:59.374771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2cb83-efa3-48e4-a933-3fb74e98f5c9 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:59.375400 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2cb83-efa3-48e4-a933-3fb74e98f5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:59.375983 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2cb83-efa3-48e4-a933-3fb74e98f5c9 None admin] PATH_INFO: `/v3/projects/43dfbfd1802b436791f73a286898fd0a` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:59.379273 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2cb83-efa3-48e4-a933-3fb74e98f5c9 None admin] RBAC: Authorizing `identity:get_project(project_id=43dfbfd1802b436791f73a286898fd0a)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:59.383077 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2cb83-efa3-48e4-a933-3fb74e98f5c9 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:59.394807 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 72/148] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:33:59 2022] GET /identity/v3/projects/43dfbfd1802b436791f73a286898fd0a => generated 298 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:33:59.402938 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2cb83-efa3-48e4-a933-3fb74e98f5c9 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:59.525688 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:59.579595 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 77/149] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:33:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:33:59.671624 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2cb83-efa3-48e4-a933-3fb74e98f5c9 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:59.761783 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344b0e0-1ab9-4e5d-a037-7092a817b1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:59.762551 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344b0e0-1ab9-4e5d-a037-7092a817b1b5 None admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:59.762911 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344b0e0-1ab9-4e5d-a037-7092a817b1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:59.763188 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344b0e0-1ab9-4e5d-a037-7092a817b1b5 None admin] PATH_INFO: `/v3/projects/43dfbfd1802b436791f73a286898fd0a/users/34c6b867af5c4bb492a60653f7aa934d/roles/28bafe05b4a44e89a89bdd6806d44ac5` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:59.771698 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344b0e0-1ab9-4e5d-a037-7092a817b1b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=43dfbfd1802b436791f73a286898fd0a, user_id=34c6b867af5c4bb492a60653f7aa934d, role_id=28bafe05b4a44e89a89bdd6806d44ac5)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:59.773765 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344b0e0-1ab9-4e5d-a037-7092a817b1b5 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:59.801139 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 73/150] 10.222.0.94 () {58 vars in 1439 bytes} [Wed Aug 24 04:33:59 2022] PUT /identity/v3/projects/43dfbfd1802b436791f73a286898fd0a/users/34c6b867af5c4bb492a60653f7aa934d/roles/28bafe05b4a44e89a89bdd6806d44ac5 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:34:00.576459 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbbe14-a52f-4f26-93e1-5b1bfcf4c77a None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:00.579277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344b0e0-1ab9-4e5d-a037-7092a817b1b5 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:00.582366 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbbe14-a52f-4f26-93e1-5b1bfcf4c77a None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:00.586864 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbbe14-a52f-4f26-93e1-5b1bfcf4c77a None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:00.594304 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 78/151] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:00 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:00.605088 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb1d59-1ea7-407b-b6c8-283214c0fe0a None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:00.606084 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb1d59-1ea7-407b-b6c8-283214c0fe0a None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:00.606853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb1d59-1ea7-407b-b6c8-283214c0fe0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:00.675290 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-f5eb1d59-1ea7-407b-b6c8-283214c0fe0a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:00.683982 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-f5eb1d59-1ea7-407b-b6c8-283214c0fe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:00.899709 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 79/152] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:34:00.963707 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:00.973001 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344b0e0-1ab9-4e5d-a037-7092a817b1b5 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:01.063251 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32d7a7-8010-4a8b-9513-605d0007c395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:01.064132 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32d7a7-8010-4a8b-9513-605d0007c395 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:01.064574 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32d7a7-8010-4a8b-9513-605d0007c395 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:01.065999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32d7a7-8010-4a8b-9513-605d0007c395 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:01.092405 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32d7a7-8010-4a8b-9513-605d0007c395 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:01.102677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-eb32d7a7-8010-4a8b-9513-605d0007c395 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:34:01.102677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:01.102677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:01.102677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:01.102677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:01.102677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:01.102677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:01.102677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:01.102677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:01.102677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:01.102677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:01.102677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:01.102677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:01.102677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:01.102677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:01.102677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:01.104351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:01.104351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:01.104351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:01.104351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:01.104351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:01.104351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:01.104351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:01.104351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:01.104351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:01.104351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:01.104351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:01.104351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:01.104351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:01.104351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:01.104351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:01.104351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:01.105901 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:01.105901 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:01.105901 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:01.105901 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:01.105901 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:01.105901 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:01.105901 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:01.105901 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:01.105901 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:01.105901 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:01.105901 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:34:01.105901 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:34:01.105901 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 74/153] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:34:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 527 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:01.117576 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb1d59-1ea7-407b-b6c8-283214c0fe0a None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:01.180369 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6818ae9-8286-406d-985b-4390bd426c56 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:01.180748 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6818ae9-8286-406d-985b-4390bd426c56 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:01.181199 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6818ae9-8286-406d-985b-4390bd426c56 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:01.183769 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 75/154] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:34:01.196589 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea36690-106e-423a-8166-4ebc424ac9fe None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:01.197085 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea36690-106e-423a-8166-4ebc424ac9fe None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:01.197598 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea36690-106e-423a-8166-4ebc424ac9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:01.259764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-5ea36690-106e-423a-8166-4ebc424ac9fe None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:01.262115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-5ea36690-106e-423a-8166-4ebc424ac9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:01.360470 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:01.449790 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb1d59-1ea7-407b-b6c8-283214c0fe0a None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:01.509699 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 76/155] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:34:01.559285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cc568-59f1-4103-9a22-218041a715ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:01.559972 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cc568-59f1-4103-9a22-218041a715ab None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:01.560287 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cc568-59f1-4103-9a22-218041a715ab None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:01.560526 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cc568-59f1-4103-9a22-218041a715ab None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:01.561274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cc568-59f1-4103-9a22-218041a715ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:01.561613 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cc568-59f1-4103-9a22-218041a715ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:01.563626 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cc568-59f1-4103-9a22-218041a715ab None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:01.586394 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 80/156] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:34:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:01.595756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea36690-106e-423a-8166-4ebc424ac9fe None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:01.870872 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:01.892542 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea36690-106e-423a-8166-4ebc424ac9fe None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:01.979769 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a01ed-16e0-452c-968b-0a2611cd84fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:01.980837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a01ed-16e0-452c-968b-0a2611cd84fa None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:01.981288 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a01ed-16e0-452c-968b-0a2611cd84fa None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:01.981774 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a01ed-16e0-452c-968b-0a2611cd84fa None admin] PATH_INFO: `/v3/users/4df458c2526a46c5a13d982659afe50c` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:01.986887 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a01ed-16e0-452c-968b-0a2611cd84fa None admin] RBAC: Authorizing `identity:get_user(user_id=4df458c2526a46c5a13d982659afe50c)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:01.990508 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a01ed-16e0-452c-968b-0a2611cd84fa None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:01.994385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 77/157] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:34:01 2022] GET /identity/v3/users/4df458c2526a46c5a13d982659afe50c => generated 247 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:02.003603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cc568-59f1-4103-9a22-218041a715ab None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:02.072561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a01ed-16e0-452c-968b-0a2611cd84fa None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:02.292272 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cc568-59f1-4103-9a22-218041a715ab None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:02.428418 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54f10a-3c43-4dba-84b5-db0fd0b2a5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:02.429987 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54f10a-3c43-4dba-84b5-db0fd0b2a5e8 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:02.430760 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54f10a-3c43-4dba-84b5-db0fd0b2a5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:02.431515 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54f10a-3c43-4dba-84b5-db0fd0b2a5e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:02.461712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a01ed-16e0-452c-968b-0a2611cd84fa None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:02.474009 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:02.534016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7724c-7bae-4efd-9ea8-dddc261391c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:02.535219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7724c-7bae-4efd-9ea8-dddc261391c8 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:02.535763 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7724c-7bae-4efd-9ea8-dddc261391c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:02.536335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7724c-7bae-4efd-9ea8-dddc261391c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:02.558863 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7724c-7bae-4efd-9ea8-dddc261391c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:02.571509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-1dd7724c-7bae-4efd-9ea8-dddc261391c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:34:02.571509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:02.571509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:02.571509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:02.571509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:02.571509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:02.571509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:02.571509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:02.571509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:02.571509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:02.571509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:02.571509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:02.571509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:02.571509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:02.571509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:02.571509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:02.573514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:02.573514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:02.573514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:02.573514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:02.573514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:02.573514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:02.573514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:02.573514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:02.573514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:02.573514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:02.573514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:02.573514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:02.573514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:02.573514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:02.573514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:02.573514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:02.575083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:02.575083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:02.575083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:02.575083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:02.575083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:02.575083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:02.575083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:02.575083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:02.575083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:02.575083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:02.575083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:34:02.575083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:34:02.575083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 78/158] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:34:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 502 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:34:02.576512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457d061-19bf-4211-973b-11dbeaf6d60e None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:02.576512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457d061-19bf-4211-973b-11dbeaf6d60e None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:02.577145 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457d061-19bf-4211-973b-11dbeaf6d60e None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:02.585459 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 79/159] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:02.602411 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccf41c-a4f4-48e9-baa7-ea6e6ae63942 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:02.610001 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccf41c-a4f4-48e9-baa7-ea6e6ae63942 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:02.610744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccf41c-a4f4-48e9-baa7-ea6e6ae63942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:02.669734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54f10a-3c43-4dba-84b5-db0fd0b2a5e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:02.672350 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54f10a-3c43-4dba-84b5-db0fd0b2a5e8 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:02.676184 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-feccf41c-a4f4-48e9-baa7-ea6e6ae63942 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:02.679797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-feccf41c-a4f4-48e9-baa7-ea6e6ae63942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:02.742040 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:02.894398 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 80/160] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:02.896840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccf41c-a4f4-48e9-baa7-ea6e6ae63942 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:03.047201 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 81/161] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:34:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1045 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:03.048685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54f10a-3c43-4dba-84b5-db0fd0b2a5e8 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:03.123672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:03.199182 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccf41c-a4f4-48e9-baa7-ea6e6ae63942 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:03.246930 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54f10a-3c43-4dba-84b5-db0fd0b2a5e8 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:03.315446 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a59a81-9b72-4fda-ae2a-9ffebcd453f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:03.316710 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b22ac-50ab-4acf-9b2c-c8ff23c684ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:03.317782 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b22ac-50ab-4acf-9b2c-c8ff23c684ac None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:03.318074 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a59a81-9b72-4fda-ae2a-9ffebcd453f6 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:03.318177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b22ac-50ab-4acf-9b2c-c8ff23c684ac None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:03.318595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b22ac-50ab-4acf-9b2c-c8ff23c684ac None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:03.318801 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a59a81-9b72-4fda-ae2a-9ffebcd453f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:03.319461 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a59a81-9b72-4fda-ae2a-9ffebcd453f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:03.319680 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b22ac-50ab-4acf-9b2c-c8ff23c684ac None admin] RBAC: Adding query filter params (name=member) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:03.320428 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b22ac-50ab-4acf-9b2c-c8ff23c684ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:03.323739 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b22ac-50ab-4acf-9b2c-c8ff23c684ac None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:03.337081 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a59a81-9b72-4fda-ae2a-9ffebcd453f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:03.343603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-d4a59a81-9b72-4fda-ae2a-9ffebcd453f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:34:03.343603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:03.343603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:03.343603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:03.343603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:03.343603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:03.343603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:03.343603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:03.343603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:03.343603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:03.343603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:03.343603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:03.343603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:03.343603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:03.343603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:03.343603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:03.344672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:03.344672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:03.344672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:03.344672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:03.344672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:03.344672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:03.344672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:03.344672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:03.344672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:03.344672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:03.344672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:03.344672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:03.344672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:03.344672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:03.344672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:03.344672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:03.345606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:03.345606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:03.345606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:03.345606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:03.345606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:03.345606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:03.345606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:03.345606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:03.345606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:03.345606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:03.345606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:34:03.345606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:34:03.350344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 82/162] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:34:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:03.351683 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a59a81-9b72-4fda-ae2a-9ffebcd453f6 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:03.357811 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 81/163] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:34:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:03.364419 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b22ac-50ab-4acf-9b2c-c8ff23c684ac None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:03.400966 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:03.567439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:03.571957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a59a81-9b72-4fda-ae2a-9ffebcd453f6 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:03.644602 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71ea89-22ac-4f08-a846-89a4e382a301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:03.646211 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71ea89-22ac-4f08-a846-89a4e382a301 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:03.646966 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71ea89-22ac-4f08-a846-89a4e382a301 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:03.647716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71ea89-22ac-4f08-a846-89a4e382a301 None admin] PATH_INFO: `/v3/projects/43dfbfd1802b436791f73a286898fd0a` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:03.650209 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71ea89-22ac-4f08-a846-89a4e382a301 None admin] RBAC: Authorizing `identity:get_project(project_id=43dfbfd1802b436791f73a286898fd0a)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:03.653235 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71ea89-22ac-4f08-a846-89a4e382a301 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:03.656698 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 83/164] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:03 2022] GET /identity/v3/projects/43dfbfd1802b436791f73a286898fd0a => generated 298 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:03.658721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71ea89-22ac-4f08-a846-89a4e382a301 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:03.749701 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b22ac-50ab-4acf-9b2c-c8ff23c684ac None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:03.890278 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc142ff-dcb5-4ebc-85e1-b021d85da2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:03.891738 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc142ff-dcb5-4ebc-85e1-b021d85da2e4 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:03.892504 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc142ff-dcb5-4ebc-85e1-b021d85da2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:03.893267 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc142ff-dcb5-4ebc-85e1-b021d85da2e4 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:03.894882 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc142ff-dcb5-4ebc-85e1-b021d85da2e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:03.895686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc142ff-dcb5-4ebc-85e1-b021d85da2e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:03.899776 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71ea89-22ac-4f08-a846-89a4e382a301 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:03.903772 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc142ff-dcb5-4ebc-85e1-b021d85da2e4 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:03.934183 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 82/165] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:34:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 572 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:03.936467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc142ff-dcb5-4ebc-85e1-b021d85da2e4 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:03.965190 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93a353-4c17-4bef-9666-41939c40b859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:03.966805 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93a353-4c17-4bef-9666-41939c40b859 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:03.967582 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93a353-4c17-4bef-9666-41939c40b859 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:03.968316 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93a353-4c17-4bef-9666-41939c40b859 None admin] PATH_INFO: `/v3/users/37fda8d07e354fa9ab9472785c33f6e4` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:03.971167 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab93a353-4c17-4bef-9666-41939c40b859 None admin] RBAC: Authorizing `identity:get_user(user_id=37fda8d07e354fa9ab9472785c33f6e4)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:03.975381 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab93a353-4c17-4bef-9666-41939c40b859 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:03.979665 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 84/166] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:34:03 2022] GET /identity/v3/users/37fda8d07e354fa9ab9472785c33f6e4 => generated 275 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:03.981600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93a353-4c17-4bef-9666-41939c40b859 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:04.051556 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:04.201995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93a353-4c17-4bef-9666-41939c40b859 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:04.242226 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:04.283074 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5fa71-a0cc-4a53-8a65-5155f2e206c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:04.285934 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5fa71-a0cc-4a53-8a65-5155f2e206c2 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:04.286740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5fa71-a0cc-4a53-8a65-5155f2e206c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:04.287486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5fa71-a0cc-4a53-8a65-5155f2e206c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:04.311280 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5fa71-a0cc-4a53-8a65-5155f2e206c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:04.323079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-b1b5fa71-a0cc-4a53-8a65-5155f2e206c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:34:04.323079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:04.323079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:04.323079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:04.323079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:04.323079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:04.323079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:04.323079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:04.323079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:04.323079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:04.323079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:04.323079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:04.323079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:04.323079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:04.323079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:04.323079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:04.324724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:04.324724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:04.324724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:04.324724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:04.324724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:04.324724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:04.324724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:04.324724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:04.324724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:04.324724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:04.324724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:04.324724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:04.324724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:04.324724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:04.324724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:04.324724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:04.326729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:04.326729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:04.326729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:04.326729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:04.326729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:04.326729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:04.326729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:04.326729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:04.326729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:04.326729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:04.326729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:34:04.326729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:34:04.332905 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 85/167] 10.222.0.94 () {56 vars in 1114 bytes} [Wed Aug 24 04:34:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:04.335117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5fa71-a0cc-4a53-8a65-5155f2e206c2 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:04.362049 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc142ff-dcb5-4ebc-85e1-b021d85da2e4 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:04.479802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12f6e7-6fdd-4242-823d-22cec83d11d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:04.480758 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12f6e7-6fdd-4242-823d-22cec83d11d2 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:04.481257 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12f6e7-6fdd-4242-823d-22cec83d11d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:04.481813 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12f6e7-6fdd-4242-823d-22cec83d11d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:04.482900 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12f6e7-6fdd-4242-823d-22cec83d11d2 None admin] RBAC: Adding query filter params (role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2, scope.project.id=43dfbfd1802b436791f73a286898fd0a, user.id=4df458c2526a46c5a13d982659afe50c) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:04.483411 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12f6e7-6fdd-4242-823d-22cec83d11d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:04.485441 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12f6e7-6fdd-4242-823d-22cec83d11d2 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:04.506822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 83/168] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:34:03 2022] GET /identity/v3/role_assignments?user.id=4df458c2526a46c5a13d982659afe50c&scope.project.id=43dfbfd1802b436791f73a286898fd0a&role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 608 bytes in 571 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:04.508635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12f6e7-6fdd-4242-823d-22cec83d11d2 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:04.596670 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:04.615839 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5fa71-a0cc-4a53-8a65-5155f2e206c2 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:04.693972 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e093f-c429-43e1-9594-efa8ee5ea3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:04.696076 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e093f-c429-43e1-9594-efa8ee5ea3ff None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:04.696896 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e093f-c429-43e1-9594-efa8ee5ea3ff None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:04.697617 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e093f-c429-43e1-9594-efa8ee5ea3ff None admin] PATH_INFO: `/v3/users/37fda8d07e354fa9ab9472785c33f6e4` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:04.700433 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e093f-c429-43e1-9594-efa8ee5ea3ff None admin] RBAC: Authorizing `identity:get_user(user_id=37fda8d07e354fa9ab9472785c33f6e4)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:04.703661 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e093f-c429-43e1-9594-efa8ee5ea3ff None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:04.708290 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 86/169] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:34:04 2022] GET /identity/v3/users/37fda8d07e354fa9ab9472785c33f6e4 => generated 275 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:04.710248 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e093f-c429-43e1-9594-efa8ee5ea3ff None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:04.923187 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12f6e7-6fdd-4242-823d-22cec83d11d2 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:05.055712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328597c-fa5f-4233-b98b-49000012b56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:05.063543 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328597c-fa5f-4233-b98b-49000012b56b None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:05.064331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328597c-fa5f-4233-b98b-49000012b56b None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:05.065976 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328597c-fa5f-4233-b98b-49000012b56b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:05.075513 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:05.099297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e093f-c429-43e1-9594-efa8ee5ea3ff None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:05.221148 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb31e5-6a71-4b8a-a2ca-a06d9fb43b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:05.222683 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb31e5-6a71-4b8a-a2ca-a06d9fb43b38 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:05.223323 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb31e5-6a71-4b8a-a2ca-a06d9fb43b38 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:05.224015 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb31e5-6a71-4b8a-a2ca-a06d9fb43b38 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:05.225592 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb31e5-6a71-4b8a-a2ca-a06d9fb43b38 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:05.226327 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb31e5-6a71-4b8a-a2ca-a06d9fb43b38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:05.229161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb31e5-6a71-4b8a-a2ca-a06d9fb43b38 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:05.246694 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 87/170] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:34:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 538 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:05.249244 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10f9aa-9288-421c-b599-b7ddbd9c8b51 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:05.250184 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10f9aa-9288-421c-b599-b7ddbd9c8b51 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:05.250933 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10f9aa-9288-421c-b599-b7ddbd9c8b51 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:05.255024 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 88/171] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:05.256796 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10f9aa-9288-421c-b599-b7ddbd9c8b51 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:05.318851 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:05.334259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328597c-fa5f-4233-b98b-49000012b56b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:05.338514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328597c-fa5f-4233-b98b-49000012b56b None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:05.576471 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10f9aa-9288-421c-b599-b7ddbd9c8b51 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:05.665431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd77f8f-7b5d-4676-b53d-0f563a538863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:05.665705 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 84/172] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:34:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1158 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:05.666641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd77f8f-7b5d-4676-b53d-0f563a538863 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:05.666910 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd77f8f-7b5d-4676-b53d-0f563a538863 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:05.667368 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd77f8f-7b5d-4676-b53d-0f563a538863 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:05.667883 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9342a6-2851-45de-843a-af3cb2506b61 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:05.668384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9342a6-2851-45de-843a-af3cb2506b61 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:05.668814 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9342a6-2851-45de-843a-af3cb2506b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:05.701756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-7c9342a6-2851-45de-843a-af3cb2506b61 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:05.704122 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-7c9342a6-2851-45de-843a-af3cb2506b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:05.761020 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:05.808320 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd77f8f-7b5d-4676-b53d-0f563a538863 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:05.810929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd77f8f-7b5d-4676-b53d-0f563a538863 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:05.834775 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 85/173] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:05.839311 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9342a6-2851-45de-843a-af3cb2506b61 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:05.865937 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:06.065750 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 89/174] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:34:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 810 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:06.069889 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d54c4c-5c38-4e81-bfc7-ba925b277075 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:06.071388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d54c4c-5c38-4e81-bfc7-ba925b277075 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:06.072176 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d54c4c-5c38-4e81-bfc7-ba925b277075 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:06.076949 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 90/175] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:06 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:06.080975 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4581739-a06c-490e-b7c7-45a6ee4c7079 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:06.081936 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4581739-a06c-490e-b7c7-45a6ee4c7079 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:06.083328 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4581739-a06c-490e-b7c7-45a6ee4c7079 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:06.088030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 91/176] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:06 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:06.090592 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4581739-a06c-490e-b7c7-45a6ee4c7079 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:06.106383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9342a6-2851-45de-843a-af3cb2506b61 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:06.186761 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fface1-3f48-49d2-b611-9c30e2cbbe2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:06.188518 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fface1-3f48-49d2-b611-9c30e2cbbe2c None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:06.189265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fface1-3f48-49d2-b611-9c30e2cbbe2c None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:06.192087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fface1-3f48-49d2-b611-9c30e2cbbe2c None admin] PATH_INFO: `/v3/users/37fda8d07e354fa9ab9472785c33f6e4` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:06.194998 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fface1-3f48-49d2-b611-9c30e2cbbe2c None admin] RBAC: Authorizing `identity:get_user(user_id=37fda8d07e354fa9ab9472785c33f6e4)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:06.199237 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fface1-3f48-49d2-b611-9c30e2cbbe2c None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:06.204261 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 86/177] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:34:05 2022] GET /identity/v3/users/37fda8d07e354fa9ab9472785c33f6e4 => generated 275 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:06.207625 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fface1-3f48-49d2-b611-9c30e2cbbe2c None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:06.305018 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:06.342688 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4581739-a06c-490e-b7c7-45a6ee4c7079 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:06.389613 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:06.406758 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd8a40-94fd-4962-8eb9-a93dea63d199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:06.407569 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd8a40-94fd-4962-8eb9-a93dea63d199 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:06.408012 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd8a40-94fd-4962-8eb9-a93dea63d199 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:06.408529 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd8a40-94fd-4962-8eb9-a93dea63d199 None admin] PATH_INFO: `/v3/projects/43dfbfd1802b436791f73a286898fd0a` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:06.410656 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd8a40-94fd-4962-8eb9-a93dea63d199 None admin] RBAC: Authorizing `identity:get_project(project_id=43dfbfd1802b436791f73a286898fd0a)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:06.412358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd8a40-94fd-4962-8eb9-a93dea63d199 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:06.414723 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 92/178] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:06 2022] GET /identity/v3/projects/43dfbfd1802b436791f73a286898fd0a => generated 298 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:06.416161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acafc0-0216-4164-8e9a-6157eb8542bf None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:06.416765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acafc0-0216-4164-8e9a-6157eb8542bf None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:06.417122 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acafc0-0216-4164-8e9a-6157eb8542bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:06.438542 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fface1-3f48-49d2-b611-9c30e2cbbe2c None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:06.451086 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-f5acafc0-0216-4164-8e9a-6157eb8542bf None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:06.453307 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-f5acafc0-0216-4164-8e9a-6157eb8542bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:06.504650 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b9eee-7f3c-42dd-b4bb-bef57feb8e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:06.505787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b9eee-7f3c-42dd-b4bb-bef57feb8e7b None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:06.506283 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b9eee-7f3c-42dd-b4bb-bef57feb8e7b None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:06.506748 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b9eee-7f3c-42dd-b4bb-bef57feb8e7b None admin] PATH_INFO: `/v3/projects/ef7fcbdab16d42e2ae21a9b09a4fbaf9` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:06.509046 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b9eee-7f3c-42dd-b4bb-bef57feb8e7b None admin] RBAC: Authorizing `identity:get_project(project_id=ef7fcbdab16d42e2ae21a9b09a4fbaf9)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:06.511919 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b9eee-7f3c-42dd-b4bb-bef57feb8e7b None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:06.524325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 87/179] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:06 2022] GET /identity/v3/projects/ef7fcbdab16d42e2ae21a9b09a4fbaf9 => generated 312 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:06.524325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78ea25-c514-47e2-8c6d-9c142fe06c26 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:06.524325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78ea25-c514-47e2-8c6d-9c142fe06c26 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:06.524325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78ea25-c514-47e2-8c6d-9c142fe06c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:06.552615 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-ee78ea25-c514-47e2-8c6d-9c142fe06c26 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:06.554995 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-ee78ea25-c514-47e2-8c6d-9c142fe06c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:06.571097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 93/180] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:06.573247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acafc0-0216-4164-8e9a-6157eb8542bf None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:06.709490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 88/181] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:06.714816 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761c641-3ec8-4d2b-b449-fc13a1ad99ac None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:06.714816 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761c641-3ec8-4d2b-b449-fc13a1ad99ac None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:06.714816 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761c641-3ec8-4d2b-b449-fc13a1ad99ac None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:06.723858 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 89/182] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:06 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:06.725801 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761c641-3ec8-4d2b-b449-fc13a1ad99ac None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:06.809141 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:06.832019 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acafc0-0216-4164-8e9a-6157eb8542bf None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:06.885705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:06.910694 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2ad1c-5b37-47b9-b8e0-2b9eb7b5904b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:06.912390 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2ad1c-5b37-47b9-b8e0-2b9eb7b5904b None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:06.913568 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2ad1c-5b37-47b9-b8e0-2b9eb7b5904b None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:06.914367 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2ad1c-5b37-47b9-b8e0-2b9eb7b5904b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:06.978152 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761c641-3ec8-4d2b-b449-fc13a1ad99ac None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:07.053866 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17737f7e-5f6f-4bbf-8867-8666f7129d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:07.054802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17737f7e-5f6f-4bbf-8867-8666f7129d4d None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:07.055277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17737f7e-5f6f-4bbf-8867-8666f7129d4d None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:07.055671 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17737f7e-5f6f-4bbf-8867-8666f7129d4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:07.065357 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2ad1c-5b37-47b9-b8e0-2b9eb7b5904b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:07.068606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2ad1c-5b37-47b9-b8e0-2b9eb7b5904b None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:07.071855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17737f7e-5f6f-4bbf-8867-8666f7129d4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:07.078086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-17737f7e-5f6f-4bbf-8867-8666f7129d4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:34:07.078086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:07.078086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:07.078086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:07.078086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:07.078086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:07.078086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:07.078086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:07.078086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:07.078086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:07.078086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:07.078086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:07.078086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:07.078086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:07.078086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:07.078086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:07.079791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:07.079791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:07.079791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:07.079791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:07.079791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:07.079791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:07.079791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:07.079791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:07.079791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:07.079791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:07.079791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:07.079791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:07.079791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:07.079791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:07.079791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:07.079791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:07.087155 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:07.087155 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:07.087155 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:07.087155 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:07.087155 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:07.087155 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:07.087155 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:07.087155 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:07.087155 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:07.087155 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:07.087155 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:34:07.087155 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:34:07.087155 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 90/183] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:34:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:07.087155 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17737f7e-5f6f-4bbf-8867-8666f7129d4d None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:07.280708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:07.303381 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 94/184] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:34:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 724 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:07.303381 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2ad1c-5b37-47b9-b8e0-2b9eb7b5904b None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:07.303769 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17737f7e-5f6f-4bbf-8867-8666f7129d4d None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:07.351350 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:07.369225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac5d28-fc3b-4f24-a969-10f961fe6a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:07.370366 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac5d28-fc3b-4f24-a969-10f961fe6a14 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:07.370627 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac5d28-fc3b-4f24-a969-10f961fe6a14 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:07.371055 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac5d28-fc3b-4f24-a969-10f961fe6a14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:07.372104 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac5d28-fc3b-4f24-a969-10f961fe6a14 None admin] RBAC: Adding query filter params (role.id=1a586b803a1e429f82b85f386d7564fb, scope.project.id=43dfbfd1802b436791f73a286898fd0a, user.id=37fda8d07e354fa9ab9472785c33f6e4) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:07.372457 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac5d28-fc3b-4f24-a969-10f961fe6a14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:07.374937 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac5d28-fc3b-4f24-a969-10f961fe6a14 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:07.385874 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 91/185] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:34:07 2022] GET /identity/v3/role_assignments?user.id=37fda8d07e354fa9ab9472785c33f6e4&scope.project.id=43dfbfd1802b436791f73a286898fd0a&role.id=1a586b803a1e429f82b85f386d7564fb => generated 608 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:07.387425 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403d852-a7d9-483a-97ed-5d5bca275d8e None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:07.387798 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403d852-a7d9-483a-97ed-5d5bca275d8e None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:07.388187 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403d852-a7d9-483a-97ed-5d5bca275d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:07.416613 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-9403d852-a7d9-483a-97ed-5d5bca275d8e None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:07.418776 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-9403d852-a7d9-483a-97ed-5d5bca275d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:07.519951 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2ad1c-5b37-47b9-b8e0-2b9eb7b5904b None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:07.600523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 92/186] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:07.602332 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403d852-a7d9-483a-97ed-5d5bca275d8e None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:07.631655 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715487a-2155-44d5-a2f0-54dfd1dd86ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:07.632136 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715487a-2155-44d5-a2f0-54dfd1dd86ad None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:07.632604 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715487a-2155-44d5-a2f0-54dfd1dd86ad None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:07.633502 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715487a-2155-44d5-a2f0-54dfd1dd86ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:07.634543 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715487a-2155-44d5-a2f0-54dfd1dd86ad None admin] RBAC: Adding query filter params (role.id=1a586b803a1e429f82b85f386d7564fb, scope.project.id=ef7fcbdab16d42e2ae21a9b09a4fbaf9, user.id=37fda8d07e354fa9ab9472785c33f6e4) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:07.634900 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715487a-2155-44d5-a2f0-54dfd1dd86ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:07.636717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715487a-2155-44d5-a2f0-54dfd1dd86ad None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:07.652301 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 95/187] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:34:07 2022] GET /identity/v3/role_assignments?user.id=37fda8d07e354fa9ab9472785c33f6e4&scope.project.id=ef7fcbdab16d42e2ae21a9b09a4fbaf9&role.id=1a586b803a1e429f82b85f386d7564fb => generated 608 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:07.654505 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715487a-2155-44d5-a2f0-54dfd1dd86ad None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:07.861512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:07.895401 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403d852-a7d9-483a-97ed-5d5bca275d8e None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:07.912275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:07.947870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715487a-2155-44d5-a2f0-54dfd1dd86ad None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:07.969128 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80280f-5b9f-4165-8ccc-3d893bc04c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:07.970541 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80280f-5b9f-4165-8ccc-3d893bc04c06 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:07.972226 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80280f-5b9f-4165-8ccc-3d893bc04c06 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:07.972418 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80280f-5b9f-4165-8ccc-3d893bc04c06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:07.976189 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80280f-5b9f-4165-8ccc-3d893bc04c06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:07.978961 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80280f-5b9f-4165-8ccc-3d893bc04c06 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:07.985460 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 93/188] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:34:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:07.985460 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80280f-5b9f-4165-8ccc-3d893bc04c06 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:08.048289 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ca15a-7b24-4a50-a8c8-dc51dfa06862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:08.050353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ca15a-7b24-4a50-a8c8-dc51dfa06862 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:08.051307 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ca15a-7b24-4a50-a8c8-dc51dfa06862 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:08.052350 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ca15a-7b24-4a50-a8c8-dc51dfa06862 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:08.054161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ca15a-7b24-4a50-a8c8-dc51dfa06862 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:08.055408 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ca15a-7b24-4a50-a8c8-dc51dfa06862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:08.058553 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ca15a-7b24-4a50-a8c8-dc51dfa06862 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:08.076929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 96/189] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:34:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:08.078986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ca15a-7b24-4a50-a8c8-dc51dfa06862 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:08.242312 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80280f-5b9f-4165-8ccc-3d893bc04c06 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:08.313055 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab126ed7-60c1-4433-b0f5-4420663b049c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:08.314307 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab126ed7-60c1-4433-b0f5-4420663b049c None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:08.316549 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab126ed7-60c1-4433-b0f5-4420663b049c None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:08.317093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab126ed7-60c1-4433-b0f5-4420663b049c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:08.329086 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ca15a-7b24-4a50-a8c8-dc51dfa06862 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:08.342273 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab126ed7-60c1-4433-b0f5-4420663b049c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:08.353643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-ab126ed7-60c1-4433-b0f5-4420663b049c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:34:08.353643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:08.353643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:08.353643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:08.353643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:08.353643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:08.353643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:08.353643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:08.353643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:08.353643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:08.353643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:08.353643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:08.353643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:08.353643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:08.353643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:08.353643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:08.355793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:08.355793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:08.355793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:08.355793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:08.355793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:08.355793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:08.355793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:08.355793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:08.355793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:08.355793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:08.355793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:08.355793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:08.355793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:08.355793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:08.355793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:08.355793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:08.357371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:08.357371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:08.357371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:08.357371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:08.357371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:08.357371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:08.357371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:08.357371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:08.357371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:08.357371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:08.357371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:34:08.357371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:34:08.357371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 94/190] 10.222.0.94 () {56 vars in 1114 bytes} [Wed Aug 24 04:34:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:08.357371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab126ed7-60c1-4433-b0f5-4420663b049c None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:08.394564 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:08.407658 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5bb897-7c71-47c0-bc4a-33ffeea5603b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:08.408832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bb897-7c71-47c0-bc4a-33ffeea5603b None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:08.409328 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bb897-7c71-47c0-bc4a-33ffeea5603b None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:08.409865 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bb897-7c71-47c0-bc4a-33ffeea5603b None admin] PATH_INFO: `/v3/projects/43dfbfd1802b436791f73a286898fd0a` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:08.412586 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5bb897-7c71-47c0-bc4a-33ffeea5603b None admin] RBAC: Authorizing `identity:get_project(project_id=43dfbfd1802b436791f73a286898fd0a)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:08.415767 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5bb897-7c71-47c0-bc4a-33ffeea5603b None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:08.419092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 97/191] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:08 2022] GET /identity/v3/projects/43dfbfd1802b436791f73a286898fd0a => generated 298 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:08.420637 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5bb897-7c71-47c0-bc4a-33ffeea5603b None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:08.458963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:08.584752 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab126ed7-60c1-4433-b0f5-4420663b049c None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:08.653583 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afe79e-7aa4-4744-a258-953d0abe99a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:08.654684 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afe79e-7aa4-4744-a258-953d0abe99a9 None admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:08.655177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afe79e-7aa4-4744-a258-953d0abe99a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:08.655658 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afe79e-7aa4-4744-a258-953d0abe99a9 None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:08.656927 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32afe79e-7aa4-4744-a258-953d0abe99a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:08.660090 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32afe79e-7aa4-4744-a258-953d0abe99a9 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:08.663681 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5bb897-7c71-47c0-bc4a-33ffeea5603b None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:08.723326 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 95/192] 10.222.0.94 () {60 vars in 1132 bytes} [Wed Aug 24 04:34:08 2022] POST /identity/v3/users => generated 297 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:34:08.723326 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afe79e-7aa4-4744-a258-953d0abe99a9 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:08.775764 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be303d-74d1-4394-a53a-ba6325e9949c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:08.776870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be303d-74d1-4394-a53a-ba6325e9949c None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:08.778376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be303d-74d1-4394-a53a-ba6325e9949c None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:08.778928 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be303d-74d1-4394-a53a-ba6325e9949c None admin] PATH_INFO: `/v3/users/6334776a02744d71b21d6f704adaa404` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:08.818463 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be303d-74d1-4394-a53a-ba6325e9949c None admin] RBAC: Authorizing `identity:get_user(user_id=6334776a02744d71b21d6f704adaa404)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:08.821457 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be303d-74d1-4394-a53a-ba6325e9949c None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:08.824884 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 98/193] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:34:08 2022] GET /identity/v3/users/6334776a02744d71b21d6f704adaa404 => generated 283 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:08.833035 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be303d-74d1-4394-a53a-ba6325e9949c None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:08.913255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:08.991824 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afe79e-7aa4-4744-a258-953d0abe99a9 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:08.996425 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:09.058843 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be303d-74d1-4394-a53a-ba6325e9949c None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:09.077706 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e6ebb-cc9f-4c6f-86ff-1e32c0536455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:09.080002 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e6ebb-cc9f-4c6f-86ff-1e32c0536455 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:09.080976 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e6ebb-cc9f-4c6f-86ff-1e32c0536455 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:09.081738 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e6ebb-cc9f-4c6f-86ff-1e32c0536455 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:09.104883 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e6ebb-cc9f-4c6f-86ff-1e32c0536455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:09.116576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-9c8e6ebb-cc9f-4c6f-86ff-1e32c0536455 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:34:09.116576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:09.116576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:09.116576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:09.116576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:09.116576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:09.116576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:09.116576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:09.116576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:09.116576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:09.116576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:09.116576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:09.116576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:09.116576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:09.116576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:09.116576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:09.117679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:09.117679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:09.117679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:09.117679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:09.117679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:09.117679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:09.117679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:09.117679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:09.117679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:09.117679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:09.117679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:09.117679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:09.117679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:09.117679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:09.117679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:09.117679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:09.119578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:09.119578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:09.119578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:09.119578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:09.119578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:09.119578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:09.119578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:09.119578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:09.119578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:09.119578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:09.119578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:34:09.119578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:34:09.119578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 96/194] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:34:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:09.120727 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e6ebb-cc9f-4c6f-86ff-1e32c0536455 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:09.165890 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142362a-c595-42d5-9709-c2e133401550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:09.166967 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142362a-c595-42d5-9709-c2e133401550 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:09.167492 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142362a-c595-42d5-9709-c2e133401550 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:09.168006 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142362a-c595-42d5-9709-c2e133401550 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:09.169505 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142362a-c595-42d5-9709-c2e133401550 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:09.171570 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142362a-c595-42d5-9709-c2e133401550 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:09.176011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142362a-c595-42d5-9709-c2e133401550 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:09.192671 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 99/195] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:34:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:09.195493 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142362a-c595-42d5-9709-c2e133401550 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:09.420812 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e6ebb-cc9f-4c6f-86ff-1e32c0536455 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:09.480558 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142362a-c595-42d5-9709-c2e133401550 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:09.493229 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:09.501311 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0400b-bdac-4fb3-9c79-8b26d7fa1a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:09.502070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0400b-bdac-4fb3-9c79-8b26d7fa1a58 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:09.502783 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0400b-bdac-4fb3-9c79-8b26d7fa1a58 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:09.503356 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0400b-bdac-4fb3-9c79-8b26d7fa1a58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:09.504550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0400b-bdac-4fb3-9c79-8b26d7fa1a58 None admin] RBAC: Adding query filter params (role.id=f08394a5dbcf4506a17b78b4416f1680, scope.project.id=43dfbfd1802b436791f73a286898fd0a, user.id=37fda8d07e354fa9ab9472785c33f6e4) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:09.504930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0400b-bdac-4fb3-9c79-8b26d7fa1a58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:09.506618 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0400b-bdac-4fb3-9c79-8b26d7fa1a58 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:09.518199 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 97/196] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:34:09 2022] GET /identity/v3/role_assignments?user.id=37fda8d07e354fa9ab9472785c33f6e4&scope.project.id=43dfbfd1802b436791f73a286898fd0a&role.id=f08394a5dbcf4506a17b78b4416f1680 => generated 608 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:09.527542 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0400b-bdac-4fb3-9c79-8b26d7fa1a58 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:09.567510 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fd941-5c86-42ab-836c-511c5182bdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:09.569039 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fd941-5c86-42ab-836c-511c5182bdd9 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:09.569895 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fd941-5c86-42ab-836c-511c5182bdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:09.570744 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fd941-5c86-42ab-836c-511c5182bdd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:09.577902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:09.767475 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0400b-bdac-4fb3-9c79-8b26d7fa1a58 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:09.839287 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fd941-5c86-42ab-836c-511c5182bdd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:09.842218 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fd941-5c86-42ab-836c-511c5182bdd9 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:09.874305 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dca001-9898-4fbf-853e-2f68b1449973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:09.875491 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dca001-9898-4fbf-853e-2f68b1449973 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:09.875973 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dca001-9898-4fbf-853e-2f68b1449973 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:09.876448 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dca001-9898-4fbf-853e-2f68b1449973 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:09.877741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dca001-9898-4fbf-853e-2f68b1449973 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:09.878785 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dca001-9898-4fbf-853e-2f68b1449973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:09.881443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dca001-9898-4fbf-853e-2f68b1449973 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:09.904137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 98/197] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:34:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:09.905817 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dca001-9898-4fbf-853e-2f68b1449973 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:10.032959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:10.053896 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 100/198] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:34:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 860 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:10.055239 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fd941-5c86-42ab-836c-511c5182bdd9 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:10.131467 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:10.136146 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dca001-9898-4fbf-853e-2f68b1449973 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:10.226498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700e478-1470-439d-9641-7406dd71edbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:10.227955 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700e478-1470-439d-9641-7406dd71edbb None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:10.228613 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700e478-1470-439d-9641-7406dd71edbb None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:10.229099 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700e478-1470-439d-9641-7406dd71edbb None admin] PATH_INFO: `/v3/users/6334776a02744d71b21d6f704adaa404` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:10.231837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700e478-1470-439d-9641-7406dd71edbb None admin] RBAC: Authorizing `identity:get_user(user_id=6334776a02744d71b21d6f704adaa404)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:10.235154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700e478-1470-439d-9641-7406dd71edbb None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:10.245217 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 99/199] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:34:09 2022] GET /identity/v3/users/6334776a02744d71b21d6f704adaa404 => generated 283 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:10.248706 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700e478-1470-439d-9641-7406dd71edbb None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:10.318638 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fd941-5c86-42ab-836c-511c5182bdd9 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:10.397097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0edf01-6ef8-4dab-869a-f966f95ba483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:10.398752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0edf01-6ef8-4dab-869a-f966f95ba483 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:10.399550 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0edf01-6ef8-4dab-869a-f966f95ba483 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:10.400323 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0edf01-6ef8-4dab-869a-f966f95ba483 None admin] PATH_INFO: `/v3/users/34c6b867af5c4bb492a60653f7aa934d` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:10.403058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0edf01-6ef8-4dab-869a-f966f95ba483 None admin] RBAC: Authorizing `identity:get_user(user_id=34c6b867af5c4bb492a60653f7aa934d)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:10.406286 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0edf01-6ef8-4dab-869a-f966f95ba483 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:10.411034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 101/200] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:34:10 2022] GET /identity/v3/users/34c6b867af5c4bb492a60653f7aa934d => generated 289 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:10.413443 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0edf01-6ef8-4dab-869a-f966f95ba483 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:10.499637 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700e478-1470-439d-9641-7406dd71edbb None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:10.550889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:10.574819 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542f5d9-5439-4139-9b1d-81317a41ed59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:10.576045 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542f5d9-5439-4139-9b1d-81317a41ed59 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:10.576677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542f5d9-5439-4139-9b1d-81317a41ed59 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:10.577285 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542f5d9-5439-4139-9b1d-81317a41ed59 None admin] PATH_INFO: `/v3/projects/82ce9b40374d42e880f6e6d06d93787e` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:10.579662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542f5d9-5439-4139-9b1d-81317a41ed59 None admin] RBAC: Authorizing `identity:get_project(project_id=82ce9b40374d42e880f6e6d06d93787e)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:10.584125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542f5d9-5439-4139-9b1d-81317a41ed59 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:10.587828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 100/201] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:10 2022] GET /identity/v3/projects/82ce9b40374d42e880f6e6d06d93787e => generated 302 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:10.589763 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542f5d9-5439-4139-9b1d-81317a41ed59 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:10.626123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0edf01-6ef8-4dab-869a-f966f95ba483 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:10.630740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:10.680609 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4647132-ec0a-4866-9f6c-cab1f29a54e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:10.685939 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4647132-ec0a-4866-9f6c-cab1f29a54e4 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:10.686759 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4647132-ec0a-4866-9f6c-cab1f29a54e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:10.687310 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4647132-ec0a-4866-9f6c-cab1f29a54e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:10.801132 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542f5d9-5439-4139-9b1d-81317a41ed59 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:10.828604 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4647132-ec0a-4866-9f6c-cab1f29a54e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:10.831906 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4647132-ec0a-4866-9f6c-cab1f29a54e4 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:10.859870 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d96b2-16e4-4bf4-8a04-e50da838c334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:10.861073 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d96b2-16e4-4bf4-8a04-e50da838c334 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:10.863138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d96b2-16e4-4bf4-8a04-e50da838c334 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:10.863768 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d96b2-16e4-4bf4-8a04-e50da838c334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:10.985603 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:11.009862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d96b2-16e4-4bf4-8a04-e50da838c334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:11.012492 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d96b2-16e4-4bf4-8a04-e50da838c334 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:11.051120 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 102/202] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:34:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:11.053149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4647132-ec0a-4866-9f6c-cab1f29a54e4 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:11.059922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:11.214710 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 101/203] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:34:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:11.216293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d96b2-16e4-4bf4-8a04-e50da838c334 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:11.267655 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4647132-ec0a-4866-9f6c-cab1f29a54e4 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:11.339789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3ef48-6345-492d-be9b-38d4754ff617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:11.341347 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3ef48-6345-492d-be9b-38d4754ff617 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:11.342166 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3ef48-6345-492d-be9b-38d4754ff617 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:11.343021 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3ef48-6345-492d-be9b-38d4754ff617 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:11.344829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3ef48-6345-492d-be9b-38d4754ff617 None admin] RBAC: Adding query filter params (role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2, scope.project.id=82ce9b40374d42e880f6e6d06d93787e, user.id=6334776a02744d71b21d6f704adaa404) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:11.346275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3ef48-6345-492d-be9b-38d4754ff617 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:11.349798 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3ef48-6345-492d-be9b-38d4754ff617 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:11.363368 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 103/204] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:34:11 2022] GET /identity/v3/role_assignments?user.id=6334776a02744d71b21d6f704adaa404&scope.project.id=82ce9b40374d42e880f6e6d06d93787e&role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 259 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:11.365434 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3ef48-6345-492d-be9b-38d4754ff617 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:11.406613 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:11.426294 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d96b2-16e4-4bf4-8a04-e50da838c334 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:11.505606 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08b35e-d2f5-4f97-97db-1583e143a889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:11.506942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08b35e-d2f5-4f97-97db-1583e143a889 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:11.507449 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08b35e-d2f5-4f97-97db-1583e143a889 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:11.507938 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08b35e-d2f5-4f97-97db-1583e143a889 None admin] PATH_INFO: `/v3/projects/82ce9b40374d42e880f6e6d06d93787e` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:11.510954 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08b35e-d2f5-4f97-97db-1583e143a889 None admin] RBAC: Authorizing `identity:get_project(project_id=82ce9b40374d42e880f6e6d06d93787e)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:11.513633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08b35e-d2f5-4f97-97db-1583e143a889 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:11.517050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 102/205] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:11 2022] GET /identity/v3/projects/82ce9b40374d42e880f6e6d06d93787e => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:11.527453 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:11.531472 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08b35e-d2f5-4f97-97db-1583e143a889 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:11.598554 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3ef48-6345-492d-be9b-38d4754ff617 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:11.706896 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05172ae-9fbc-41fb-9ab2-ae192573e474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:11.708009 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05172ae-9fbc-41fb-9ab2-ae192573e474 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:11.708554 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05172ae-9fbc-41fb-9ab2-ae192573e474 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:11.709000 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05172ae-9fbc-41fb-9ab2-ae192573e474 None admin] PATH_INFO: `/v3/projects/43dfbfd1802b436791f73a286898fd0a` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:11.711345 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05172ae-9fbc-41fb-9ab2-ae192573e474 None admin] RBAC: Authorizing `identity:get_project(project_id=43dfbfd1802b436791f73a286898fd0a)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:11.715705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05172ae-9fbc-41fb-9ab2-ae192573e474 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:11.724529 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 104/206] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:11 2022] GET /identity/v3/projects/43dfbfd1802b436791f73a286898fd0a => generated 298 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:11.734820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05172ae-9fbc-41fb-9ab2-ae192573e474 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:11.760683 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08b35e-d2f5-4f97-97db-1583e143a889 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:11.828084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042d7e9-bb5f-4d1b-a22f-01c58decf4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:11.829005 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042d7e9-bb5f-4d1b-a22f-01c58decf4dd None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:11.829542 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042d7e9-bb5f-4d1b-a22f-01c58decf4dd None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:11.830361 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042d7e9-bb5f-4d1b-a22f-01c58decf4dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:11.832004 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042d7e9-bb5f-4d1b-a22f-01c58decf4dd None admin] RBAC: Adding query filter params (role.id=f08394a5dbcf4506a17b78b4416f1680, scope.project.id=82ce9b40374d42e880f6e6d06d93787e, user.id=6334776a02744d71b21d6f704adaa404) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:11.832565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042d7e9-bb5f-4d1b-a22f-01c58decf4dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:11.836000 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042d7e9-bb5f-4d1b-a22f-01c58decf4dd None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:11.847762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 103/207] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:34:11 2022] GET /identity/v3/role_assignments?user.id=6334776a02744d71b21d6f704adaa404&scope.project.id=82ce9b40374d42e880f6e6d06d93787e&role.id=f08394a5dbcf4506a17b78b4416f1680 => generated 259 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:34:12.034897 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05172ae-9fbc-41fb-9ab2-ae192573e474 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:12.107147 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd6852-69a0-4676-8ad1-2efb08c1ae04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:12.108193 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd6852-69a0-4676-8ad1-2efb08c1ae04 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:12.108687 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd6852-69a0-4676-8ad1-2efb08c1ae04 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:12.109173 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd6852-69a0-4676-8ad1-2efb08c1ae04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:12.110676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd6852-69a0-4676-8ad1-2efb08c1ae04 None admin] RBAC: Adding query filter params (role.id=28bafe05b4a44e89a89bdd6806d44ac5, scope.project.id=43dfbfd1802b436791f73a286898fd0a, user.id=34c6b867af5c4bb492a60653f7aa934d) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:12.112218 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd6852-69a0-4676-8ad1-2efb08c1ae04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:12.115377 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd6852-69a0-4676-8ad1-2efb08c1ae04 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:12.121280 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:12.135854 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 105/208] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:34:11 2022] GET /identity/v3/role_assignments?user.id=34c6b867af5c4bb492a60653f7aa934d&scope.project.id=43dfbfd1802b436791f73a286898fd0a&role.id=28bafe05b4a44e89a89bdd6806d44ac5 => generated 608 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:12.869211 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20ba09-1e42-4a47-a08f-f8ec069dcc5c None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:12.870070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20ba09-1e42-4a47-a08f-f8ec069dcc5c None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:12.870441 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20ba09-1e42-4a47-a08f-f8ec069dcc5c None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:12.873279 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 104/209] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:12.883313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9c730-5a2b-4a6f-8594-765bcd6d662a None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:12.884038 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9c730-5a2b-4a6f-8594-765bcd6d662a None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:12.884367 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9c730-5a2b-4a6f-8594-765bcd6d662a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:12.928630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-bde9c730-5a2b-4a6f-8594-765bcd6d662a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:12.930876 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-bde9c730-5a2b-4a6f-8594-765bcd6d662a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:12.999683 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f66bb-4281-474b-be60-2d0fb1dd61e1 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:13.000312 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f66bb-4281-474b-be60-2d0fb1dd61e1 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:13.000817 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f66bb-4281-474b-be60-2d0fb1dd61e1 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:13.007727 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 105/210] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:13.013513 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe0130-a4bd-4629-b79c-f38ad212ff22 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:13.013921 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe0130-a4bd-4629-b79c-f38ad212ff22 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:13.014186 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe0130-a4bd-4629-b79c-f38ad212ff22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:13.048140 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-24fe0130-a4bd-4629-b79c-f38ad212ff22 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:13.050447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-24fe0130-a4bd-4629-b79c-f38ad212ff22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:13.091061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:13.109156 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 106/211] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:13.200106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 106/212] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:34:13.508906 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9c730-5a2b-4a6f-8594-765bcd6d662a None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:13.727138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe0130-a4bd-4629-b79c-f38ad212ff22 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:13.728499 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9c730-5a2b-4a6f-8594-765bcd6d662a None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:13.794877 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:13.806982 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b66bde-237d-4990-822f-6a854d8e21fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:13.808104 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b66bde-237d-4990-822f-6a854d8e21fb None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:13.808579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b66bde-237d-4990-822f-6a854d8e21fb None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:13.809051 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b66bde-237d-4990-822f-6a854d8e21fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:13.832887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b66bde-237d-4990-822f-6a854d8e21fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:13.843128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-98b66bde-237d-4990-822f-6a854d8e21fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:34:13.843128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:13.843128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:13.843128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:13.843128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:13.843128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:13.843128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:13.843128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:13.843128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:13.843128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:13.843128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:13.843128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:13.843128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:13.843128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:13.843128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:13.843128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:13.844871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:13.844871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:13.844871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:13.844871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:13.844871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:13.844871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:13.844871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:13.844871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:13.844871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:13.844871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:13.844871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:13.844871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:13.844871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:13.844871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:13.844871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:13.844871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:13.847739 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:13.847739 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:13.847739 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:13.847739 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:13.847739 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:13.847739 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:13.847739 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:13.847739 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:13.847739 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:13.847739 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:13.847739 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:34:13.847739 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:34:13.847739 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 107/213] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:34:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:13.856380 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b66bde-237d-4990-822f-6a854d8e21fb None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:13.955878 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe0130-a4bd-4629-b79c-f38ad212ff22 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:14.031902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c66766-04bd-4450-8e5b-ebf658cee81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:14.032938 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c66766-04bd-4450-8e5b-ebf658cee81d None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:14.034002 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c66766-04bd-4450-8e5b-ebf658cee81d None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:14.034472 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c66766-04bd-4450-8e5b-ebf658cee81d None admin] PATH_INFO: `/v3/domains/default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:14.036870 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c66766-04bd-4450-8e5b-ebf658cee81d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:14.040088 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c66766-04bd-4450-8e5b-ebf658cee81d None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:14.050124 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 107/214] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:34:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:14.053798 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c66766-04bd-4450-8e5b-ebf658cee81d None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:14.077456 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b66bde-237d-4990-822f-6a854d8e21fb None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:14.108162 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:14.158303 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbc947-d329-4275-900d-2c227d5a1f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:14.159869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbc947-d329-4275-900d-2c227d5a1f14 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:14.160597 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbc947-d329-4275-900d-2c227d5a1f14 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:14.161315 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbc947-d329-4275-900d-2c227d5a1f14 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:14.163239 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbc947-d329-4275-900d-2c227d5a1f14 None admin] RBAC: Adding query filter params (name=member) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:14.164194 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbc947-d329-4275-900d-2c227d5a1f14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:14.167190 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbc947-d329-4275-900d-2c227d5a1f14 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:14.193828 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 108/215] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:34:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:14.196507 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbc947-d329-4275-900d-2c227d5a1f14 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:14.280433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c66766-04bd-4450-8e5b-ebf658cee81d None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:14.316606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:14.370245 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc0460-3e49-47b8-bac4-19540e85d189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:14.372649 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc0460-3e49-47b8-bac4-19540e85d189 None admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:14.373438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc0460-3e49-47b8-bac4-19540e85d189 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:14.374114 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc0460-3e49-47b8-bac4-19540e85d189 None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:14.376429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc0460-3e49-47b8-bac4-19540e85d189 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:14.381678 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc0460-3e49-47b8-bac4-19540e85d189 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:14.433006 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbc947-d329-4275-900d-2c227d5a1f14 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:14.446090 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 108/216] 10.222.0.94 () {60 vars in 1132 bytes} [Wed Aug 24 04:34:14 2022] POST /identity/v3/users => generated 297 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:34:14.509781 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c3796-3940-4df5-a4be-931bff14c1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:14.511321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c3796-3940-4df5-a4be-931bff14c1fc None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:14.512113 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c3796-3940-4df5-a4be-931bff14c1fc None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:14.512795 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c3796-3940-4df5-a4be-931bff14c1fc None admin] PATH_INFO: `/v3/users/2e908230e6a24669a0537c362c48b00f` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:14.543989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c3796-3940-4df5-a4be-931bff14c1fc None admin] RBAC: Authorizing `identity:get_user(user_id=2e908230e6a24669a0537c362c48b00f)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:14.547350 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c3796-3940-4df5-a4be-931bff14c1fc None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:14.552136 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 109/217] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:34:14 2022] GET /identity/v3/users/2e908230e6a24669a0537c362c48b00f => generated 297 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:14.561883 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc0460-3e49-47b8-bac4-19540e85d189 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:14.747759 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:14.801125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc0460-3e49-47b8-bac4-19540e85d189 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:14.885310 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5adec5-8f4c-4109-8ead-543d36c78e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:14.886467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5adec5-8f4c-4109-8ead-543d36c78e34 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:14.886940 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5adec5-8f4c-4109-8ead-543d36c78e34 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:14.887490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5adec5-8f4c-4109-8ead-543d36c78e34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:15.055330 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5adec5-8f4c-4109-8ead-543d36c78e34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:15.056995 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5adec5-8f4c-4109-8ead-543d36c78e34 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:15.250009 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:15.318312 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 109/218] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:34:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 757 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:15.327778 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c3796-3940-4df5-a4be-931bff14c1fc None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:15.382701 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8b9ad-48ac-4312-b652-0a52252d1d4b None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:15.383658 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8b9ad-48ac-4312-b652-0a52252d1d4b None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:15.384355 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8b9ad-48ac-4312-b652-0a52252d1d4b None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:15.388036 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 110/219] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:15.397648 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c5675-b20e-4607-85d4-5158a09817fd None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:15.398509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c5675-b20e-4607-85d4-5158a09817fd None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:15.399209 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c5675-b20e-4607-85d4-5158a09817fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:15.437871 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-678c5675-b20e-4607-85d4-5158a09817fd None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:15.442464 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-678c5675-b20e-4607-85d4-5158a09817fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:15.610173 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 111/220] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:34:15.612474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c3796-3940-4df5-a4be-931bff14c1fc None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:15.614520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60190ed5-4c5f-4002-8568-8859ec5292e0 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:15.615568 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60190ed5-4c5f-4002-8568-8859ec5292e0 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:15.616275 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60190ed5-4c5f-4002-8568-8859ec5292e0 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:15.619650 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 112/221] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:15.631058 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80265c1d-c8c8-47af-a33b-724dabaf19af None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:15.631876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80265c1d-c8c8-47af-a33b-724dabaf19af None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:15.632567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80265c1d-c8c8-47af-a33b-724dabaf19af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:15.643365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:15.696119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c027422-6566-4a85-8e79-2a989c9d457c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:15.697214 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c027422-6566-4a85-8e79-2a989c9d457c None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:15.697739 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c027422-6566-4a85-8e79-2a989c9d457c None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:15.698230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c027422-6566-4a85-8e79-2a989c9d457c None admin] PATH_INFO: `/v3/projects/82ce9b40374d42e880f6e6d06d93787e` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:15.699277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-80265c1d-c8c8-47af-a33b-724dabaf19af None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:15.700436 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c027422-6566-4a85-8e79-2a989c9d457c None admin] RBAC: Authorizing `identity:get_project(project_id=82ce9b40374d42e880f6e6d06d93787e)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:15.701394 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-80265c1d-c8c8-47af-a33b-724dabaf19af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:15.703265 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c027422-6566-4a85-8e79-2a989c9d457c None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:15.708123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 110/222] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:15 2022] GET /identity/v3/projects/82ce9b40374d42e880f6e6d06d93787e => generated 302 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:15.726424 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c027422-6566-4a85-8e79-2a989c9d457c None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:15.917650 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 113/223] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:16.087460 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c027422-6566-4a85-8e79-2a989c9d457c None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:16.180099 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80265c1d-c8c8-47af-a33b-724dabaf19af None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:16.202791 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c557f55-5d2c-47bb-9b2c-71c0cd29cc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:16.203862 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c557f55-5d2c-47bb-9b2c-71c0cd29cc0a None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:16.204363 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c557f55-5d2c-47bb-9b2c-71c0cd29cc0a None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:16.205328 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c557f55-5d2c-47bb-9b2c-71c0cd29cc0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:16.207289 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c557f55-5d2c-47bb-9b2c-71c0cd29cc0a None admin] RBAC: Adding query filter params (role.id=1a586b803a1e429f82b85f386d7564fb, scope.project.id=82ce9b40374d42e880f6e6d06d93787e, user.id=2e908230e6a24669a0537c362c48b00f) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:16.207840 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c557f55-5d2c-47bb-9b2c-71c0cd29cc0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:16.210823 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c557f55-5d2c-47bb-9b2c-71c0cd29cc0a None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:16.223979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 111/224] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:34:15 2022] GET /identity/v3/role_assignments?user.id=2e908230e6a24669a0537c362c48b00f&scope.project.id=82ce9b40374d42e880f6e6d06d93787e&role.id=1a586b803a1e429f82b85f386d7564fb => generated 259 bytes in 499 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:16.328196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:16.496419 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80265c1d-c8c8-47af-a33b-724dabaf19af None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:16.554843 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c557f55-5d2c-47bb-9b2c-71c0cd29cc0a None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:16.584832 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb1e36-8e40-4a4b-b0f6-31e2aba045ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:16.586053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb1e36-8e40-4a4b-b0f6-31e2aba045ad None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:16.586547 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb1e36-8e40-4a4b-b0f6-31e2aba045ad None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:16.587193 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb1e36-8e40-4a4b-b0f6-31e2aba045ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:16.610709 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb1e36-8e40-4a4b-b0f6-31e2aba045ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:16.621235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-25fb1e36-8e40-4a4b-b0f6-31e2aba045ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:34:16.621235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:16.621235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:16.621235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:16.621235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:16.621235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:16.621235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:16.621235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:16.621235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:16.621235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:16.621235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:16.621235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:16.621235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:16.621235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:16.621235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:16.621235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:16.623093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:16.623093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:16.623093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:16.623093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:16.623093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:16.623093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:16.623093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:16.623093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:16.623093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:16.623093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:16.623093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:16.623093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:16.623093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:16.623093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:16.623093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:16.623093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:16.625370 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:16.625370 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:16.625370 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:16.625370 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:16.625370 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:16.625370 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:16.625370 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:16.625370 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:16.625370 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:16.625370 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:16.625370 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:34:16.625370 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:34:16.625370 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 114/225] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:34:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 445 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:16.638339 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb1e36-8e40-4a4b-b0f6-31e2aba045ad None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:16.659611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:16.791576 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c557f55-5d2c-47bb-9b2c-71c0cd29cc0a None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:16.855547 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4df836-5bc4-44f9-9bfa-eb43000cf652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:16.856652 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4df836-5bc4-44f9-9bfa-eb43000cf652 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:16.857169 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4df836-5bc4-44f9-9bfa-eb43000cf652 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:16.857697 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4df836-5bc4-44f9-9bfa-eb43000cf652 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:16.906817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4df836-5bc4-44f9-9bfa-eb43000cf652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:16.928486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-fb4df836-5bc4-44f9-9bfa-eb43000cf652 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:34:16.928486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:16.928486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:16.928486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:16.928486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:16.928486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:16.928486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:16.928486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:16.928486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:16.928486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:16.928486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:16.928486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:16.928486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:16.928486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:16.928486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:16.928486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:16.930230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:16.930230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:16.930230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:16.930230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:16.930230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:16.930230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:16.930230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:16.930230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:16.930230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:16.930230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:16.930230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:16.930230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:16.930230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:16.930230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:16.930230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:16.930230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:16.931743 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:16.931743 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:16.931743 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:16.931743 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:16.931743 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:16.931743 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:16.931743 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:16.931743 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:16.931743 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:16.931743 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:16.931743 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:34:16.931743 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:34:16.931743 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 112/226] 10.222.0.94 () {56 vars in 1114 bytes} [Wed Aug 24 04:34:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:16.945544 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4df836-5bc4-44f9-9bfa-eb43000cf652 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:17.024236 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb1e36-8e40-4a4b-b0f6-31e2aba045ad None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:17.031994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:17.102307 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745a83f-0468-4f94-a85e-e55c74ccf2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:17.104330 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745a83f-0468-4f94-a85e-e55c74ccf2cb None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:17.105210 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745a83f-0468-4f94-a85e-e55c74ccf2cb None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:17.106015 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745a83f-0468-4f94-a85e-e55c74ccf2cb None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:17.107578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745a83f-0468-4f94-a85e-e55c74ccf2cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:17.108402 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745a83f-0468-4f94-a85e-e55c74ccf2cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:17.112248 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745a83f-0468-4f94-a85e-e55c74ccf2cb None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:17.131447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 115/227] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:34:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 495 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:34:17.144431 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745a83f-0468-4f94-a85e-e55c74ccf2cb None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:17.349657 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4df836-5bc4-44f9-9bfa-eb43000cf652 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:17.352122 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:17.379959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745a83f-0468-4f94-a85e-e55c74ccf2cb None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:17.466191 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca7699-85a4-44e7-af57-44acf6a33005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:17.468337 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca7699-85a4-44e7-af57-44acf6a33005 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:17.469199 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca7699-85a4-44e7-af57-44acf6a33005 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:17.469990 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca7699-85a4-44e7-af57-44acf6a33005 None admin] PATH_INFO: `/v3/users/6334776a02744d71b21d6f704adaa404` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:17.474334 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca7699-85a4-44e7-af57-44acf6a33005 None admin] RBAC: Authorizing `identity:get_user(user_id=6334776a02744d71b21d6f704adaa404)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:17.478079 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca7699-85a4-44e7-af57-44acf6a33005 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:17.482086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 116/228] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:34:17 2022] GET /identity/v3/users/6334776a02744d71b21d6f704adaa404 => generated 283 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:17.495472 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca7699-85a4-44e7-af57-44acf6a33005 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:17.500487 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8dd6f-75c1-4dbc-bf46-29ef02a82108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:17.501223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8dd6f-75c1-4dbc-bf46-29ef02a82108 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:17.502333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8dd6f-75c1-4dbc-bf46-29ef02a82108 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:17.503470 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8dd6f-75c1-4dbc-bf46-29ef02a82108 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:17.504876 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8dd6f-75c1-4dbc-bf46-29ef02a82108 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:17.505424 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8dd6f-75c1-4dbc-bf46-29ef02a82108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:17.507647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8dd6f-75c1-4dbc-bf46-29ef02a82108 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:17.524960 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 113/229] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:34:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 580 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:17.535935 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8dd6f-75c1-4dbc-bf46-29ef02a82108 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:17.602042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:17.864405 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8dd6f-75c1-4dbc-bf46-29ef02a82108 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:17.899264 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca7699-85a4-44e7-af57-44acf6a33005 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:17.999957 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c4ca1-2cfc-47e3-b191-dc9ce74ff833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:18.003093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c4ca1-2cfc-47e3-b191-dc9ce74ff833 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:18.004125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c4ca1-2cfc-47e3-b191-dc9ce74ff833 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:18.004953 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c4ca1-2cfc-47e3-b191-dc9ce74ff833 None admin] PATH_INFO: `/v3/projects/82ce9b40374d42e880f6e6d06d93787e` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:18.007819 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c4ca1-2cfc-47e3-b191-dc9ce74ff833 None admin] RBAC: Authorizing `identity:get_project(project_id=82ce9b40374d42e880f6e6d06d93787e)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:18.011567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c4ca1-2cfc-47e3-b191-dc9ce74ff833 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:18.015474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 117/230] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:17 2022] GET /identity/v3/projects/82ce9b40374d42e880f6e6d06d93787e => generated 302 bytes in 521 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:34:18.022342 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a371e1-6548-4e4b-b31c-77401dbaf037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:18.023434 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a371e1-6548-4e4b-b31c-77401dbaf037 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:18.023888 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a371e1-6548-4e4b-b31c-77401dbaf037 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:18.024362 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a371e1-6548-4e4b-b31c-77401dbaf037 None admin] PATH_INFO: `/v3/users/6334776a02744d71b21d6f704adaa404` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:18.027124 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a371e1-6548-4e4b-b31c-77401dbaf037 None admin] RBAC: Authorizing `identity:get_user(user_id=6334776a02744d71b21d6f704adaa404)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:18.029367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c4ca1-2cfc-47e3-b191-dc9ce74ff833 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:18.030256 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a371e1-6548-4e4b-b31c-77401dbaf037 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:18.034353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 114/231] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:34:17 2022] GET /identity/v3/users/6334776a02744d71b21d6f704adaa404 => generated 283 bytes in 501 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:34:18.044357 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a371e1-6548-4e4b-b31c-77401dbaf037 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:18.204832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:18.350011 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:18.370302 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c4ca1-2cfc-47e3-b191-dc9ce74ff833 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:18.435267 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a371e1-6548-4e4b-b31c-77401dbaf037 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:18.524477 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef6660-5ee0-44f0-8745-d6079159a8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:18.527813 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef6660-5ee0-44f0-8745-d6079159a8d6 None admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:18.529439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef6660-5ee0-44f0-8745-d6079159a8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:18.531272 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef6660-5ee0-44f0-8745-d6079159a8d6 None admin] PATH_INFO: `/v3/projects/82ce9b40374d42e880f6e6d06d93787e/users/6334776a02744d71b21d6f704adaa404/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:18.532774 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14398b-3894-48a1-8230-4b54356d462e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:18.536702 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14398b-3894-48a1-8230-4b54356d462e None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:18.537957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14398b-3894-48a1-8230-4b54356d462e None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:18.539942 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14398b-3894-48a1-8230-4b54356d462e None admin] PATH_INFO: `/v3/projects/82ce9b40374d42e880f6e6d06d93787e` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:18.541719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef6660-5ee0-44f0-8745-d6079159a8d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=82ce9b40374d42e880f6e6d06d93787e, user_id=6334776a02744d71b21d6f704adaa404, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:18.545841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14398b-3894-48a1-8230-4b54356d462e None admin] RBAC: Authorizing `identity:get_project(project_id=82ce9b40374d42e880f6e6d06d93787e)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:18.548183 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef6660-5ee0-44f0-8745-d6079159a8d6 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:18.552935 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14398b-3894-48a1-8230-4b54356d462e None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:18.562929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 115/232] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:18 2022] GET /identity/v3/projects/82ce9b40374d42e880f6e6d06d93787e => generated 302 bytes in 520 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:34:18.571547 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14398b-3894-48a1-8230-4b54356d462e None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:18.603630 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 118/233] 10.222.0.94 () {58 vars in 1439 bytes} [Wed Aug 24 04:34:18 2022] PUT /identity/v3/projects/82ce9b40374d42e880f6e6d06d93787e/users/6334776a02744d71b21d6f704adaa404/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:34:18.853357 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:18.861069 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14398b-3894-48a1-8230-4b54356d462e None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:18.952779 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a82db1-8d5b-4509-90ac-015b97f2f11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:18.954119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a82db1-8d5b-4509-90ac-015b97f2f11a None admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:18.954613 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a82db1-8d5b-4509-90ac-015b97f2f11a None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:18.955646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a82db1-8d5b-4509-90ac-015b97f2f11a None admin] PATH_INFO: `/v3/projects/82ce9b40374d42e880f6e6d06d93787e/users/6334776a02744d71b21d6f704adaa404/roles/f08394a5dbcf4506a17b78b4416f1680` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:18.960123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a82db1-8d5b-4509-90ac-015b97f2f11a None admin] RBAC: Authorizing `identity:create_grant(project_id=82ce9b40374d42e880f6e6d06d93787e, user_id=6334776a02744d71b21d6f704adaa404, role_id=f08394a5dbcf4506a17b78b4416f1680)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:18.963446 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a82db1-8d5b-4509-90ac-015b97f2f11a None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:18.994764 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 116/234] 10.222.0.94 () {58 vars in 1439 bytes} [Wed Aug 24 04:34:18 2022] PUT /identity/v3/projects/82ce9b40374d42e880f6e6d06d93787e/users/6334776a02744d71b21d6f704adaa404/roles/f08394a5dbcf4506a17b78b4416f1680 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:34:19.200641 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef5b92-52f5-4f22-ac23-8271356189a4 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:19.201106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef5b92-52f5-4f22-ac23-8271356189a4 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:19.201652 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef5b92-52f5-4f22-ac23-8271356189a4 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:19.205177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 119/235] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:19.215826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2a269-dda8-470d-ad35-09b10a7cf471 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:19.216823 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2a269-dda8-470d-ad35-09b10a7cf471 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:19.217657 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2a269-dda8-470d-ad35-09b10a7cf471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:19.257329 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-f8d2a269-dda8-470d-ad35-09b10a7cf471 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:19.259213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-f8d2a269-dda8-470d-ad35-09b10a7cf471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:19.266264 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff19301-5c27-4471-b2f4-e462bdbaf833 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:19.266771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff19301-5c27-4471-b2f4-e462bdbaf833 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:19.267393 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff19301-5c27-4471-b2f4-e462bdbaf833 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:19.270215 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 120/236] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:34:19.288940 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bab929-84f6-4e60-bcfe-883cfa786e07 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:19.289524 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bab929-84f6-4e60-bcfe-883cfa786e07 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:19.289971 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bab929-84f6-4e60-bcfe-883cfa786e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:19.323908 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-45bab929-84f6-4e60-bcfe-883cfa786e07 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:19.325648 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-45bab929-84f6-4e60-bcfe-883cfa786e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:19.425908 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 117/237] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:19.523325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 121/238] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:20.139914 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2a269-dda8-470d-ad35-09b10a7cf471 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:20.219649 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bab929-84f6-4e60-bcfe-883cfa786e07 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:20.420790 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:20.446531 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2a269-dda8-470d-ad35-09b10a7cf471 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:20.459852 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:20.503956 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bab929-84f6-4e60-bcfe-883cfa786e07 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:20.521735 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73652c62-baa7-4f1c-9f2f-44e5340c94df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:20.523244 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73652c62-baa7-4f1c-9f2f-44e5340c94df None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:20.524134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73652c62-baa7-4f1c-9f2f-44e5340c94df None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:20.524841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73652c62-baa7-4f1c-9f2f-44e5340c94df None admin] PATH_INFO: `/v3/domains/default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:20.527543 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73652c62-baa7-4f1c-9f2f-44e5340c94df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:20.530853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73652c62-baa7-4f1c-9f2f-44e5340c94df None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:20.535458 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 118/239] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:34:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:20.538413 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3abf1-d6de-4ad5-8b78-7bc1fae5e25b None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:20.539213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3abf1-d6de-4ad5-8b78-7bc1fae5e25b None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:20.540067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3abf1-d6de-4ad5-8b78-7bc1fae5e25b None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:20.542932 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 119/240] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:20.549705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3abf1-d6de-4ad5-8b78-7bc1fae5e25b None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:20.590291 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf4230-63ea-4d99-9d2a-ae64156d5f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:20.591477 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf4230-63ea-4d99-9d2a-ae64156d5f5a None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:20.591988 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf4230-63ea-4d99-9d2a-ae64156d5f5a None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:20.592560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf4230-63ea-4d99-9d2a-ae64156d5f5a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:20.619030 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf4230-63ea-4d99-9d2a-ae64156d5f5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:20.630560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-d8cf4230-63ea-4d99-9d2a-ae64156d5f5a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:34:20.630560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:20.630560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:20.630560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:20.630560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:20.630560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:20.630560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:20.630560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:20.630560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:20.630560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:20.630560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:20.630560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:20.630560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:20.630560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:20.630560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:20.630560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:20.632523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:20.632523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:20.632523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:20.632523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:20.632523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:20.632523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:20.632523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:20.632523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:20.632523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:20.632523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:20.632523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:20.632523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:20.632523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:20.632523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:20.632523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:20.632523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:20.634143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:20.634143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:20.634143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:20.634143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:20.634143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:20.634143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:20.634143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:20.634143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:20.634143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:20.634143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:20.634143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:34:20.634143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:34:20.637532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 122/241] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:34:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:20.640105 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afa3b1-2613-4072-bf72-fd6fb50d6444 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:20.644230 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afa3b1-2613-4072-bf72-fd6fb50d6444 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:20.644818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afa3b1-2613-4072-bf72-fd6fb50d6444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:20.684047 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-38afa3b1-2613-4072-bf72-fd6fb50d6444 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:20.686431 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-38afa3b1-2613-4072-bf72-fd6fb50d6444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:20.797813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3abf1-d6de-4ad5-8b78-7bc1fae5e25b None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:20.868914 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 123/242] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:20.868914 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38afa3b1-2613-4072-bf72-fd6fb50d6444 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:20.870957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a035e-2ebd-458d-b81e-4dfbc662f5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:20.871887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a035e-2ebd-458d-b81e-4dfbc662f5fe None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:20.872412 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a035e-2ebd-458d-b81e-4dfbc662f5fe None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:20.872933 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a035e-2ebd-458d-b81e-4dfbc662f5fe None admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:20.878259 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a035e-2ebd-458d-b81e-4dfbc662f5fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:20.881113 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a035e-2ebd-458d-b81e-4dfbc662f5fe None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:20.971317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 120/243] 10.222.0.94 () {60 vars in 1132 bytes} [Wed Aug 24 04:34:20 2022] POST /identity/v3/users => generated 293 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:34:21.020731 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:21.073595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38afa3b1-2613-4072-bf72-fd6fb50d6444 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:21.146773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a2705-19f8-4625-8855-fa1f5188726d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:21.147862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a2705-19f8-4625-8855-fa1f5188726d None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:21.148364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a2705-19f8-4625-8855-fa1f5188726d None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:21.148858 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a2705-19f8-4625-8855-fa1f5188726d None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:21.150192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a2705-19f8-4625-8855-fa1f5188726d None admin] RBAC: Adding query filter params (name=reader) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:21.150821 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a2705-19f8-4625-8855-fa1f5188726d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:21.153605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a2705-19f8-4625-8855-fa1f5188726d None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:21.172371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 124/244] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:34:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:21.181901 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a035e-2ebd-458d-b81e-4dfbc662f5fe None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:21.231458 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:21.417857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a035e-2ebd-458d-b81e-4dfbc662f5fe None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:21.471144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a2705-19f8-4625-8855-fa1f5188726d None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:21.489498 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c846d-609a-4fcc-ae37-3b57c68383a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:21.490514 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c846d-609a-4fcc-ae37-3b57c68383a6 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:21.490995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c846d-609a-4fcc-ae37-3b57c68383a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:21.491461 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c846d-609a-4fcc-ae37-3b57c68383a6 None admin] PATH_INFO: `/v3/users/03fe1ce22e9744faad0396e2789a4962` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:21.518318 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c846d-609a-4fcc-ae37-3b57c68383a6 None admin] RBAC: Authorizing `identity:get_user(user_id=03fe1ce22e9744faad0396e2789a4962)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:21.520967 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c846d-609a-4fcc-ae37-3b57c68383a6 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:21.524408 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 121/245] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:34:21 2022] GET /identity/v3/users/03fe1ce22e9744faad0396e2789a4962 => generated 297 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:21.535066 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c846d-609a-4fcc-ae37-3b57c68383a6 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:21.742608 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:21.785316 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a2705-19f8-4625-8855-fa1f5188726d None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:21.833445 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c846d-609a-4fcc-ae37-3b57c68383a6 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:21.872839 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d38d7-4aaf-4302-9f51-bdb826d7f34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:21.875386 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d38d7-4aaf-4302-9f51-bdb826d7f34e None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:21.875386 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d38d7-4aaf-4302-9f51-bdb826d7f34e None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:21.875726 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d38d7-4aaf-4302-9f51-bdb826d7f34e None admin] PATH_INFO: `/v3/roles/member` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:21.903750 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d38d7-4aaf-4302-9f51-bdb826d7f34e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:21.918048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:21.925847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-eb7d38d7-4aaf-4302-9f51-bdb826d7f34e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:34:21.925847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:21.925847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:21.925847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:21.925847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:21.925847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:21.925847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:21.925847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:21.925847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:21.925847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:21.925847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:21.925847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:21.925847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:21.925847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:21.925847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:21.925847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:21.927620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:21.927620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:21.927620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:21.927620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:21.927620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:21.927620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:21.927620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:21.927620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:21.927620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:21.927620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:21.927620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:21.927620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:21.927620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:21.927620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:21.927620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:21.927620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:21.929364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:21.929364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:21.929364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:21.929364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:21.929364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:21.929364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:21.929364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:21.929364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:21.929364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:21.929364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:21.929364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:34:21.929364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:34:21.929364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 125/246] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:34:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 459 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:21.941322 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d38d7-4aaf-4302-9f51-bdb826d7f34e None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:21.942747 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842fe729-7135-4ac8-ace2-45130a1682d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:21.944251 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fe729-7135-4ac8-ace2-45130a1682d5 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:21.944779 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fe729-7135-4ac8-ace2-45130a1682d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:21.945281 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fe729-7135-4ac8-ace2-45130a1682d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:22.129243 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842fe729-7135-4ac8-ace2-45130a1682d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:22.132428 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842fe729-7135-4ac8-ace2-45130a1682d5 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:22.287761 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d38d7-4aaf-4302-9f51-bdb826d7f34e None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:22.296211 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:22.352383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 122/247] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:34:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 818 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 04:34:22.360078 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842fe729-7135-4ac8-ace2-45130a1682d5 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:22.426203 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5077534-355a-4486-85fc-54997a886dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:22.426203 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5077534-355a-4486-85fc-54997a886dc6 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:22.426203 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5077534-355a-4486-85fc-54997a886dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:22.426203 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5077534-355a-4486-85fc-54997a886dc6 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:22.427544 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5077534-355a-4486-85fc-54997a886dc6 None admin] RBAC: Adding query filter params (name=member) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:22.428200 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5077534-355a-4486-85fc-54997a886dc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:22.431277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5077534-355a-4486-85fc-54997a886dc6 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:22.469726 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 126/248] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:34:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 528 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:34:22.477449 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5077534-355a-4486-85fc-54997a886dc6 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:22.558088 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842fe729-7135-4ac8-ace2-45130a1682d5 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:22.619314 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddcec1-e66e-4b95-80bb-6b979e762244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:22.620197 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddcec1-e66e-4b95-80bb-6b979e762244 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:22.620587 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddcec1-e66e-4b95-80bb-6b979e762244 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:22.620944 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddcec1-e66e-4b95-80bb-6b979e762244 None admin] PATH_INFO: `/v3/projects/82ce9b40374d42e880f6e6d06d93787e` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:22.630397 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ddcec1-e66e-4b95-80bb-6b979e762244 None admin] RBAC: Authorizing `identity:get_project(project_id=82ce9b40374d42e880f6e6d06d93787e)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:22.632014 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ddcec1-e66e-4b95-80bb-6b979e762244 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:22.634404 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 123/249] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:22 2022] GET /identity/v3/projects/82ce9b40374d42e880f6e6d06d93787e => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:22.648230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546b564-5261-4417-9d34-5d3bc0349110 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:22.649464 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546b564-5261-4417-9d34-5d3bc0349110 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:22.650242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546b564-5261-4417-9d34-5d3bc0349110 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:22.655802 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 124/250] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:22.665443 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546b564-5261-4417-9d34-5d3bc0349110 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:22.680043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:22.786506 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5077534-355a-4486-85fc-54997a886dc6 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:22.844889 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:22.919690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823966f-3035-4e6c-b347-1b861805db03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:22.934341 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823966f-3035-4e6c-b347-1b861805db03 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:22.934787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823966f-3035-4e6c-b347-1b861805db03 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:22.935249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823966f-3035-4e6c-b347-1b861805db03 None admin] PATH_INFO: `/v3/users/2e908230e6a24669a0537c362c48b00f` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:22.940992 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823966f-3035-4e6c-b347-1b861805db03 None admin] RBAC: Authorizing `identity:get_user(user_id=2e908230e6a24669a0537c362c48b00f)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:22.944050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823966f-3035-4e6c-b347-1b861805db03 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:22.954116 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 127/251] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:34:22 2022] GET /identity/v3/users/2e908230e6a24669a0537c362c48b00f => generated 297 bytes in 478 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:22.956565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2012571-75eb-45ae-a4f5-4fc659184c35 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:22.957568 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2012571-75eb-45ae-a4f5-4fc659184c35 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:22.958063 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2012571-75eb-45ae-a4f5-4fc659184c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:23.019704 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-c2012571-75eb-45ae-a4f5-4fc659184c35 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:23.022159 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-c2012571-75eb-45ae-a4f5-4fc659184c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:23.027653 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546b564-5261-4417-9d34-5d3bc0349110 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:23.134341 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7000f6-fe1f-4b1d-9252-dbdc7185c1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:23.135603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7000f6-fe1f-4b1d-9252-dbdc7185c1bf None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:23.136075 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7000f6-fe1f-4b1d-9252-dbdc7185c1bf None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:23.136525 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7000f6-fe1f-4b1d-9252-dbdc7185c1bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:23.137949 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7000f6-fe1f-4b1d-9252-dbdc7185c1bf None admin] RBAC: Adding query filter params (role.id=28bafe05b4a44e89a89bdd6806d44ac5, scope.project.id=82ce9b40374d42e880f6e6d06d93787e, user.id=03fe1ce22e9744faad0396e2789a4962) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:23.138467 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7000f6-fe1f-4b1d-9252-dbdc7185c1bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:23.141498 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7000f6-fe1f-4b1d-9252-dbdc7185c1bf None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:23.153515 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 125/252] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:34:22 2022] GET /identity/v3/role_assignments?user.id=03fe1ce22e9744faad0396e2789a4962&scope.project.id=82ce9b40374d42e880f6e6d06d93787e&role.id=28bafe05b4a44e89a89bdd6806d44ac5 => generated 259 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:23.155005 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7000f6-fe1f-4b1d-9252-dbdc7185c1bf None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:23.196916 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 128/253] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:23.199153 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6321b1-f33e-4853-8e0e-19f1b4e210c0 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:23.199642 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6321b1-f33e-4853-8e0e-19f1b4e210c0 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:23.200074 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6321b1-f33e-4853-8e0e-19f1b4e210c0 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:23.203159 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 129/254] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:23.212612 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a387392-d395-4d14-a49a-b258e575bb2b None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:23.213053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a387392-d395-4d14-a49a-b258e575bb2b None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:23.213564 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a387392-d395-4d14-a49a-b258e575bb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:23.265894 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-5a387392-d395-4d14-a49a-b258e575bb2b None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:23.269504 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-5a387392-d395-4d14-a49a-b258e575bb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:23.441730 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:23.524267 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 130/255] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:23.560914 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7000f6-fe1f-4b1d-9252-dbdc7185c1bf None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:23.567563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:23.647550 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb1b5b-0e59-47d5-b0d5-644207b7b18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:23.648657 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb1b5b-0e59-47d5-b0d5-644207b7b18b None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:23.649147 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb1b5b-0e59-47d5-b0d5-644207b7b18b None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:23.649674 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb1b5b-0e59-47d5-b0d5-644207b7b18b None admin] PATH_INFO: `/v3/projects/82ce9b40374d42e880f6e6d06d93787e` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:23.654870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb1b5b-0e59-47d5-b0d5-644207b7b18b None admin] RBAC: Authorizing `identity:get_project(project_id=82ce9b40374d42e880f6e6d06d93787e)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:23.657959 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb1b5b-0e59-47d5-b0d5-644207b7b18b None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:23.661569 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 126/256] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:23 2022] GET /identity/v3/projects/82ce9b40374d42e880f6e6d06d93787e => generated 302 bytes in 507 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:23.672541 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a387392-d395-4d14-a49a-b258e575bb2b None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:23.903285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb1b5b-0e59-47d5-b0d5-644207b7b18b None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:24.041069 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a387392-d395-4d14-a49a-b258e575bb2b None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:24.178871 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c6db0-915f-455b-89a8-10f4bae0ea1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:24.180045 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c6db0-915f-455b-89a8-10f4bae0ea1c None admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:24.180547 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c6db0-915f-455b-89a8-10f4bae0ea1c None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:24.181006 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c6db0-915f-455b-89a8-10f4bae0ea1c None admin] PATH_INFO: `/v3/projects/82ce9b40374d42e880f6e6d06d93787e/users/2e908230e6a24669a0537c362c48b00f/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:24.187552 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c6db0-915f-455b-89a8-10f4bae0ea1c None admin] RBAC: Authorizing `identity:create_grant(project_id=82ce9b40374d42e880f6e6d06d93787e, user_id=2e908230e6a24669a0537c362c48b00f, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:24.202721 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c6db0-915f-455b-89a8-10f4bae0ea1c None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:24.261605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 131/257] 10.222.0.94 () {58 vars in 1439 bytes} [Wed Aug 24 04:34:23 2022] PUT /identity/v3/projects/82ce9b40374d42e880f6e6d06d93787e/users/2e908230e6a24669a0537c362c48b00f/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:34:24.295081 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb1b5b-0e59-47d5-b0d5-644207b7b18b None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:24.384393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53efbdc-a226-492a-8405-23857d68f694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:24.385373 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53efbdc-a226-492a-8405-23857d68f694 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:24.385832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53efbdc-a226-492a-8405-23857d68f694 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:24.386226 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53efbdc-a226-492a-8405-23857d68f694 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:24.408699 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53efbdc-a226-492a-8405-23857d68f694 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:24.419561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-f53efbdc-a226-492a-8405-23857d68f694 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:34:24.419561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:24.419561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:24.419561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:24.419561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:24.419561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:24.419561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:24.419561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:24.419561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:24.419561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:24.419561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:24.419561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:24.419561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:24.419561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:24.419561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:24.419561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:24.421324 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:24.421324 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:24.421324 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:24.421324 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:24.421324 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:24.421324 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:24.421324 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:24.421324 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:24.421324 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:24.421324 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:24.421324 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:24.421324 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:24.421324 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:24.421324 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:24.421324 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:24.421324 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:24.422968 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:24.422968 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:24.422968 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:24.422968 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:24.422968 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:24.422968 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:24.422968 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:24.422968 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:24.422968 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:24.422968 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:24.422968 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:34:24.422968 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:34:24.422968 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 127/258] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:34:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 520 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:34:24.436232 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c6db0-915f-455b-89a8-10f4bae0ea1c None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:24.459758 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53efbdc-a226-492a-8405-23857d68f694 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:24.585376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:24.597981 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:24.738565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c6db0-915f-455b-89a8-10f4bae0ea1c None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:24.824159 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624271cc-bc2e-4a50-92fc-beb668c87824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:24.825296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624271cc-bc2e-4a50-92fc-beb668c87824 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:24.825897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624271cc-bc2e-4a50-92fc-beb668c87824 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:24.826398 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624271cc-bc2e-4a50-92fc-beb668c87824 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:24.827690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624271cc-bc2e-4a50-92fc-beb668c87824 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:24.828165 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624271cc-bc2e-4a50-92fc-beb668c87824 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:24.831310 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624271cc-bc2e-4a50-92fc-beb668c87824 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:24.870494 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53efbdc-a226-492a-8405-23857d68f694 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:24.877712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 132/259] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:34:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:24.887577 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624271cc-bc2e-4a50-92fc-beb668c87824 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:25.018752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b34f5-f2bd-40c6-8b21-0ce207260f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:25.019859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b34f5-f2bd-40c6-8b21-0ce207260f8c None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:25.020308 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b34f5-f2bd-40c6-8b21-0ce207260f8c None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:25.020769 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b34f5-f2bd-40c6-8b21-0ce207260f8c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:25.082378 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b34f5-f2bd-40c6-8b21-0ce207260f8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:25.112187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-a09b34f5-f2bd-40c6-8b21-0ce207260f8c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:34:25.112187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:25.112187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:25.112187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:25.112187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:25.112187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:25.112187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:25.112187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:25.112187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:25.112187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:25.112187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:25.112187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:25.112187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:25.112187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:25.112187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:25.112187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:25.114028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:25.114028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:25.114028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:25.114028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:25.114028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:25.114028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:25.114028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:25.114028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:25.114028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:25.114028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:25.114028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:25.114028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:25.114028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:25.114028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:25.114028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:25.114028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:25.115742 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:25.115742 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:25.115742 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:25.115742 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:25.115742 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:25.115742 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:25.115742 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:25.115742 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:25.115742 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:25.115742 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:25.115742 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:34:25.115742 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:34:25.119656 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 128/260] 10.222.0.94 () {56 vars in 1114 bytes} [Wed Aug 24 04:34:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 661 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:25.124873 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b34f5-f2bd-40c6-8b21-0ce207260f8c None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:25.257473 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624271cc-bc2e-4a50-92fc-beb668c87824 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:25.289085 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:25.390913 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99feac24-1be5-4def-9852-d7c559186042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:25.393336 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99feac24-1be5-4def-9852-d7c559186042 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:25.394215 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99feac24-1be5-4def-9852-d7c559186042 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:25.394994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99feac24-1be5-4def-9852-d7c559186042 None admin] PATH_INFO: `/v3/users/6334776a02744d71b21d6f704adaa404` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:25.397629 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99feac24-1be5-4def-9852-d7c559186042 None admin] RBAC: Authorizing `identity:get_user(user_id=6334776a02744d71b21d6f704adaa404)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:25.409447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99feac24-1be5-4def-9852-d7c559186042 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:25.413899 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 133/261] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:34:24 2022] GET /identity/v3/users/6334776a02744d71b21d6f704adaa404 => generated 283 bytes in 528 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:25.430146 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99feac24-1be5-4def-9852-d7c559186042 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:25.502278 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:25.530947 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b34f5-f2bd-40c6-8b21-0ce207260f8c None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:25.626865 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dd002-ea6c-46ae-a2c2-7cd58616ada7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:25.627888 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dd002-ea6c-46ae-a2c2-7cd58616ada7 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:25.628360 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dd002-ea6c-46ae-a2c2-7cd58616ada7 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:25.629154 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dd002-ea6c-46ae-a2c2-7cd58616ada7 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:25.631116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907dd002-ea6c-46ae-a2c2-7cd58616ada7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:25.632123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907dd002-ea6c-46ae-a2c2-7cd58616ada7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:25.636422 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907dd002-ea6c-46ae-a2c2-7cd58616ada7 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:25.659060 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 129/262] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:34:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 535 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:25.668208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dd002-ea6c-46ae-a2c2-7cd58616ada7 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:25.778982 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99feac24-1be5-4def-9852-d7c559186042 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:25.857397 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d8370-020d-4fed-82aa-5b39716abce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:25.858677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d8370-020d-4fed-82aa-5b39716abce7 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:25.859269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d8370-020d-4fed-82aa-5b39716abce7 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:25.860112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d8370-020d-4fed-82aa-5b39716abce7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:25.946936 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dd002-ea6c-46ae-a2c2-7cd58616ada7 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:25.977932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:26.027794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d8370-020d-4fed-82aa-5b39716abce7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:26.030352 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d8370-020d-4fed-82aa-5b39716abce7 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:26.056930 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f826c4-06a4-4f11-9f76-4b94ce7e71ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:26.058300 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f826c4-06a4-4f11-9f76-4b94ce7e71ab None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:26.058561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f826c4-06a4-4f11-9f76-4b94ce7e71ab None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:26.059038 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f826c4-06a4-4f11-9f76-4b94ce7e71ab None admin] PATH_INFO: `/v3/users/6334776a02744d71b21d6f704adaa404` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:26.062751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f826c4-06a4-4f11-9f76-4b94ce7e71ab None admin] RBAC: Authorizing `identity:get_user(user_id=6334776a02744d71b21d6f704adaa404)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:26.066214 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f826c4-06a4-4f11-9f76-4b94ce7e71ab None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:26.076925 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 130/263] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:34:25 2022] GET /identity/v3/users/6334776a02744d71b21d6f704adaa404 => generated 283 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:34:26.079000 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f826c4-06a4-4f11-9f76-4b94ce7e71ab None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:26.166928 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:26.303797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 134/264] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:34:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 875 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 04:34:26.313806 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d8370-020d-4fed-82aa-5b39716abce7 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:26.407950 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f826c4-06a4-4f11-9f76-4b94ce7e71ab None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:26.474292 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:26.520915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d8370-020d-4fed-82aa-5b39716abce7 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:26.551855 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f05b7-1357-49b0-8d86-b87341590dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:26.552407 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f05b7-1357-49b0-8d86-b87341590dd7 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:26.552892 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f05b7-1357-49b0-8d86-b87341590dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:26.553371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f05b7-1357-49b0-8d86-b87341590dd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:26.601160 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2131cbc-ad0d-40f5-94a7-863409eab66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:26.602793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2131cbc-ad0d-40f5-94a7-863409eab66b None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:26.603528 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2131cbc-ad0d-40f5-94a7-863409eab66b None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:26.604222 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2131cbc-ad0d-40f5-94a7-863409eab66b None admin] PATH_INFO: `/v3/projects/82ce9b40374d42e880f6e6d06d93787e` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:26.607075 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2131cbc-ad0d-40f5-94a7-863409eab66b None admin] RBAC: Authorizing `identity:get_project(project_id=82ce9b40374d42e880f6e6d06d93787e)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:26.610194 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2131cbc-ad0d-40f5-94a7-863409eab66b None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:26.615086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 135/265] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:26 2022] GET /identity/v3/projects/82ce9b40374d42e880f6e6d06d93787e => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:34:26.625251 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2131cbc-ad0d-40f5-94a7-863409eab66b None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:26.796258 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f05b7-1357-49b0-8d86-b87341590dd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:26.801620 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f05b7-1357-49b0-8d86-b87341590dd7 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:26.878730 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:26.977508 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2131cbc-ad0d-40f5-94a7-863409eab66b None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:27.033484 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 131/266] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:34:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 956 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:27.036403 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67622cb-a4e9-4eda-b4a6-b3bc92a2d533 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:27.037661 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67622cb-a4e9-4eda-b4a6-b3bc92a2d533 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:27.038463 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67622cb-a4e9-4eda-b4a6-b3bc92a2d533 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:27.041360 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 132/267] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:27.044268 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe74997-667b-42e3-916c-1948c0e0cb93 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:27.045142 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe74997-667b-42e3-916c-1948c0e0cb93 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:27.045971 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe74997-667b-42e3-916c-1948c0e0cb93 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:27.048934 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fed75a-17b3-41ab-93f4-6825a41183ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:27.050576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fed75a-17b3-41ab-93f4-6825a41183ba None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:27.051389 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fed75a-17b3-41ab-93f4-6825a41183ba None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:27.051693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 133/268] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:27.057456 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fed75a-17b3-41ab-93f4-6825a41183ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:27.057456 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fed75a-17b3-41ab-93f4-6825a41183ba None admin] RBAC: Adding query filter params (role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2, scope.project.id=82ce9b40374d42e880f6e6d06d93787e, user.id=6334776a02744d71b21d6f704adaa404) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:27.057456 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fed75a-17b3-41ab-93f4-6825a41183ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:27.057456 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fed75a-17b3-41ab-93f4-6825a41183ba None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:27.061780 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f26a47-c609-4e69-91c3-d19dca7dd39c None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:27.062708 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f26a47-c609-4e69-91c3-d19dca7dd39c None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:27.063546 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f26a47-c609-4e69-91c3-d19dca7dd39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:27.070629 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 136/269] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:34:26 2022] GET /identity/v3/role_assignments?user.id=6334776a02744d71b21d6f704adaa404&scope.project.id=82ce9b40374d42e880f6e6d06d93787e&role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 608 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:27.072353 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fed75a-17b3-41ab-93f4-6825a41183ba None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:27.095611 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:27.123594 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-98f26a47-c609-4e69-91c3-d19dca7dd39c None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:27.126097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-98f26a47-c609-4e69-91c3-d19dca7dd39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:27.281157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fed75a-17b3-41ab-93f4-6825a41183ba None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:27.356733 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fcc5f-f20c-4605-b81b-e96e2884e248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:27.357469 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fcc5f-f20c-4605-b81b-e96e2884e248 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:27.357776 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fcc5f-f20c-4605-b81b-e96e2884e248 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:27.358048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fcc5f-f20c-4605-b81b-e96e2884e248 None admin] PATH_INFO: `/v3/projects/82ce9b40374d42e880f6e6d06d93787e` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:27.359528 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fcc5f-f20c-4605-b81b-e96e2884e248 None admin] RBAC: Authorizing `identity:get_project(project_id=82ce9b40374d42e880f6e6d06d93787e)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:27.362751 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fcc5f-f20c-4605-b81b-e96e2884e248 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:27.367998 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 137/270] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:27 2022] GET /identity/v3/projects/82ce9b40374d42e880f6e6d06d93787e => generated 302 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:27.370483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e938cd-9544-4fff-a753-b953da0bdf0f None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:27.370979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e938cd-9544-4fff-a753-b953da0bdf0f None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:27.371460 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e938cd-9544-4fff-a753-b953da0bdf0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:27.386902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 134/271] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:27.388599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f26a47-c609-4e69-91c3-d19dca7dd39c None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:27.402222 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-c7e938cd-9544-4fff-a753-b953da0bdf0f None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:27.403526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-c7e938cd-9544-4fff-a753-b953da0bdf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:27.499158 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:27.538246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 138/272] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:27.598089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f26a47-c609-4e69-91c3-d19dca7dd39c None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:27.652523 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d970f7a-dd9d-4363-97a9-adddcc8e08cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:27.653315 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d970f7a-dd9d-4363-97a9-adddcc8e08cd None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:27.653746 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d970f7a-dd9d-4363-97a9-adddcc8e08cd None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:27.654079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d970f7a-dd9d-4363-97a9-adddcc8e08cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:27.655002 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d970f7a-dd9d-4363-97a9-adddcc8e08cd None admin] RBAC: Adding query filter params (role.id=f08394a5dbcf4506a17b78b4416f1680, scope.project.id=82ce9b40374d42e880f6e6d06d93787e, user.id=6334776a02744d71b21d6f704adaa404) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:27.655516 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d970f7a-dd9d-4363-97a9-adddcc8e08cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:27.657326 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d970f7a-dd9d-4363-97a9-adddcc8e08cd None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:27.668272 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 135/273] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:34:27 2022] GET /identity/v3/role_assignments?user.id=6334776a02744d71b21d6f704adaa404&scope.project.id=82ce9b40374d42e880f6e6d06d93787e&role.id=f08394a5dbcf4506a17b78b4416f1680 => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:27.675570 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09135fb-79d3-4fb3-a094-587cf0417ad6 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:27.676060 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09135fb-79d3-4fb3-a094-587cf0417ad6 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:27.676438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09135fb-79d3-4fb3-a094-587cf0417ad6 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:27.678422 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 139/274] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:34:27.688311 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2ccb4-66ce-42f1-aa09-9f77aaba085e None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:27.689266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2ccb4-66ce-42f1-aa09-9f77aaba085e None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:27.689814 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2ccb4-66ce-42f1-aa09-9f77aaba085e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:27.743393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-edb2ccb4-66ce-42f1-aa09-9f77aaba085e None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:27.745907 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-edb2ccb4-66ce-42f1-aa09-9f77aaba085e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:27.923862 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 136/275] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:34:28.018755 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09135fb-79d3-4fb3-a094-587cf0417ad6 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:28.043422 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:28.126572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2ccb4-66ce-42f1-aa09-9f77aaba085e None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:28.237720 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09135fb-79d3-4fb3-a094-587cf0417ad6 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:28.251564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:28.309294 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca270c-3737-460d-85be-0f14d450bf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:28.310358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca270c-3737-460d-85be-0f14d450bf03 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:28.311052 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca270c-3737-460d-85be-0f14d450bf03 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:28.311784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca270c-3737-460d-85be-0f14d450bf03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:28.335415 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca270c-3737-460d-85be-0f14d450bf03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:28.345182 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-eaca270c-3737-460d-85be-0f14d450bf03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:34:28.345182 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:28.345182 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:28.345182 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:28.345182 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:28.345182 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:28.345182 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:28.345182 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:28.345182 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:28.345182 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:28.345182 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:28.345182 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:28.345182 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:28.345182 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:28.345182 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:28.345182 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:28.347439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:28.347439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:28.347439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:28.347439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:28.347439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:28.347439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:28.347439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:28.347439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:28.347439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:28.347439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:28.347439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:28.347439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:28.347439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:28.347439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:28.347439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:28.347439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:28.348706 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:28.348706 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:28.348706 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:28.348706 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:28.348706 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:28.348706 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:28.348706 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:28.348706 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:28.348706 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:28.348706 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:28.348706 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:34:28.348706 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:34:28.353170 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 140/276] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:34:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:28.364549 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca270c-3737-460d-85be-0f14d450bf03 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:28.397390 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2ccb4-66ce-42f1-aa09-9f77aaba085e None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:28.472933 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb92b1-001f-4ddd-b06a-decc58f94f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:28.474215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb92b1-001f-4ddd-b06a-decc58f94f69 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:28.474866 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb92b1-001f-4ddd-b06a-decc58f94f69 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:28.475459 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb92b1-001f-4ddd-b06a-decc58f94f69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:28.477840 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb92b1-001f-4ddd-b06a-decc58f94f69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:28.480869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb92b1-001f-4ddd-b06a-decc58f94f69 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:28.485026 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 137/277] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:34:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:28.494613 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb92b1-001f-4ddd-b06a-decc58f94f69 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:28.508045 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:28.586617 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca270c-3737-460d-85be-0f14d450bf03 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:28.659677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9893f9-9d41-4742-bcbf-27e645cb0730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:28.659984 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb92b1-001f-4ddd-b06a-decc58f94f69 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:28.660742 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9893f9-9d41-4742-bcbf-27e645cb0730 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:28.661231 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9893f9-9d41-4742-bcbf-27e645cb0730 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:28.661764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9893f9-9d41-4742-bcbf-27e645cb0730 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:28.663274 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9893f9-9d41-4742-bcbf-27e645cb0730 None admin] RBAC: Adding query filter params (name=member) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:28.663819 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9893f9-9d41-4742-bcbf-27e645cb0730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:28.666618 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9893f9-9d41-4742-bcbf-27e645cb0730 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:28.692766 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 141/278] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:34:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:34:28.692766 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9893f9-9d41-4742-bcbf-27e645cb0730 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:28.694370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:28.745162 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c556e3-d806-4d4b-8be0-e022d7f5c63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:28.746070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c556e3-d806-4d4b-8be0-e022d7f5c63a None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:28.746477 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c556e3-d806-4d4b-8be0-e022d7f5c63a None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:28.747005 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c556e3-d806-4d4b-8be0-e022d7f5c63a None admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:28.748350 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c556e3-d806-4d4b-8be0-e022d7f5c63a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:28.751860 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c556e3-d806-4d4b-8be0-e022d7f5c63a None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:28.791860 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 138/279] 10.222.0.94 () {60 vars in 1132 bytes} [Wed Aug 24 04:34:28 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:34:28.793901 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c556e3-d806-4d4b-8be0-e022d7f5c63a None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:28.919754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9893f9-9d41-4742-bcbf-27e645cb0730 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:28.987230 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:29.001272 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7730648-2359-40c3-b68b-f86b451e7d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:29.003582 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7730648-2359-40c3-b68b-f86b451e7d30 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:29.004464 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7730648-2359-40c3-b68b-f86b451e7d30 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:29.005223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7730648-2359-40c3-b68b-f86b451e7d30 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:29.029573 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7730648-2359-40c3-b68b-f86b451e7d30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:29.042052 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-e7730648-2359-40c3-b68b-f86b451e7d30 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:34:29.042052 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:29.042052 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:29.042052 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:29.042052 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:29.042052 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:29.042052 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:29.042052 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:29.042052 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:29.042052 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:29.042052 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:29.042052 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:29.042052 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:29.042052 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:29.042052 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:29.042052 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:29.043840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:29.043840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:29.043840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:29.043840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:29.043840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:29.043840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:29.043840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:29.043840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:29.043840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:29.043840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:29.043840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:29.043840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:29.043840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:29.043840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:29.043840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:29.043840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:29.045431 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:29.045431 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:29.045431 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:29.045431 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:29.045431 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:29.045431 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:29.045431 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:29.045431 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:29.045431 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:29.045431 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:29.045431 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:34:29.045431 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:34:29.051023 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 142/280] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:34:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:29.060451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c556e3-d806-4d4b-8be0-e022d7f5c63a None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:29.062997 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7730648-2359-40c3-b68b-f86b451e7d30 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:29.149843 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633baae-b844-41d9-bf1b-d8eb8f85c56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:29.151326 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633baae-b844-41d9-bf1b-d8eb8f85c56a None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:29.152090 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633baae-b844-41d9-bf1b-d8eb8f85c56a None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:29.152802 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633baae-b844-41d9-bf1b-d8eb8f85c56a None admin] PATH_INFO: `/v3/users/2393ab3a7e2b4c31b40e04b514624330` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:29.183254 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633baae-b844-41d9-bf1b-d8eb8f85c56a None admin] RBAC: Authorizing `identity:get_user(user_id=2393ab3a7e2b4c31b40e04b514624330)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:29.186147 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633baae-b844-41d9-bf1b-d8eb8f85c56a None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:29.190958 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 139/281] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:34:28 2022] GET /identity/v3/users/2393ab3a7e2b4c31b40e04b514624330 => generated 293 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:29.204835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633baae-b844-41d9-bf1b-d8eb8f85c56a None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:29.266419 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:29.303920 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7730648-2359-40c3-b68b-f86b451e7d30 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:29.381373 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce7d9d-dc4a-429c-9fff-a1faa6a3d422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:29.382722 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7d9d-dc4a-429c-9fff-a1faa6a3d422 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:29.383255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7d9d-dc4a-429c-9fff-a1faa6a3d422 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:29.383724 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7d9d-dc4a-429c-9fff-a1faa6a3d422 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:29.385269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce7d9d-dc4a-429c-9fff-a1faa6a3d422 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:29.386618 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce7d9d-dc4a-429c-9fff-a1faa6a3d422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:29.389391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce7d9d-dc4a-429c-9fff-a1faa6a3d422 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:29.415329 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633baae-b844-41d9-bf1b-d8eb8f85c56a None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:29.418921 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 143/282] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:34:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:34:29.421718 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f74b2-46b3-40f8-ad7f-c7613bef9f24 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:29.422631 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f74b2-46b3-40f8-ad7f-c7613bef9f24 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:29.423925 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f74b2-46b3-40f8-ad7f-c7613bef9f24 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:29.427723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 144/283] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:29.434569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f74b2-46b3-40f8-ad7f-c7613bef9f24 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:29.475589 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b5d04-fba8-4a3b-9172-b3ef08edb2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:29.476485 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b5d04-fba8-4a3b-9172-b3ef08edb2b4 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:29.477432 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b5d04-fba8-4a3b-9172-b3ef08edb2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:29.477886 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b5d04-fba8-4a3b-9172-b3ef08edb2b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:29.480070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b5d04-fba8-4a3b-9172-b3ef08edb2b4 None admin] RBAC: Adding query filter params (role.id=1a586b803a1e429f82b85f386d7564fb, user.id=2393ab3a7e2b4c31b40e04b514624330, scope.system=all) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:29.480609 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b5d04-fba8-4a3b-9172-b3ef08edb2b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:29.483571 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b5d04-fba8-4a3b-9172-b3ef08edb2b4 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:29.496600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 140/284] 10.222.0.94 () {56 vars in 1308 bytes} [Wed Aug 24 04:34:29 2022] GET /identity/v3/role_assignments?user.id=2393ab3a7e2b4c31b40e04b514624330&scope.system=all&role.id=1a586b803a1e429f82b85f386d7564fb => generated 226 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:29.499373 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1ad54-2428-4a6a-aea0-c04eb5e83e49 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:29.500682 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1ad54-2428-4a6a-aea0-c04eb5e83e49 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:29.501254 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1ad54-2428-4a6a-aea0-c04eb5e83e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:29.536329 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-38b1ad54-2428-4a6a-aea0-c04eb5e83e49 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:29.537964 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-38b1ad54-2428-4a6a-aea0-c04eb5e83e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:29.584712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:29.705723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f74b2-46b3-40f8-ad7f-c7613bef9f24 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:29.741091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 141/285] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:29.786925 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a54833-8f05-4565-8a47-f4d0a0909251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:29.788271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a54833-8f05-4565-8a47-f4d0a0909251 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:29.788769 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a54833-8f05-4565-8a47-f4d0a0909251 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:29.789267 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a54833-8f05-4565-8a47-f4d0a0909251 None admin] PATH_INFO: `/v3/users/03fe1ce22e9744faad0396e2789a4962` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:29.791600 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a54833-8f05-4565-8a47-f4d0a0909251 None admin] RBAC: Authorizing `identity:get_user(user_id=03fe1ce22e9744faad0396e2789a4962)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:29.793994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a54833-8f05-4565-8a47-f4d0a0909251 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:29.797589 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 145/286] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:34:29 2022] GET /identity/v3/users/03fe1ce22e9744faad0396e2789a4962 => generated 297 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:29.806794 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1ad54-2428-4a6a-aea0-c04eb5e83e49 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:29.855726 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:30.030010 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1ad54-2428-4a6a-aea0-c04eb5e83e49 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:30.128051 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c958ba-8296-4f6d-a592-eca481f27d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:30.129188 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c958ba-8296-4f6d-a592-eca481f27d32 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:30.129648 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c958ba-8296-4f6d-a592-eca481f27d32 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:30.130148 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c958ba-8296-4f6d-a592-eca481f27d32 None admin] PATH_INFO: `/v3/projects/82ce9b40374d42e880f6e6d06d93787e` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:30.132558 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c958ba-8296-4f6d-a592-eca481f27d32 None admin] RBAC: Authorizing `identity:get_project(project_id=82ce9b40374d42e880f6e6d06d93787e)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:30.135545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c958ba-8296-4f6d-a592-eca481f27d32 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:30.139472 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 142/287] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:29 2022] GET /identity/v3/projects/82ce9b40374d42e880f6e6d06d93787e => generated 302 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:30.147096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a54833-8f05-4565-8a47-f4d0a0909251 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:30.374750 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a54833-8f05-4565-8a47-f4d0a0909251 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:30.419441 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:30.434060 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c958ba-8296-4f6d-a592-eca481f27d32 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:30.453058 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346960d3-dd69-428b-9829-01077ffa26a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:30.454463 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346960d3-dd69-428b-9829-01077ffa26a5 None admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:30.454959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346960d3-dd69-428b-9829-01077ffa26a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:30.455467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346960d3-dd69-428b-9829-01077ffa26a5 None admin] PATH_INFO: `/v3/projects/82ce9b40374d42e880f6e6d06d93787e/users/03fe1ce22e9744faad0396e2789a4962/roles/28bafe05b4a44e89a89bdd6806d44ac5` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:30.459390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346960d3-dd69-428b-9829-01077ffa26a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=82ce9b40374d42e880f6e6d06d93787e, user_id=03fe1ce22e9744faad0396e2789a4962, role_id=28bafe05b4a44e89a89bdd6806d44ac5)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:30.462369 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346960d3-dd69-428b-9829-01077ffa26a5 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:30.496326 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 146/288] 10.222.0.94 () {58 vars in 1439 bytes} [Wed Aug 24 04:34:30 2022] PUT /identity/v3/projects/82ce9b40374d42e880f6e6d06d93787e/users/03fe1ce22e9744faad0396e2789a4962/roles/28bafe05b4a44e89a89bdd6806d44ac5 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:34:30.709315 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:30.741156 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c958ba-8296-4f6d-a592-eca481f27d32 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:30.833077 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154761a6-4482-4aa6-97ad-7b2f91219659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:30.834262 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154761a6-4482-4aa6-97ad-7b2f91219659 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:30.834780 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154761a6-4482-4aa6-97ad-7b2f91219659 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:30.835262 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154761a6-4482-4aa6-97ad-7b2f91219659 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:30.866786 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154761a6-4482-4aa6-97ad-7b2f91219659 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:30.878370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-154761a6-4482-4aa6-97ad-7b2f91219659 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:34:30.878370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:30.878370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:30.878370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:30.878370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:30.878370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:30.878370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:30.878370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:30.878370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:30.878370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:30.878370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:30.878370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:30.878370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:30.878370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:30.878370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:30.878370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:30.880092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:30.880092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:30.880092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:30.880092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:30.880092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:30.880092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:30.880092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:30.880092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:30.880092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:30.880092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:30.880092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:30.880092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:30.880092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:30.880092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:30.880092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:30.880092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:30.881835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:30.881835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:30.881835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:30.881835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:30.881835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:30.881835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:30.881835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:30.881835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:30.881835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:30.881835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:30.881835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:34:30.881835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:34:30.881835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 143/289] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:34:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 448 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:30.892123 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346960d3-dd69-428b-9829-01077ffa26a5 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:31.123706 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346960d3-dd69-428b-9829-01077ffa26a5 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:31.213860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ffd64-789e-460e-b3f6-7b5d2e196a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:31.216021 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ffd64-789e-460e-b3f6-7b5d2e196a76 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:31.216736 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ffd64-789e-460e-b3f6-7b5d2e196a76 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:31.217460 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ffd64-789e-460e-b3f6-7b5d2e196a76 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:31.218855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ffd64-789e-460e-b3f6-7b5d2e196a76 None admin] RBAC: Adding query filter params (name=member) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:31.220097 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ffd64-789e-460e-b3f6-7b5d2e196a76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:31.222392 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ffd64-789e-460e-b3f6-7b5d2e196a76 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:31.247787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 147/290] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:34:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:31.256886 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154761a6-4482-4aa6-97ad-7b2f91219659 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:31.530989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154761a6-4482-4aa6-97ad-7b2f91219659 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:31.607552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d97d2-afb2-4275-83ba-e50beae514c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:31.609025 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d97d2-afb2-4275-83ba-e50beae514c2 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:31.609622 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d97d2-afb2-4275-83ba-e50beae514c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:31.610908 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d97d2-afb2-4275-83ba-e50beae514c2 None admin] PATH_INFO: `/v3/users/2e908230e6a24669a0537c362c48b00f` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:31.613273 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d97d2-afb2-4275-83ba-e50beae514c2 None admin] RBAC: Authorizing `identity:get_user(user_id=2e908230e6a24669a0537c362c48b00f)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:31.616562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d97d2-afb2-4275-83ba-e50beae514c2 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:31.620061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 144/291] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:34:31 2022] GET /identity/v3/users/2e908230e6a24669a0537c362c48b00f => generated 297 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:31.629905 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ffd64-789e-460e-b3f6-7b5d2e196a76 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:31.752978 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:31.903227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ffd64-789e-460e-b3f6-7b5d2e196a76 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:31.999905 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc022dc-1a3a-47e1-a2bd-6adfcf28c2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:32.001559 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc022dc-1a3a-47e1-a2bd-6adfcf28c2a4 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:32.002067 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc022dc-1a3a-47e1-a2bd-6adfcf28c2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:32.002561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc022dc-1a3a-47e1-a2bd-6adfcf28c2a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:32.196765 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc022dc-1a3a-47e1-a2bd-6adfcf28c2a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:32.199603 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc022dc-1a3a-47e1-a2bd-6adfcf28c2a4 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:32.297500 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:32.468604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 148/292] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:34:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 840 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:32.480124 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d97d2-afb2-4275-83ba-e50beae514c2 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:32.527063 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:32.780979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d97d2-afb2-4275-83ba-e50beae514c2 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:32.888536 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c1532-03ca-45f0-840d-09d160665599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:32.889720 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c1532-03ca-45f0-840d-09d160665599 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:32.890138 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c1532-03ca-45f0-840d-09d160665599 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:32.890721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c1532-03ca-45f0-840d-09d160665599 None admin] PATH_INFO: `/v3/projects/82ce9b40374d42e880f6e6d06d93787e` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:32.894659 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c1532-03ca-45f0-840d-09d160665599 None admin] RBAC: Authorizing `identity:get_project(project_id=82ce9b40374d42e880f6e6d06d93787e)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:32.897879 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c1532-03ca-45f0-840d-09d160665599 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:32.901564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 145/293] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:32 2022] GET /identity/v3/projects/82ce9b40374d42e880f6e6d06d93787e => generated 302 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:32.913152 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc022dc-1a3a-47e1-a2bd-6adfcf28c2a4 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:33.056637 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeb8f7-3058-4c22-95ca-aafd135f7c66 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:33.057663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeb8f7-3058-4c22-95ca-aafd135f7c66 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:33.058471 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeb8f7-3058-4c22-95ca-aafd135f7c66 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:33.062539 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 146/294] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:34:33.070694 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a71fa-4692-4a25-a707-886326a313d7 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:33.071179 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a71fa-4692-4a25-a707-886326a313d7 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:33.071685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a71fa-4692-4a25-a707-886326a313d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:33.125367 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-dc4a71fa-4692-4a25-a707-886326a313d7 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:33.128821 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-dc4a71fa-4692-4a25-a707-886326a313d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:33.177718 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc022dc-1a3a-47e1-a2bd-6adfcf28c2a4 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:33.324645 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8098b78-fcc6-447d-974d-5576b3abd89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:33.325902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8098b78-fcc6-447d-974d-5576b3abd89f None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:33.326185 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8098b78-fcc6-447d-974d-5576b3abd89f None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:33.329661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8098b78-fcc6-447d-974d-5576b3abd89f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:33.329661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8098b78-fcc6-447d-974d-5576b3abd89f None admin] RBAC: Adding query filter params (role.id=1a586b803a1e429f82b85f386d7564fb, scope.project.id=82ce9b40374d42e880f6e6d06d93787e, user.id=2e908230e6a24669a0537c362c48b00f) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:33.329661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8098b78-fcc6-447d-974d-5576b3abd89f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:33.332801 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8098b78-fcc6-447d-974d-5576b3abd89f None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:33.349002 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 149/295] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:34:32 2022] GET /identity/v3/role_assignments?user.id=2e908230e6a24669a0537c362c48b00f&scope.project.id=82ce9b40374d42e880f6e6d06d93787e&role.id=1a586b803a1e429f82b85f386d7564fb => generated 608 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:33.351648 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1215a-d543-4e74-86d5-a8bbe57094cc None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:33.352366 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1215a-d543-4e74-86d5-a8bbe57094cc None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:33.353023 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1215a-d543-4e74-86d5-a8bbe57094cc None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:33.361552 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 150/296] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:33.366199 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85f38b-a3be-4862-bca2-48539bc154f7 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:33.367074 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85f38b-a3be-4862-bca2-48539bc154f7 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:33.367806 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85f38b-a3be-4862-bca2-48539bc154f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:33.394442 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:33.407758 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-0b85f38b-a3be-4862-bca2-48539bc154f7 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:33.410186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 147/297] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:33.410993 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-0b85f38b-a3be-4862-bca2-48539bc154f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:33.592150 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 151/298] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:34:33.622870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb2133-5718-4645-8f9a-ae4ea831a04b None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:33.624589 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb2133-5718-4645-8f9a-ae4ea831a04b None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:33.625373 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb2133-5718-4645-8f9a-ae4ea831a04b None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:33.629562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 148/299] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:33.639650 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5686c-49db-4897-b1f7-7f776d47c181 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:33.640572 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5686c-49db-4897-b1f7-7f776d47c181 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:33.642012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5686c-49db-4897-b1f7-7f776d47c181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:33.676614 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-edd5686c-49db-4897-b1f7-7f776d47c181 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:33.679582 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-edd5686c-49db-4897-b1f7-7f776d47c181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:33.868623 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 152/300] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:34.026217 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb2133-5718-4645-8f9a-ae4ea831a04b None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:34.073326 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:34.182647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5686c-49db-4897-b1f7-7f776d47c181 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:34.272854 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb2133-5718-4645-8f9a-ae4ea831a04b None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:34.339347 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:34.343577 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea0775-f702-4d1c-9f71-becc8e7c57c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:34.345770 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea0775-f702-4d1c-9f71-becc8e7c57c9 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:34.346611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea0775-f702-4d1c-9f71-becc8e7c57c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:34.347416 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea0775-f702-4d1c-9f71-becc8e7c57c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:34.368689 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea0775-f702-4d1c-9f71-becc8e7c57c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:34.379777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-0bea0775-f702-4d1c-9f71-becc8e7c57c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:34:34.379777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:34.379777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:34.379777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:34.379777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:34.379777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:34.379777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:34.379777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:34.379777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:34.379777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:34.379777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:34.379777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:34.379777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:34.379777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:34.379777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:34.379777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:34.381579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:34.381579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:34.381579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:34.381579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:34.381579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:34.381579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:34.381579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:34.381579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:34.381579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:34.381579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:34.381579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:34.381579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:34.381579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:34.381579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:34.381579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:34.381579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:34.383171 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:34.383171 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:34.383171 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:34.383171 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:34.383171 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:34.383171 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:34.383171 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:34.383171 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:34.383171 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:34.383171 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:34.383171 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:34:34.383171 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:34:34.387411 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 149/301] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:34:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:34:34.397691 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea0775-f702-4d1c-9f71-becc8e7c57c9 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:34.423991 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5686c-49db-4897-b1f7-7f776d47c181 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:34.498184 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb5394-9f04-4051-b6f5-9ca711628368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:34.499612 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb5394-9f04-4051-b6f5-9ca711628368 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:34.500334 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb5394-9f04-4051-b6f5-9ca711628368 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:34.501353 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb5394-9f04-4051-b6f5-9ca711628368 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:34.503707 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb5394-9f04-4051-b6f5-9ca711628368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:34.506606 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb5394-9f04-4051-b6f5-9ca711628368 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:34.513615 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 153/302] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:34:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:34.513615 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb5394-9f04-4051-b6f5-9ca711628368 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:34.573223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:34.630575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea0775-f702-4d1c-9f71-becc8e7c57c9 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:34.709454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f58afa-e5a2-4154-9db4-0d4683fd7598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:34.710543 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f58afa-e5a2-4154-9db4-0d4683fd7598 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:34.711092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f58afa-e5a2-4154-9db4-0d4683fd7598 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:34.711559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f58afa-e5a2-4154-9db4-0d4683fd7598 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:34.713955 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f58afa-e5a2-4154-9db4-0d4683fd7598 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:34.713955 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f58afa-e5a2-4154-9db4-0d4683fd7598 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:34.717921 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f58afa-e5a2-4154-9db4-0d4683fd7598 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:34.737955 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 150/303] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:34:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:34.741157 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f58afa-e5a2-4154-9db4-0d4683fd7598 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:34.744826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb5394-9f04-4051-b6f5-9ca711628368 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:34.823607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff37e99-86a7-4ca4-bbf5-f7b07ba6ef1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:34.824688 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff37e99-86a7-4ca4-bbf5-f7b07ba6ef1e None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:34.826362 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff37e99-86a7-4ca4-bbf5-f7b07ba6ef1e None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:34.826362 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff37e99-86a7-4ca4-bbf5-f7b07ba6ef1e None admin] PATH_INFO: `/v3/roles/member` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:34.830792 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:34.851950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff37e99-86a7-4ca4-bbf5-f7b07ba6ef1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:34.862569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-1ff37e99-86a7-4ca4-bbf5-f7b07ba6ef1e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:34:34.862569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:34.862569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:34.862569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:34.862569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:34.862569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:34.862569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:34.862569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:34.862569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:34.862569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:34.862569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:34.862569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:34.862569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:34.862569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:34.862569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:34.862569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:34.864426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:34.864426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:34.864426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:34.864426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:34.864426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:34.864426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:34.864426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:34.864426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:34.864426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:34.864426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:34.864426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:34.864426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:34.864426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:34.864426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:34.864426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:34.864426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:34.867000 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:34.867000 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:34.867000 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:34.867000 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:34.867000 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:34.867000 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:34.867000 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:34.867000 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:34.867000 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:34.867000 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:34.867000 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:34:34.867000 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:34:34.873164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 154/304] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:34:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:34.874701 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff37e99-86a7-4ca4-bbf5-f7b07ba6ef1e None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:34.982818 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f58afa-e5a2-4154-9db4-0d4683fd7598 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:35.058106 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e55cc1-a1d1-467f-84aa-c45b1d4c8126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:35.059829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e55cc1-a1d1-467f-84aa-c45b1d4c8126 None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:35.060620 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e55cc1-a1d1-467f-84aa-c45b1d4c8126 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:35.061346 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e55cc1-a1d1-467f-84aa-c45b1d4c8126 None admin] PATH_INFO: `/v3/groups` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:35.062744 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e55cc1-a1d1-467f-84aa-c45b1d4c8126 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:35.067233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e55cc1-a1d1-467f-84aa-c45b1d4c8126 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:35.090476 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:35.100305 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff37e99-86a7-4ca4-bbf5-f7b07ba6ef1e None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:35.114340 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 151/305] 10.222.0.94 () {60 vars in 1134 bytes} [Wed Aug 24 04:34:34 2022] POST /identity/v3/groups => generated 229 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:34:35.116228 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e55cc1-a1d1-467f-84aa-c45b1d4c8126 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:35.181738 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0058d-5c96-49b4-a3b3-6e8f69d04e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:35.183489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0058d-5c96-49b4-a3b3-6e8f69d04e59 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:35.183489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0058d-5c96-49b4-a3b3-6e8f69d04e59 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:35.183927 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0058d-5c96-49b4-a3b3-6e8f69d04e59 None admin] PATH_INFO: `/v3/users/02b639206b654bd688dd524e06055b8e` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:35.218272 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0058d-5c96-49b4-a3b3-6e8f69d04e59 None admin] RBAC: Authorizing `identity:get_user(user_id=02b639206b654bd688dd524e06055b8e)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:35.222659 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0058d-5c96-49b4-a3b3-6e8f69d04e59 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:35.227224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 155/306] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:34:34 2022] GET /identity/v3/users/02b639206b654bd688dd524e06055b8e => generated 293 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:35.237440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0058d-5c96-49b4-a3b3-6e8f69d04e59 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:35.371069 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:35.391958 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e55cc1-a1d1-467f-84aa-c45b1d4c8126 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:35.488123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7444e61-3dc7-42f1-952d-956ed3e2aef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:35.489491 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7444e61-3dc7-42f1-952d-956ed3e2aef5 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:35.489945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7444e61-3dc7-42f1-952d-956ed3e2aef5 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:35.490437 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7444e61-3dc7-42f1-952d-956ed3e2aef5 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:35.491518 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0058d-5c96-49b4-a3b3-6e8f69d04e59 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:35.491842 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7444e61-3dc7-42f1-952d-956ed3e2aef5 None admin] RBAC: Adding query filter params (name=member) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:35.492366 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7444e61-3dc7-42f1-952d-956ed3e2aef5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:35.495215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7444e61-3dc7-42f1-952d-956ed3e2aef5 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:35.512643 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 152/307] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:34:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:35.515050 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4512ff-6a74-4f93-805a-74cdd39b0d47 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:35.515562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4512ff-6a74-4f93-805a-74cdd39b0d47 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:35.516060 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4512ff-6a74-4f93-805a-74cdd39b0d47 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:35.519513 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 153/308] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:35.527072 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4512ff-6a74-4f93-805a-74cdd39b0d47 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:35.568840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f8bb9-99f5-4d91-a256-aac8ad2b7ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:35.570269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f8bb9-99f5-4d91-a256-aac8ad2b7ecc None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:35.571045 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f8bb9-99f5-4d91-a256-aac8ad2b7ecc None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:35.571788 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f8bb9-99f5-4d91-a256-aac8ad2b7ecc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:35.573650 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f8bb9-99f5-4d91-a256-aac8ad2b7ecc None admin] RBAC: Adding query filter params (role.id=28bafe05b4a44e89a89bdd6806d44ac5, user.id=02b639206b654bd688dd524e06055b8e, scope.system=all) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:35.574453 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f8bb9-99f5-4d91-a256-aac8ad2b7ecc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:35.577291 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f8bb9-99f5-4d91-a256-aac8ad2b7ecc None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:35.589304 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 156/309] 10.222.0.94 () {56 vars in 1308 bytes} [Wed Aug 24 04:34:35 2022] GET /identity/v3/role_assignments?user.id=02b639206b654bd688dd524e06055b8e&scope.system=all&role.id=28bafe05b4a44e89a89bdd6806d44ac5 => generated 226 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:34:35.592356 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b426281-f05a-45bb-986e-6e2891cbfe86 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:35.592838 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b426281-f05a-45bb-986e-6e2891cbfe86 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:35.593303 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b426281-f05a-45bb-986e-6e2891cbfe86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:35.628710 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-1b426281-f05a-45bb-986e-6e2891cbfe86 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:35.631371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-1b426281-f05a-45bb-986e-6e2891cbfe86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:35.660138 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:35.776379 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4512ff-6a74-4f93-805a-74cdd39b0d47 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:35.786320 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 157/310] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:35.865766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72757b86-7513-4b3d-a092-9330934c0228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:35.866962 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72757b86-7513-4b3d-a092-9330934c0228 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:35.867466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72757b86-7513-4b3d-a092-9330934c0228 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:35.867968 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72757b86-7513-4b3d-a092-9330934c0228 None admin] PATH_INFO: `/v3/users/2393ab3a7e2b4c31b40e04b514624330` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:35.870780 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72757b86-7513-4b3d-a092-9330934c0228 None admin] RBAC: Authorizing `identity:get_user(user_id=2393ab3a7e2b4c31b40e04b514624330)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:35.875302 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72757b86-7513-4b3d-a092-9330934c0228 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:35.881364 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 154/311] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:34:35 2022] GET /identity/v3/users/2393ab3a7e2b4c31b40e04b514624330 => generated 293 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:35.890345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b426281-f05a-45bb-986e-6e2891cbfe86 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:35.992860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:36.107332 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b426281-f05a-45bb-986e-6e2891cbfe86 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:36.184918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ee2d8-93b1-4e1a-805e-f6c2a794fdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:36.186127 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ee2d8-93b1-4e1a-805e-f6c2a794fdf5 None admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:36.186637 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ee2d8-93b1-4e1a-805e-f6c2a794fdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:36.187134 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ee2d8-93b1-4e1a-805e-f6c2a794fdf5 None admin] PATH_INFO: `/v3/system/users/2393ab3a7e2b4c31b40e04b514624330/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:36.190235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ee2d8-93b1-4e1a-805e-f6c2a794fdf5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2393ab3a7e2b4c31b40e04b514624330, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:36.193014 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ee2d8-93b1-4e1a-805e-f6c2a794fdf5 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:36.217802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 158/312] 10.222.0.94 () {58 vars in 1334 bytes} [Wed Aug 24 04:34:35 2022] PUT /identity/v3/system/users/2393ab3a7e2b4c31b40e04b514624330/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:34:36.369559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72757b86-7513-4b3d-a092-9330934c0228 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:36.597685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72757b86-7513-4b3d-a092-9330934c0228 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:36.647659 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:36.661615 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4c4bc-71c3-44d7-85ff-884e2ceb7dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:36.663268 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4c4bc-71c3-44d7-85ff-884e2ceb7dc9 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:36.663766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4c4bc-71c3-44d7-85ff-884e2ceb7dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:36.664343 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4c4bc-71c3-44d7-85ff-884e2ceb7dc9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:36.693475 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4c4bc-71c3-44d7-85ff-884e2ceb7dc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:36.699454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-5bb4c4bc-71c3-44d7-85ff-884e2ceb7dc9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:34:36.699454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:36.699454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:36.699454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:36.699454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:36.699454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:36.699454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:36.699454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:36.699454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:36.699454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:36.699454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:36.699454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:36.699454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:36.699454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:36.699454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:36.699454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:36.701139 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:36.701139 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:36.701139 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:36.701139 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:36.701139 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:36.701139 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:36.701139 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:36.701139 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:36.701139 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:36.701139 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:36.701139 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:36.701139 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:36.701139 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:36.701139 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:36.701139 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:36.701139 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:36.703285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:36.703285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:36.703285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:36.703285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:36.703285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:36.703285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:36.703285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:36.703285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:36.703285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:36.703285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:36.703285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:34:36.703285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:34:36.703285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 155/313] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:34:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:36.711198 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ee2d8-93b1-4e1a-805e-f6c2a794fdf5 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:36.947942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ee2d8-93b1-4e1a-805e-f6c2a794fdf5 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:36.971151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:37.030966 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d521e7-fd9e-4605-9d26-a580ee261f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:37.033942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d521e7-fd9e-4605-9d26-a580ee261f19 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:37.034469 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d521e7-fd9e-4605-9d26-a580ee261f19 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:37.034961 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d521e7-fd9e-4605-9d26-a580ee261f19 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:37.036394 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d521e7-fd9e-4605-9d26-a580ee261f19 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:37.037200 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d521e7-fd9e-4605-9d26-a580ee261f19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:37.039928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d521e7-fd9e-4605-9d26-a580ee261f19 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:37.060090 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 159/314] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:34:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:37.069058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4c4bc-71c3-44d7-85ff-884e2ceb7dc9 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:37.297453 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4c4bc-71c3-44d7-85ff-884e2ceb7dc9 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:37.377272 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b357e7-6d6e-4883-b2b2-393090060ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:37.378550 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b357e7-6d6e-4883-b2b2-393090060ab3 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:37.379060 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b357e7-6d6e-4883-b2b2-393090060ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:37.379554 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b357e7-6d6e-4883-b2b2-393090060ab3 None admin] PATH_INFO: `/v3/users/03fe1ce22e9744faad0396e2789a4962` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:37.382208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b357e7-6d6e-4883-b2b2-393090060ab3 None admin] RBAC: Authorizing `identity:get_user(user_id=03fe1ce22e9744faad0396e2789a4962)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:37.385316 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b357e7-6d6e-4883-b2b2-393090060ab3 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:37.389030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 156/315] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:34:37 2022] GET /identity/v3/users/03fe1ce22e9744faad0396e2789a4962 => generated 297 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:34:37.398794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d521e7-fd9e-4605-9d26-a580ee261f19 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:37.637792 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d521e7-fd9e-4605-9d26-a580ee261f19 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:37.728220 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c813f68-c96c-4ce8-81f1-2791a6289b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:37.729424 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c813f68-c96c-4ce8-81f1-2791a6289b78 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:37.729810 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c813f68-c96c-4ce8-81f1-2791a6289b78 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:37.730289 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c813f68-c96c-4ce8-81f1-2791a6289b78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:37.826512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:37.894510 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c813f68-c96c-4ce8-81f1-2791a6289b78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:37.897371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c813f68-c96c-4ce8-81f1-2791a6289b78 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:38.093573 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 160/316] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:34:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:38.102984 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b357e7-6d6e-4883-b2b2-393090060ab3 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:38.237122 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:38.336810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b357e7-6d6e-4883-b2b2-393090060ab3 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:38.418310 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05e5c8-b953-4792-9426-89a81482f017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:38.419407 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05e5c8-b953-4792-9426-89a81482f017 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:38.419917 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05e5c8-b953-4792-9426-89a81482f017 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:38.420409 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05e5c8-b953-4792-9426-89a81482f017 None admin] PATH_INFO: `/v3/projects/82ce9b40374d42e880f6e6d06d93787e` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:38.424234 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05e5c8-b953-4792-9426-89a81482f017 None admin] RBAC: Authorizing `identity:get_project(project_id=82ce9b40374d42e880f6e6d06d93787e)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:38.427153 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05e5c8-b953-4792-9426-89a81482f017 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:38.430972 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 157/317] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:38 2022] GET /identity/v3/projects/82ce9b40374d42e880f6e6d06d93787e => generated 302 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:38.443467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c813f68-c96c-4ce8-81f1-2791a6289b78 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:38.619619 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:38.698208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c813f68-c96c-4ce8-81f1-2791a6289b78 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:38.781132 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8f7cb-50d4-47ce-a76b-cf5dbf39eaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:38.783550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8f7cb-50d4-47ce-a76b-cf5dbf39eaed None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:38.783550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8f7cb-50d4-47ce-a76b-cf5dbf39eaed None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:38.784001 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8f7cb-50d4-47ce-a76b-cf5dbf39eaed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:38.785486 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8f7cb-50d4-47ce-a76b-cf5dbf39eaed None admin] RBAC: Adding query filter params (role.id=28bafe05b4a44e89a89bdd6806d44ac5, scope.project.id=82ce9b40374d42e880f6e6d06d93787e, user.id=03fe1ce22e9744faad0396e2789a4962) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:38.789446 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8f7cb-50d4-47ce-a76b-cf5dbf39eaed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:38.789446 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8f7cb-50d4-47ce-a76b-cf5dbf39eaed None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:38.806980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 161/318] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:34:38 2022] GET /identity/v3/role_assignments?user.id=03fe1ce22e9744faad0396e2789a4962&scope.project.id=82ce9b40374d42e880f6e6d06d93787e&role.id=28bafe05b4a44e89a89bdd6806d44ac5 => generated 608 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:38.854329 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e205e6c-8299-4303-9432-fe25b73c147c None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:38.855856 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e205e6c-8299-4303-9432-fe25b73c147c None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:38.856806 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e205e6c-8299-4303-9432-fe25b73c147c None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:38.861042 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 158/319] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:38.871951 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd3b75-9ac7-4132-91d9-9658216ccf7f None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:38.872985 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd3b75-9ac7-4132-91d9-9658216ccf7f None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:38.873908 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd3b75-9ac7-4132-91d9-9658216ccf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:38.912964 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-9ccd3b75-9ac7-4132-91d9-9658216ccf7f None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:38.916019 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-9ccd3b75-9ac7-4132-91d9-9658216ccf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:39.071394 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 162/320] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:39.152935 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2d145-5da2-4cd9-a52b-a89620b977d7 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:39.154458 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2d145-5da2-4cd9-a52b-a89620b977d7 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:39.154939 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2d145-5da2-4cd9-a52b-a89620b977d7 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:39.158442 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 159/321] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:39.168583 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0248041-f38d-4a72-8bb4-e67317837914 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:39.169682 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0248041-f38d-4a72-8bb4-e67317837914 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:39.170472 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0248041-f38d-4a72-8bb4-e67317837914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:39.206905 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-f0248041-f38d-4a72-8bb4-e67317837914 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:39.209822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-f0248041-f38d-4a72-8bb4-e67317837914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:39.350212 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:39.373548 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 163/322] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:39.570252 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2d145-5da2-4cd9-a52b-a89620b977d7 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:39.696267 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b4d90-2884-4e19-818e-1feee8ac3c77 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:39.697732 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b4d90-2884-4e19-818e-1feee8ac3c77 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:39.698547 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b4d90-2884-4e19-818e-1feee8ac3c77 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:39.703460 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 164/323] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:39.722748 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c1883-212b-4dd5-9f80-7032284840f9 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:39.724471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c1883-212b-4dd5-9f80-7032284840f9 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:39.725234 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c1883-212b-4dd5-9f80-7032284840f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:39.761717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-8e1c1883-212b-4dd5-9f80-7032284840f9 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:39.764740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-8e1c1883-212b-4dd5-9f80-7032284840f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:39.772913 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2d145-5da2-4cd9-a52b-a89620b977d7 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:39.820577 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:39.843094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da4851-f26c-4b06-ad2c-cec372f38bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:39.844734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da4851-f26c-4b06-ad2c-cec372f38bb0 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:39.845484 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da4851-f26c-4b06-ad2c-cec372f38bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:39.846149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da4851-f26c-4b06-ad2c-cec372f38bb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:39.847965 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da4851-f26c-4b06-ad2c-cec372f38bb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:39.849996 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da4851-f26c-4b06-ad2c-cec372f38bb0 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:39.852327 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 160/324] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:34:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:39.861482 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da4851-f26c-4b06-ad2c-cec372f38bb0 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:39.909142 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 165/325] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:39.941990 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c1883-212b-4dd5-9f80-7032284840f9 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:40.062895 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da4851-f26c-4b06-ad2c-cec372f38bb0 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:40.143912 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8609a-ba04-4cb3-b81a-509e89b60278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:40.144811 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8609a-ba04-4cb3-b81a-509e89b60278 None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:40.145265 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8609a-ba04-4cb3-b81a-509e89b60278 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:40.145731 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8609a-ba04-4cb3-b81a-509e89b60278 None admin] PATH_INFO: `/v3/groups` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:40.146817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f8609a-ba04-4cb3-b81a-509e89b60278 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:40.148583 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f8609a-ba04-4cb3-b81a-509e89b60278 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:40.173884 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 161/326] 10.222.0.94 () {60 vars in 1134 bytes} [Wed Aug 24 04:34:39 2022] POST /identity/v3/groups => generated 226 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:34:40.175827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c1883-212b-4dd5-9f80-7032284840f9 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:40.223136 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:40.235708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a16d6-20c1-4733-ba71-381f6e86b5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:40.236557 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a16d6-20c1-4733-ba71-381f6e86b5b4 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:40.237028 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a16d6-20c1-4733-ba71-381f6e86b5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:40.237439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a16d6-20c1-4733-ba71-381f6e86b5b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:40.252135 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a16d6-20c1-4733-ba71-381f6e86b5b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:40.257608 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-881a16d6-20c1-4733-ba71-381f6e86b5b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:34:40.257608 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:40.257608 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:40.257608 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:40.257608 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:40.257608 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:40.257608 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:40.257608 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:40.257608 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:40.257608 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:40.257608 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:40.257608 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:40.257608 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:40.257608 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:40.257608 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:40.257608 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:40.259391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:40.259391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:40.259391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:40.259391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:40.259391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:40.259391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:40.259391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:40.259391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:40.259391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:40.259391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:40.259391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:40.259391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:40.259391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:40.259391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:40.259391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:40.259391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:40.260396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:40.260396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:40.260396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:40.260396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:40.260396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:40.260396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:40.260396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:40.260396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:40.260396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:40.260396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:40.260396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:34:40.260396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:34:40.260396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 166/327] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:34:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:34:40.268302 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8609a-ba04-4cb3-b81a-509e89b60278 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:40.364743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a16d6-20c1-4733-ba71-381f6e86b5b4 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:40.380677 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:40.477584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8609a-ba04-4cb3-b81a-509e89b60278 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:40.545328 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5e22e-4d17-4ea0-91d3-ff12f37faf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:40.546707 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5e22e-4d17-4ea0-91d3-ff12f37faf21 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:40.546882 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5e22e-4d17-4ea0-91d3-ff12f37faf21 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:40.547817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5e22e-4d17-4ea0-91d3-ff12f37faf21 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:40.549027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5e22e-4d17-4ea0-91d3-ff12f37faf21 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:40.549761 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5e22e-4d17-4ea0-91d3-ff12f37faf21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:40.552260 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5e22e-4d17-4ea0-91d3-ff12f37faf21 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:40.573096 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 162/328] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:34:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:34:40.585770 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5e22e-4d17-4ea0-91d3-ff12f37faf21 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:40.605297 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a16d6-20c1-4733-ba71-381f6e86b5b4 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:40.687550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52633a6d-c15f-4c05-8b1c-5411cf300d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:40.690084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52633a6d-c15f-4c05-8b1c-5411cf300d4c None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:40.691063 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52633a6d-c15f-4c05-8b1c-5411cf300d4c None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:40.691718 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52633a6d-c15f-4c05-8b1c-5411cf300d4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:40.728406 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52633a6d-c15f-4c05-8b1c-5411cf300d4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:40.740670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-52633a6d-c15f-4c05-8b1c-5411cf300d4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:34:40.740670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:40.740670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:40.740670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:40.740670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:40.740670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:40.740670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:40.740670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:40.740670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:40.740670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:40.740670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:40.740670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:40.740670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:40.740670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:40.740670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:40.740670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:40.742481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:40.742481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:40.742481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:40.742481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:40.742481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:40.742481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:40.742481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:40.742481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:40.742481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:40.742481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:40.742481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:40.742481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:40.742481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:40.742481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:40.742481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:40.742481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:40.746697 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:40.746697 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:40.746697 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:40.746697 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:40.746697 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:40.746697 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:40.746697 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:40.746697 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:40.746697 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:40.746697 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:40.746697 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:34:40.746697 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:34:40.746697 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 167/329] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:34:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:34:40.755119 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52633a6d-c15f-4c05-8b1c-5411cf300d4c None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:40.837224 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5e22e-4d17-4ea0-91d3-ff12f37faf21 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:40.872884 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:40.876042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:40.920020 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1250d-8a2b-43e1-bde8-f5cf81c72dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:40.921234 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1250d-8a2b-43e1-bde8-f5cf81c72dc8 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:40.921785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1250d-8a2b-43e1-bde8-f5cf81c72dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:40.922398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1250d-8a2b-43e1-bde8-f5cf81c72dc8 None admin] PATH_INFO: `/v3/users/02b639206b654bd688dd524e06055b8e` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:40.925887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1250d-8a2b-43e1-bde8-f5cf81c72dc8 None admin] RBAC: Authorizing `identity:get_user(user_id=02b639206b654bd688dd524e06055b8e)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:40.928724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1250d-8a2b-43e1-bde8-f5cf81c72dc8 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:40.932342 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 163/330] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:34:40 2022] GET /identity/v3/users/02b639206b654bd688dd524e06055b8e => generated 293 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:40.944418 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1250d-8a2b-43e1-bde8-f5cf81c72dc8 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:41.020322 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52633a6d-c15f-4c05-8b1c-5411cf300d4c None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:41.114434 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53898b34-0c29-458a-8dfb-9b4e80c51b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:41.115451 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53898b34-0c29-458a-8dfb-9b4e80c51b41 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:41.115950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53898b34-0c29-458a-8dfb-9b4e80c51b41 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:41.116408 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53898b34-0c29-458a-8dfb-9b4e80c51b41 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:41.117621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53898b34-0c29-458a-8dfb-9b4e80c51b41 None admin] RBAC: Adding query filter params (name=member) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:41.118144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53898b34-0c29-458a-8dfb-9b4e80c51b41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:41.120748 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53898b34-0c29-458a-8dfb-9b4e80c51b41 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:41.139063 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 168/331] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:34:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:41.150934 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53898b34-0c29-458a-8dfb-9b4e80c51b41 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:41.217348 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1250d-8a2b-43e1-bde8-f5cf81c72dc8 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:41.304763 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821776bd-b315-462c-b0a9-e4a8a6808f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:41.305875 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821776bd-b315-462c-b0a9-e4a8a6808f08 None admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:41.306398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821776bd-b315-462c-b0a9-e4a8a6808f08 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:41.306892 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821776bd-b315-462c-b0a9-e4a8a6808f08 None admin] PATH_INFO: `/v3/system/users/02b639206b654bd688dd524e06055b8e/roles/28bafe05b4a44e89a89bdd6806d44ac5` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:41.309656 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821776bd-b315-462c-b0a9-e4a8a6808f08 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=02b639206b654bd688dd524e06055b8e, role_id=28bafe05b4a44e89a89bdd6806d44ac5)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:41.311854 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821776bd-b315-462c-b0a9-e4a8a6808f08 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:41.331943 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 164/332] 10.222.0.94 () {58 vars in 1334 bytes} [Wed Aug 24 04:34:40 2022] PUT /identity/v3/system/users/02b639206b654bd688dd524e06055b8e/roles/28bafe05b4a44e89a89bdd6806d44ac5 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:34:41.396543 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53898b34-0c29-458a-8dfb-9b4e80c51b41 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:41.412392 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:41.461337 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3aaeb-8722-41ca-951e-c9e140147fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:41.462663 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3aaeb-8722-41ca-951e-c9e140147fb0 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:41.463152 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3aaeb-8722-41ca-951e-c9e140147fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:41.463616 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3aaeb-8722-41ca-951e-c9e140147fb0 None admin] PATH_INFO: `/v3/users/2393ab3a7e2b4c31b40e04b514624330` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:41.466126 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3aaeb-8722-41ca-951e-c9e140147fb0 None admin] RBAC: Authorizing `identity:get_user(user_id=2393ab3a7e2b4c31b40e04b514624330)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:41.469720 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3aaeb-8722-41ca-951e-c9e140147fb0 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:41.473674 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 169/333] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:34:41 2022] GET /identity/v3/users/2393ab3a7e2b4c31b40e04b514624330 => generated 293 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:41.483082 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821776bd-b315-462c-b0a9-e4a8a6808f08 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:41.582964 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:41.710296 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821776bd-b315-462c-b0a9-e4a8a6808f08 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:41.792353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c85d3d-aec6-4632-8dae-44ad1fb6f7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:41.793595 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c85d3d-aec6-4632-8dae-44ad1fb6f7dd None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:41.794102 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c85d3d-aec6-4632-8dae-44ad1fb6f7dd None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:41.794638 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c85d3d-aec6-4632-8dae-44ad1fb6f7dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:41.795943 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c85d3d-aec6-4632-8dae-44ad1fb6f7dd None admin] RBAC: Adding query filter params (role.id=1a586b803a1e429f82b85f386d7564fb, user.id=2393ab3a7e2b4c31b40e04b514624330, scope.system=all) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:41.796499 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c85d3d-aec6-4632-8dae-44ad1fb6f7dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:41.799370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c85d3d-aec6-4632-8dae-44ad1fb6f7dd None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:41.834002 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 165/334] 10.222.0.94 () {56 vars in 1308 bytes} [Wed Aug 24 04:34:41 2022] GET /identity/v3/role_assignments?user.id=2393ab3a7e2b4c31b40e04b514624330&scope.system=all&role.id=1a586b803a1e429f82b85f386d7564fb => generated 510 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:44.572860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272410d-64fb-4784-bac2-9a4fb0f9635c None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:44.573740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272410d-64fb-4784-bac2-9a4fb0f9635c None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:44.573740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272410d-64fb-4784-bac2-9a4fb0f9635c None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:44.575335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 170/335] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:44.584536 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c984516-3708-4eb6-95bb-3364d3d8c6e5 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:44.585146 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c984516-3708-4eb6-95bb-3364d3d8c6e5 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:44.585593 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c984516-3708-4eb6-95bb-3364d3d8c6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:44.618627 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-5c984516-3708-4eb6-95bb-3364d3d8c6e5 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:44.619994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-5c984516-3708-4eb6-95bb-3364d3d8c6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:44.782532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 166/336] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:44.963088 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a20fb-e8d8-401b-bcc0-f3d9c8f7376a None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:44.963474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a20fb-e8d8-401b-bcc0-f3d9c8f7376a None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:44.963965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a20fb-e8d8-401b-bcc0-f3d9c8f7376a None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:44.967271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 171/337] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:44.975760 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024efb2-3db8-437a-8adf-d636828c684b None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:44.976266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024efb2-3db8-437a-8adf-d636828c684b None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:44.976774 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024efb2-3db8-437a-8adf-d636828c684b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:45.018588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-d024efb2-3db8-437a-8adf-d636828c684b None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:45.020711 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-d024efb2-3db8-437a-8adf-d636828c684b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:45.097381 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:45.183299 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 167/338] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:45.557304 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a20fb-e8d8-401b-bcc0-f3d9c8f7376a None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:45.808644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a20fb-e8d8-401b-bcc0-f3d9c8f7376a None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:45.879971 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608c210-2481-4e38-8f10-b032ba11f264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:45.881099 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608c210-2481-4e38-8f10-b032ba11f264 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:45.881624 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608c210-2481-4e38-8f10-b032ba11f264 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:45.882125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608c210-2481-4e38-8f10-b032ba11f264 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:45.908576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608c210-2481-4e38-8f10-b032ba11f264 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:45.918012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-1608c210-2481-4e38-8f10-b032ba11f264 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:34:45.918012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:45.918012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:45.918012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:45.918012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:45.918012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:45.918012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:45.918012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:45.918012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:45.918012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:45.918012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:45.918012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:45.918012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:45.918012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:45.918012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:45.918012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:45.919794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:45.919794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:45.919794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:45.919794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:45.919794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:45.919794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:45.919794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:45.919794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:45.919794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:45.919794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:45.919794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:45.919794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:45.919794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:45.919794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:45.919794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:45.919794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:45.923620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:45.923620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:45.923620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:45.923620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:45.923620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:45.923620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:45.923620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:45.923620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:45.923620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:45.923620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:45.923620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:34:45.923620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:34:45.923620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 172/339] 10.222.0.94 () {56 vars in 1114 bytes} [Wed Aug 24 04:34:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:45.930552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024efb2-3db8-437a-8adf-d636828c684b None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:46.167327 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608c210-2481-4e38-8f10-b032ba11f264 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:46.173255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024efb2-3db8-437a-8adf-d636828c684b None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:46.249744 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8870f-d6ad-4d7e-917b-61e66156e3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:46.250070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:46.251629 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8870f-d6ad-4d7e-917b-61e66156e3df None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:46.252475 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8870f-d6ad-4d7e-917b-61e66156e3df None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:46.253272 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8870f-d6ad-4d7e-917b-61e66156e3df None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:46.255020 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8870f-d6ad-4d7e-917b-61e66156e3df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:46.255931 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8870f-d6ad-4d7e-917b-61e66156e3df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:46.259045 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8870f-d6ad-4d7e-917b-61e66156e3df None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:46.278816 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 168/340] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:34:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:46.292335 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8870f-d6ad-4d7e-917b-61e66156e3df None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:46.413023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:46.524684 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608c210-2481-4e38-8f10-b032ba11f264 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:46.620749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8870f-d6ad-4d7e-917b-61e66156e3df None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:46.647464 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106b854-81e0-4d49-a7ff-8de1f5e8a7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:46.648480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106b854-81e0-4d49-a7ff-8de1f5e8a7cf None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:46.648938 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106b854-81e0-4d49-a7ff-8de1f5e8a7cf None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:46.649393 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106b854-81e0-4d49-a7ff-8de1f5e8a7cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:46.675772 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75552a-ca6d-44e7-a7ae-64f4600052f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:46.676420 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75552a-ca6d-44e7-a7ae-64f4600052f5 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:46.676707 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75552a-ca6d-44e7-a7ae-64f4600052f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:46.676996 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75552a-ca6d-44e7-a7ae-64f4600052f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:46.691921 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106b854-81e0-4d49-a7ff-8de1f5e8a7cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:46.701818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-3106b854-81e0-4d49-a7ff-8de1f5e8a7cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:34:46.701818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:46.701818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:46.701818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:46.701818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:46.701818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:46.701818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:46.701818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:46.701818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:46.701818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:46.701818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:46.701818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:46.701818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:46.701818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:46.701818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:46.701818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:46.703695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:46.703695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:46.703695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:46.703695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:46.703695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:46.703695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:46.703695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:46.703695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:46.703695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:46.703695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:46.703695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:46.703695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:46.703695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:46.703695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:46.703695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:46.703695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:46.705834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:46.705834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:46.705834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:46.705834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:46.705834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:46.705834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:46.705834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:46.705834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:46.705834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:46.705834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:46.705834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:34:46.705834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:34:46.705834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 173/341] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:34:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 539 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:46.711978 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bbcdd-d3dc-46ef-b23d-233075eb1489 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:46.712439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bbcdd-d3dc-46ef-b23d-233075eb1489 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:46.712892 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bbcdd-d3dc-46ef-b23d-233075eb1489 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:46.725361 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 174/342] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:46 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:46.725361 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bbcdd-d3dc-46ef-b23d-233075eb1489 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:46.867624 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75552a-ca6d-44e7-a7ae-64f4600052f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:46.870114 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75552a-ca6d-44e7-a7ae-64f4600052f5 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:46.982521 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:47.000817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:47.010652 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bbcdd-d3dc-46ef-b23d-233075eb1489 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:47.119652 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d07d4b-b409-4150-90ec-f66d4986f0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:47.120659 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d07d4b-b409-4150-90ec-f66d4986f0cd None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:47.121180 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d07d4b-b409-4150-90ec-f66d4986f0cd None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:47.123204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d07d4b-b409-4150-90ec-f66d4986f0cd None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:47.124461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d07d4b-b409-4150-90ec-f66d4986f0cd None admin] RBAC: Adding query filter params (name=member) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:47.125569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d07d4b-b409-4150-90ec-f66d4986f0cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:47.128263 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d07d4b-b409-4150-90ec-f66d4986f0cd None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:47.149533 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 175/343] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:34:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:47.152002 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cba6f-1bae-46b9-acab-d9a3900b585c None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:47.152446 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cba6f-1bae-46b9-acab-d9a3900b585c None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:47.153862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cba6f-1bae-46b9-acab-d9a3900b585c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:47.187634 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-af0cba6f-1bae-46b9-acab-d9a3900b585c None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:47.189870 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-af0cba6f-1bae-46b9-acab-d9a3900b585c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:47.297569 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 169/344] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:34:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1000 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:47.299659 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e851a-e276-49ad-a3ef-44e2ee1bf649 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:47.300209 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e851a-e276-49ad-a3ef-44e2ee1bf649 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:47.300648 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e851a-e276-49ad-a3ef-44e2ee1bf649 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:47.308467 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 170/345] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:47.308467 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e851a-e276-49ad-a3ef-44e2ee1bf649 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:47.366658 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 176/346] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:47.367633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cba6f-1bae-46b9-acab-d9a3900b585c None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:47.584195 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e851a-e276-49ad-a3ef-44e2ee1bf649 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:47.613154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:47.641709 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:47.649818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cba6f-1bae-46b9-acab-d9a3900b585c None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:47.675180 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4a517-18b1-45e2-96ad-4c02aa0a3223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:47.676577 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4a517-18b1-45e2-96ad-4c02aa0a3223 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:47.677238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4a517-18b1-45e2-96ad-4c02aa0a3223 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:47.678048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4a517-18b1-45e2-96ad-4c02aa0a3223 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:47.762482 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7fe88-7a0d-43d8-a31a-05e753b2fb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:47.763631 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7fe88-7a0d-43d8-a31a-05e753b2fb66 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:47.763631 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7fe88-7a0d-43d8-a31a-05e753b2fb66 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:47.764072 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7fe88-7a0d-43d8-a31a-05e753b2fb66 None admin] PATH_INFO: `/v3/projects/43dfbfd1802b436791f73a286898fd0a` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:47.768036 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7fe88-7a0d-43d8-a31a-05e753b2fb66 None admin] RBAC: Authorizing `identity:get_project(project_id=43dfbfd1802b436791f73a286898fd0a)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:47.773033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7fe88-7a0d-43d8-a31a-05e753b2fb66 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:47.776812 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 177/347] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:47 2022] GET /identity/v3/projects/43dfbfd1802b436791f73a286898fd0a => generated 298 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:47.784789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9948a-adb6-4a41-ab58-1b26b287ddb9 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:47.784789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9948a-adb6-4a41-ab58-1b26b287ddb9 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:47.784789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9948a-adb6-4a41-ab58-1b26b287ddb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:47.825829 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-fda9948a-adb6-4a41-ab58-1b26b287ddb9 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:47.828106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-fda9948a-adb6-4a41-ab58-1b26b287ddb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:47.866808 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4a517-18b1-45e2-96ad-4c02aa0a3223 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:47.870887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4a517-18b1-45e2-96ad-4c02aa0a3223 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:48.005906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 178/348] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:48.008239 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582a72c-1797-4917-84b2-9bf4ae1100d2 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:48.008755 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582a72c-1797-4917-84b2-9bf4ae1100d2 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:48.009262 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582a72c-1797-4917-84b2-9bf4ae1100d2 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:48.012162 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 179/349] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:48.013480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582a72c-1797-4917-84b2-9bf4ae1100d2 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:48.093661 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 171/350] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:34:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 790 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:48.095680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4a517-18b1-45e2-96ad-4c02aa0a3223 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:48.166153 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:48.233268 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:48.283888 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582a72c-1797-4917-84b2-9bf4ae1100d2 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:48.345993 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4a517-18b1-45e2-96ad-4c02aa0a3223 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:48.363302 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5dc01-36d4-46a9-b6c8-0608058300d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:48.364771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5dc01-36d4-46a9-b6c8-0608058300d7 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:48.365514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5dc01-36d4-46a9-b6c8-0608058300d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:48.366244 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5dc01-36d4-46a9-b6c8-0608058300d7 None admin] PATH_INFO: `/v3/groups/da03d38c6f0e4724881c4babc6a4d2e4` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:48.381309 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5dc01-36d4-46a9-b6c8-0608058300d7 None admin] RBAC: Authorizing `identity:get_group(group_id=da03d38c6f0e4724881c4babc6a4d2e4)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:48.383479 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5dc01-36d4-46a9-b6c8-0608058300d7 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:48.385453 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 180/351] 10.222.0.94 () {56 vars in 1180 bytes} [Wed Aug 24 04:34:48 2022] GET /identity/v3/groups/da03d38c6f0e4724881c4babc6a4d2e4 => generated 226 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:48.386798 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54a78b-937b-4a19-a6aa-bdd250e5ac0d None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:48.387159 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54a78b-937b-4a19-a6aa-bdd250e5ac0d None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:48.387660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54a78b-937b-4a19-a6aa-bdd250e5ac0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:48.417095 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-7f54a78b-937b-4a19-a6aa-bdd250e5ac0d None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:48.418422 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-7f54a78b-937b-4a19-a6aa-bdd250e5ac0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:48.425185 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44b8d8-32cb-4bac-9b67-9ce8ff436520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:48.426898 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44b8d8-32cb-4bac-9b67-9ce8ff436520 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:48.427721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44b8d8-32cb-4bac-9b67-9ce8ff436520 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:48.428499 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44b8d8-32cb-4bac-9b67-9ce8ff436520 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:48.455535 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44b8d8-32cb-4bac-9b67-9ce8ff436520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:48.464293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-ed44b8d8-32cb-4bac-9b67-9ce8ff436520 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:34:48.464293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:48.464293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:48.464293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:48.464293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:48.464293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:48.464293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:48.464293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:48.464293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:48.464293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:48.464293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:48.464293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:48.464293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:48.464293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:48.464293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:48.464293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:48.466750 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:48.466750 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:48.466750 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:48.466750 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:48.466750 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:48.466750 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:48.466750 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:48.466750 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:48.466750 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:48.466750 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:48.466750 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:48.466750 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:48.466750 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:48.466750 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:48.466750 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:48.466750 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:48.468205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:48.468205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:48.468205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:48.468205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:48.468205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:48.468205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:48.468205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:48.468205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:48.468205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:48.468205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:48.468205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:34:48.468205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:34:48.468205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 172/352] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:34:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:48.468205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44b8d8-32cb-4bac-9b67-9ce8ff436520 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:48.574430 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 181/353] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:48.576105 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be69807-0a87-44dd-b1de-d0f9776efa5c None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:48.576539 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be69807-0a87-44dd-b1de-d0f9776efa5c None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:48.576851 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be69807-0a87-44dd-b1de-d0f9776efa5c None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:48.579611 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 182/354] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:48.580715 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be69807-0a87-44dd-b1de-d0f9776efa5c None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:48.662411 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:48.692340 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44b8d8-32cb-4bac-9b67-9ce8ff436520 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:48.739887 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:48.758269 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e1e5b-e5b3-4a39-bdd6-8d730c857d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:48.759202 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e1e5b-e5b3-4a39-bdd6-8d730c857d2d None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:48.759540 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e1e5b-e5b3-4a39-bdd6-8d730c857d2d None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:48.759894 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e1e5b-e5b3-4a39-bdd6-8d730c857d2d None admin] PATH_INFO: `/v3/projects/43dfbfd1802b436791f73a286898fd0a` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:48.761663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e1e5b-e5b3-4a39-bdd6-8d730c857d2d None admin] RBAC: Authorizing `identity:get_project(project_id=43dfbfd1802b436791f73a286898fd0a)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:48.763563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e1e5b-e5b3-4a39-bdd6-8d730c857d2d None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:48.766296 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 173/355] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:48 2022] GET /identity/v3/projects/43dfbfd1802b436791f73a286898fd0a => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:48.767591 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e1e5b-e5b3-4a39-bdd6-8d730c857d2d None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:48.783532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be69807-0a87-44dd-b1de-d0f9776efa5c None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:48.883618 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca7bb5-b4bd-491b-8c57-e13c26c57b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:48.884639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca7bb5-b4bd-491b-8c57-e13c26c57b0b None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:48.885121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca7bb5-b4bd-491b-8c57-e13c26c57b0b None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:48.885708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca7bb5-b4bd-491b-8c57-e13c26c57b0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:48.887138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca7bb5-b4bd-491b-8c57-e13c26c57b0b None admin] RBAC: Adding query filter params (group.id=da03d38c6f0e4724881c4babc6a4d2e4, role.id=f08394a5dbcf4506a17b78b4416f1680, scope.project.id=43dfbfd1802b436791f73a286898fd0a) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:48.887673 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca7bb5-b4bd-491b-8c57-e13c26c57b0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:48.891256 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca7bb5-b4bd-491b-8c57-e13c26c57b0b None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:48.909540 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 183/356] 10.222.0.94 () {56 vars in 1376 bytes} [Wed Aug 24 04:34:48 2022] GET /identity/v3/role_assignments?group.id=da03d38c6f0e4724881c4babc6a4d2e4&scope.project.id=43dfbfd1802b436791f73a286898fd0a&role.id=f08394a5dbcf4506a17b78b4416f1680 => generated 260 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:48.909540 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca7bb5-b4bd-491b-8c57-e13c26c57b0b None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:49.009613 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e1e5b-e5b3-4a39-bdd6-8d730c857d2d None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:49.093105 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0581040-ed21-4830-b0b3-72e6c4b96977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:49.094563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0581040-ed21-4830-b0b3-72e6c4b96977 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:49.095440 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0581040-ed21-4830-b0b3-72e6c4b96977 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:49.095440 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0581040-ed21-4830-b0b3-72e6c4b96977 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:49.096913 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0581040-ed21-4830-b0b3-72e6c4b96977 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:49.097458 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0581040-ed21-4830-b0b3-72e6c4b96977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:49.100028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0581040-ed21-4830-b0b3-72e6c4b96977 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:49.120507 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 174/357] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:34:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:49.123320 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626e4e2-9867-49ed-8f50-838925f487ab None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:49.123817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626e4e2-9867-49ed-8f50-838925f487ab None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:49.124283 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626e4e2-9867-49ed-8f50-838925f487ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:49.163825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-4626e4e2-9867-49ed-8f50-838925f487ab None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:49.166103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-4626e4e2-9867-49ed-8f50-838925f487ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:49.184049 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca7bb5-b4bd-491b-8c57-e13c26c57b0b None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:49.190899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:49.272732 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01b07e-e933-4b56-8790-a00a205a98e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:49.274372 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01b07e-e933-4b56-8790-a00a205a98e1 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:49.275249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01b07e-e933-4b56-8790-a00a205a98e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:49.276004 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01b07e-e933-4b56-8790-a00a205a98e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:49.304244 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01b07e-e933-4b56-8790-a00a205a98e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:49.314800 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-8e01b07e-e933-4b56-8790-a00a205a98e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:34:49.314800 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:49.314800 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:49.314800 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:49.314800 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:49.314800 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:49.314800 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:49.314800 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:49.314800 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:49.314800 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:49.314800 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:49.314800 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:49.314800 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:49.314800 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:49.314800 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:49.314800 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:49.316420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:49.316420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:49.316420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:49.316420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:49.316420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:49.316420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:49.316420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:49.316420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:49.316420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:49.316420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:49.316420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:49.316420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:49.316420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:49.316420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:49.316420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:49.316420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:49.318042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:49.318042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:49.318042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:49.318042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:49.318042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:49.318042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:49.318042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:49.318042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:49.318042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:49.318042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:49.318042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:34:49.318042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:34:49.318042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 184/358] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:34:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:49.320690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01b07e-e933-4b56-8790-a00a205a98e1 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:49.331447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:49.357657 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 175/359] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:49.360014 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626e4e2-9867-49ed-8f50-838925f487ab None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:49.616540 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01b07e-e933-4b56-8790-a00a205a98e1 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:49.628779 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626e4e2-9867-49ed-8f50-838925f487ab None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:49.704615 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4307c49-ecd8-4aac-95a4-da0ea4061304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:49.706097 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4307c49-ecd8-4aac-95a4-da0ea4061304 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:49.706829 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4307c49-ecd8-4aac-95a4-da0ea4061304 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:49.707460 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4307c49-ecd8-4aac-95a4-da0ea4061304 None admin] PATH_INFO: `/v3/groups/da03d38c6f0e4724881c4babc6a4d2e4` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:49.709886 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4307c49-ecd8-4aac-95a4-da0ea4061304 None admin] RBAC: Authorizing `identity:get_group(group_id=da03d38c6f0e4724881c4babc6a4d2e4)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:49.715951 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4307c49-ecd8-4aac-95a4-da0ea4061304 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:49.725491 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 185/360] 10.222.0.94 () {56 vars in 1180 bytes} [Wed Aug 24 04:34:49 2022] GET /identity/v3/groups/da03d38c6f0e4724881c4babc6a4d2e4 => generated 226 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:49.725491 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4307c49-ecd8-4aac-95a4-da0ea4061304 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:49.738123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef937d6-f739-412a-9db2-1d2461c0319e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:49.739696 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef937d6-f739-412a-9db2-1d2461c0319e None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:49.740462 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef937d6-f739-412a-9db2-1d2461c0319e None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:49.741201 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef937d6-f739-412a-9db2-1d2461c0319e None admin] PATH_INFO: `/v3/users/02b639206b654bd688dd524e06055b8e` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:49.744057 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef937d6-f739-412a-9db2-1d2461c0319e None admin] RBAC: Authorizing `identity:get_user(user_id=02b639206b654bd688dd524e06055b8e)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:49.747823 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef937d6-f739-412a-9db2-1d2461c0319e None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:49.752107 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 176/361] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:34:49 2022] GET /identity/v3/users/02b639206b654bd688dd524e06055b8e => generated 293 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:49.753930 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef937d6-f739-412a-9db2-1d2461c0319e None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:49.793088 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:49.907417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:49.973858 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4307c49-ecd8-4aac-95a4-da0ea4061304 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:49.994409 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef937d6-f739-412a-9db2-1d2461c0319e None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:50.053031 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b9acf-7519-467d-b5c2-c267100b96c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:50.054227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b9acf-7519-467d-b5c2-c267100b96c8 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:50.054673 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b9acf-7519-467d-b5c2-c267100b96c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:50.055167 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b9acf-7519-467d-b5c2-c267100b96c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:50.068156 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acddc14-430e-4c3a-a87c-57a1b2554d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:50.070093 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acddc14-430e-4c3a-a87c-57a1b2554d8e None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:50.071063 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acddc14-430e-4c3a-a87c-57a1b2554d8e None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:50.071752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acddc14-430e-4c3a-a87c-57a1b2554d8e None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:50.073041 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acddc14-430e-4c3a-a87c-57a1b2554d8e None admin] RBAC: Adding query filter params (name=member) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:50.073916 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acddc14-430e-4c3a-a87c-57a1b2554d8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:50.077248 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acddc14-430e-4c3a-a87c-57a1b2554d8e None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:50.086386 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b9acf-7519-467d-b5c2-c267100b96c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:50.096333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-b65b9acf-7519-467d-b5c2-c267100b96c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:34:50.096333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:50.096333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:50.096333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:50.096333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:50.096333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:50.096333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:50.096333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:50.096333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:50.096333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:50.096333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:50.096333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:50.096333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:50.096333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:50.096333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:50.096333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:50.098164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:50.098164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:50.098164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:50.098164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:50.098164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:50.098164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:50.098164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:50.098164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:50.098164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:50.098164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:50.098164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:50.098164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:50.098164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:50.098164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:50.098164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:50.098164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:50.099570 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:50.099570 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:50.099570 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:50.099570 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:50.099570 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:50.099570 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:50.099570 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:50.099570 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:50.099570 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:50.099570 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:50.099570 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:34:50.099570 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:34:50.100568 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 177/362] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:34:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:50.100568 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acddc14-430e-4c3a-a87c-57a1b2554d8e None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:50.102558 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 186/363] 10.222.0.94 () {56 vars in 1114 bytes} [Wed Aug 24 04:34:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:50.111147 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b9acf-7519-467d-b5c2-c267100b96c8 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:50.282349 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:50.321421 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acddc14-430e-4c3a-a87c-57a1b2554d8e None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:50.349118 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b9acf-7519-467d-b5c2-c267100b96c8 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:50.386514 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f2e7e-65f5-4738-83df-6fb33b5087d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:50.387591 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f2e7e-65f5-4738-83df-6fb33b5087d0 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:50.388102 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f2e7e-65f5-4738-83df-6fb33b5087d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:50.388702 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f2e7e-65f5-4738-83df-6fb33b5087d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:50.390731 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f2e7e-65f5-4738-83df-6fb33b5087d0 None admin] RBAC: Adding query filter params (group.id=da03d38c6f0e4724881c4babc6a4d2e4, role.id=1a586b803a1e429f82b85f386d7564fb, scope.project.id=43dfbfd1802b436791f73a286898fd0a) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:50.391308 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f2e7e-65f5-4738-83df-6fb33b5087d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:50.394315 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f2e7e-65f5-4738-83df-6fb33b5087d0 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:50.398246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:50.417457 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 178/364] 10.222.0.94 () {56 vars in 1376 bytes} [Wed Aug 24 04:34:50 2022] GET /identity/v3/role_assignments?group.id=da03d38c6f0e4724881c4babc6a4d2e4&scope.project.id=43dfbfd1802b436791f73a286898fd0a&role.id=1a586b803a1e429f82b85f386d7564fb => generated 260 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:50.417728 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6a4ff-13bd-401c-a6c1-d52b1d35c318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:50.417728 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6a4ff-13bd-401c-a6c1-d52b1d35c318 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:50.417728 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6a4ff-13bd-401c-a6c1-d52b1d35c318 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:50.418134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f2e7e-65f5-4738-83df-6fb33b5087d0 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:50.418313 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6a4ff-13bd-401c-a6c1-d52b1d35c318 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:50.418313 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6a4ff-13bd-401c-a6c1-d52b1d35c318 None admin] RBAC: Adding query filter params (role.id=28bafe05b4a44e89a89bdd6806d44ac5, user.id=02b639206b654bd688dd524e06055b8e, scope.system=all) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:50.418313 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6a4ff-13bd-401c-a6c1-d52b1d35c318 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:50.418313 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6a4ff-13bd-401c-a6c1-d52b1d35c318 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:50.441822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 187/365] 10.222.0.94 () {56 vars in 1308 bytes} [Wed Aug 24 04:34:50 2022] GET /identity/v3/role_assignments?user.id=02b639206b654bd688dd524e06055b8e&scope.system=all&role.id=28bafe05b4a44e89a89bdd6806d44ac5 => generated 510 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:50.443774 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6a4ff-13bd-401c-a6c1-d52b1d35c318 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:50.715290 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6a4ff-13bd-401c-a6c1-d52b1d35c318 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:50.775212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f2e7e-65f5-4738-83df-6fb33b5087d0 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:50.798273 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6d8ae-8266-4002-a8d1-ceccf668e2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:50.799478 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6d8ae-8266-4002-a8d1-ceccf668e2ca None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:50.799847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6d8ae-8266-4002-a8d1-ceccf668e2ca None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:50.802158 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6d8ae-8266-4002-a8d1-ceccf668e2ca None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:50.805359 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6d8ae-8266-4002-a8d1-ceccf668e2ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:50.806460 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6d8ae-8266-4002-a8d1-ceccf668e2ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:50.810786 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6d8ae-8266-4002-a8d1-ceccf668e2ca None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:50.832408 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 188/366] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:34:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:50.834977 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6d8ae-8266-4002-a8d1-ceccf668e2ca None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:50.861343 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdee14-a696-4bf7-aa57-5f6334d82a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:50.862125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdee14-a696-4bf7-aa57-5f6334d82a99 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:50.862601 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdee14-a696-4bf7-aa57-5f6334d82a99 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:50.863055 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdee14-a696-4bf7-aa57-5f6334d82a99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:50.888319 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:50.893062 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cdee14-a696-4bf7-aa57-5f6334d82a99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:50.907212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-45cdee14-a696-4bf7-aa57-5f6334d82a99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:34:50.907212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:50.907212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:50.907212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:50.907212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:50.907212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:50.907212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:50.907212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:50.907212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:50.907212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:50.907212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:50.907212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:50.907212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:50.907212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:50.907212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:50.907212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:50.909000 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:50.909000 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:50.909000 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:50.909000 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:50.909000 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:50.909000 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:50.909000 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:50.909000 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:50.909000 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:50.909000 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:50.909000 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:50.909000 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:50.909000 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:50.909000 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:50.909000 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:50.909000 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:50.910713 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:50.910713 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:50.910713 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:50.910713 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:50.910713 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:50.910713 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:50.910713 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:50.910713 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:50.910713 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:50.910713 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:50.910713 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:34:50.910713 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:34:50.910713 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 179/367] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:34:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 502 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:50.914335 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdee14-a696-4bf7-aa57-5f6334d82a99 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:51.022455 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:51.129359 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdee14-a696-4bf7-aa57-5f6334d82a99 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:51.141220 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6d8ae-8266-4002-a8d1-ceccf668e2ca None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:51.199800 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa1c70-e6c0-4714-8d2e-cf842adcf8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:51.201355 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa1c70-e6c0-4714-8d2e-cf842adcf8a9 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:51.201355 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa1c70-e6c0-4714-8d2e-cf842adcf8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:51.202122 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa1c70-e6c0-4714-8d2e-cf842adcf8a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:51.217217 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2dc56-87eb-4db3-9077-05a5c19fd6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:51.219379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2dc56-87eb-4db3-9077-05a5c19fd6c6 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:51.220227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2dc56-87eb-4db3-9077-05a5c19fd6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:51.221110 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2dc56-87eb-4db3-9077-05a5c19fd6c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:51.345358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:51.351134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa1c70-e6c0-4714-8d2e-cf842adcf8a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:51.354239 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa1c70-e6c0-4714-8d2e-cf842adcf8a9 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:51.381569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2dc56-87eb-4db3-9077-05a5c19fd6c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:51.385449 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2dc56-87eb-4db3-9077-05a5c19fd6c6 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:51.525468 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:51.572007 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 180/368] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:34:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:51.573755 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa1c70-e6c0-4714-8d2e-cf842adcf8a9 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:51.651005 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 189/369] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:34:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 817 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:51.661683 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2dc56-87eb-4db3-9077-05a5c19fd6c6 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:51.840104 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:51.847067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa1c70-e6c0-4714-8d2e-cf842adcf8a9 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:51.916147 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2dc56-87eb-4db3-9077-05a5c19fd6c6 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:51.933798 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa0935-e770-4d71-adba-024553a279d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:51.934806 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa0935-e770-4d71-adba-024553a279d6 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:51.935442 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa0935-e770-4d71-adba-024553a279d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:51.936112 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa0935-e770-4d71-adba-024553a279d6 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:51.937851 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa0935-e770-4d71-adba-024553a279d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:51.938599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa0935-e770-4d71-adba-024553a279d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:51.941711 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa0935-e770-4d71-adba-024553a279d6 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:51.965690 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 181/370] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:34:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:51.965690 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa0935-e770-4d71-adba-024553a279d6 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:52.011527 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3237260-9f2c-4f2d-b13b-9c0c084705d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:52.013111 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3237260-9f2c-4f2d-b13b-9c0c084705d5 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:52.014297 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3237260-9f2c-4f2d-b13b-9c0c084705d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:52.014933 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3237260-9f2c-4f2d-b13b-9c0c084705d5 None admin] PATH_INFO: `/v3/projects/82ce9b40374d42e880f6e6d06d93787e` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:52.018326 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3237260-9f2c-4f2d-b13b-9c0c084705d5 None admin] RBAC: Authorizing `identity:get_project(project_id=82ce9b40374d42e880f6e6d06d93787e)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:52.021587 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3237260-9f2c-4f2d-b13b-9c0c084705d5 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:52.029442 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 190/371] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:51 2022] GET /identity/v3/projects/82ce9b40374d42e880f6e6d06d93787e => generated 302 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:52.033616 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3237260-9f2c-4f2d-b13b-9c0c084705d5 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:52.070879 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:52.208079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa0935-e770-4d71-adba-024553a279d6 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:52.273252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3237260-9f2c-4f2d-b13b-9c0c084705d5 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:52.275614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3994b09-d031-4a30-8e34-cb2ff11e57de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:52.277094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3994b09-d031-4a30-8e34-cb2ff11e57de None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:52.278172 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3994b09-d031-4a30-8e34-cb2ff11e57de None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:52.279007 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3994b09-d031-4a30-8e34-cb2ff11e57de None admin] PATH_INFO: `/v3/projects/82ce9b40374d42e880f6e6d06d93787e` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:52.282447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3994b09-d031-4a30-8e34-cb2ff11e57de None admin] RBAC: Authorizing `identity:get_project(project_id=82ce9b40374d42e880f6e6d06d93787e)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:52.285433 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3994b09-d031-4a30-8e34-cb2ff11e57de None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:52.289928 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 182/372] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:51 2022] GET /identity/v3/projects/82ce9b40374d42e880f6e6d06d93787e => generated 302 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:52.292367 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3994b09-d031-4a30-8e34-cb2ff11e57de None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:52.346874 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:52.355680 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31493b15-d9db-4708-b9a3-cd8ae755195c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:52.356419 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31493b15-d9db-4708-b9a3-cd8ae755195c None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:52.356697 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31493b15-d9db-4708-b9a3-cd8ae755195c None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:52.357071 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31493b15-d9db-4708-b9a3-cd8ae755195c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:52.469274 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31493b15-d9db-4708-b9a3-cd8ae755195c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:52.471334 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31493b15-d9db-4708-b9a3-cd8ae755195c None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:52.481572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3994b09-d031-4a30-8e34-cb2ff11e57de None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:52.501248 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:52.550856 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895378f4-8d16-40fe-81d6-ac4d4de9e4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:52.551883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895378f4-8d16-40fe-81d6-ac4d4de9e4c4 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:52.552271 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895378f4-8d16-40fe-81d6-ac4d4de9e4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:52.552621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895378f4-8d16-40fe-81d6-ac4d4de9e4c4 None admin] PATH_INFO: `/v3/groups/da03d38c6f0e4724881c4babc6a4d2e4` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:52.554312 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895378f4-8d16-40fe-81d6-ac4d4de9e4c4 None admin] RBAC: Authorizing `identity:get_group(group_id=da03d38c6f0e4724881c4babc6a4d2e4)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:52.557009 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895378f4-8d16-40fe-81d6-ac4d4de9e4c4 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:52.565515 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 183/373] 10.222.0.94 () {56 vars in 1180 bytes} [Wed Aug 24 04:34:52 2022] GET /identity/v3/groups/da03d38c6f0e4724881c4babc6a4d2e4 => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:52.565515 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895378f4-8d16-40fe-81d6-ac4d4de9e4c4 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:52.656940 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 191/374] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:34:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:34:52.659778 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbb56f-74f2-49c6-a913-307cd958b6d0 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:52.660587 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbb56f-74f2-49c6-a913-307cd958b6d0 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:52.661616 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbb56f-74f2-49c6-a913-307cd958b6d0 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:52.664452 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 192/375] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:52.666348 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbb56f-74f2-49c6-a913-307cd958b6d0 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:52.762795 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:52.770575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895378f4-8d16-40fe-81d6-ac4d4de9e4c4 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:52.837078 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0186f-08ee-4637-9707-4f530bbc2109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:52.837927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0186f-08ee-4637-9707-4f530bbc2109 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:52.838375 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0186f-08ee-4637-9707-4f530bbc2109 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:52.838787 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0186f-08ee-4637-9707-4f530bbc2109 None admin] PATH_INFO: `/v3/groups/da03d38c6f0e4724881c4babc6a4d2e4` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:52.840297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0186f-08ee-4637-9707-4f530bbc2109 None admin] RBAC: Authorizing `identity:get_group(group_id=da03d38c6f0e4724881c4babc6a4d2e4)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:52.842685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0186f-08ee-4637-9707-4f530bbc2109 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:52.846958 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 184/376] 10.222.0.94 () {56 vars in 1180 bytes} [Wed Aug 24 04:34:52 2022] GET /identity/v3/groups/da03d38c6f0e4724881c4babc6a4d2e4 => generated 226 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:52.848068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0186f-08ee-4637-9707-4f530bbc2109 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:52.897515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbb56f-74f2-49c6-a913-307cd958b6d0 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:52.945632 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:52.970405 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd62b2d-07f7-4d27-b605-c757e7021db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:52.971036 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd62b2d-07f7-4d27-b605-c757e7021db2 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:52.971322 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd62b2d-07f7-4d27-b605-c757e7021db2 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:52.971599 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd62b2d-07f7-4d27-b605-c757e7021db2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:52.972355 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd62b2d-07f7-4d27-b605-c757e7021db2 None admin] RBAC: Adding query filter params (group.id=da03d38c6f0e4724881c4babc6a4d2e4, role.id=f08394a5dbcf4506a17b78b4416f1680, scope.project.id=82ce9b40374d42e880f6e6d06d93787e) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:52.972665 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd62b2d-07f7-4d27-b605-c757e7021db2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:52.974249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd62b2d-07f7-4d27-b605-c757e7021db2 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:52.980982 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 193/377] 10.222.0.94 () {56 vars in 1376 bytes} [Wed Aug 24 04:34:52 2022] GET /identity/v3/role_assignments?group.id=da03d38c6f0e4724881c4babc6a4d2e4&scope.project.id=82ce9b40374d42e880f6e6d06d93787e&role.id=f08394a5dbcf4506a17b78b4416f1680 => generated 260 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:52.982165 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349a401-f3d9-40e3-aa27-addfd671b1a1 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:52.982558 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349a401-f3d9-40e3-aa27-addfd671b1a1 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:52.982867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349a401-f3d9-40e3-aa27-addfd671b1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:53.017446 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-c349a401-f3d9-40e3-aa27-addfd671b1a1 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:53.020090 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-c349a401-f3d9-40e3-aa27-addfd671b1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:53.070566 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0186f-08ee-4637-9707-4f530bbc2109 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:53.143095 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18529e4-6fd1-48bb-b233-7f849dc1ccd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:53.144222 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18529e4-6fd1-48bb-b233-7f849dc1ccd5 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:53.144743 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18529e4-6fd1-48bb-b233-7f849dc1ccd5 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:53.145226 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18529e4-6fd1-48bb-b233-7f849dc1ccd5 None admin] PATH_INFO: `/v3/projects/dde3279595394b269fd2ccc96531ea28` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:53.147441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18529e4-6fd1-48bb-b233-7f849dc1ccd5 None admin] RBAC: Authorizing `identity:get_project(project_id=dde3279595394b269fd2ccc96531ea28)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:53.150351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18529e4-6fd1-48bb-b233-7f849dc1ccd5 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:53.159070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 185/378] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:52 2022] GET /identity/v3/projects/dde3279595394b269fd2ccc96531ea28 => generated 344 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:53.159070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18529e4-6fd1-48bb-b233-7f849dc1ccd5 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:53.163372 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 194/379] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:53.164625 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349a401-f3d9-40e3-aa27-addfd671b1a1 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:53.276137 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:53.414191 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18529e4-6fd1-48bb-b233-7f849dc1ccd5 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:53.428289 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349a401-f3d9-40e3-aa27-addfd671b1a1 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:53.467349 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:53.492200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095f556-b91c-4b6d-80f0-c101e2e13536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:53.493243 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095f556-b91c-4b6d-80f0-c101e2e13536 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:53.493742 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095f556-b91c-4b6d-80f0-c101e2e13536 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:53.494184 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095f556-b91c-4b6d-80f0-c101e2e13536 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:53.495523 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095f556-b91c-4b6d-80f0-c101e2e13536 None admin] RBAC: Adding query filter params (group.id=da03d38c6f0e4724881c4babc6a4d2e4, role.id=1a586b803a1e429f82b85f386d7564fb, scope.project.id=82ce9b40374d42e880f6e6d06d93787e) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:53.496073 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095f556-b91c-4b6d-80f0-c101e2e13536 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:53.498814 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095f556-b91c-4b6d-80f0-c101e2e13536 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:53.511345 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 186/380] 10.222.0.94 () {56 vars in 1376 bytes} [Wed Aug 24 04:34:53 2022] GET /identity/v3/role_assignments?group.id=da03d38c6f0e4724881c4babc6a4d2e4&scope.project.id=82ce9b40374d42e880f6e6d06d93787e&role.id=1a586b803a1e429f82b85f386d7564fb => generated 260 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:53.544267 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64bc98-139d-48af-8d7d-1cf6aad71fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:53.545175 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64bc98-139d-48af-8d7d-1cf6aad71fc5 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:53.545766 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64bc98-139d-48af-8d7d-1cf6aad71fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:53.546203 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64bc98-139d-48af-8d7d-1cf6aad71fc5 None admin] PATH_INFO: `/v3/groups/d1ecd259799446e88c27705eb16e01db` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:53.564187 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64bc98-139d-48af-8d7d-1cf6aad71fc5 None admin] RBAC: Authorizing `identity:get_group(group_id=d1ecd259799446e88c27705eb16e01db)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:53.567180 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64bc98-139d-48af-8d7d-1cf6aad71fc5 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:53.570916 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 195/381] 10.222.0.94 () {56 vars in 1180 bytes} [Wed Aug 24 04:34:53 2022] GET /identity/v3/groups/d1ecd259799446e88c27705eb16e01db => generated 229 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:53.578508 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095f556-b91c-4b6d-80f0-c101e2e13536 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:53.667970 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64bc98-139d-48af-8d7d-1cf6aad71fc5 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:53.791137 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:53.800126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095f556-b91c-4b6d-80f0-c101e2e13536 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:53.886819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ed635-f40a-4d08-93d6-0b8d358392a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:53.887876 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ed635-f40a-4d08-93d6-0b8d358392a4 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:53.888386 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ed635-f40a-4d08-93d6-0b8d358392a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:53.888973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ed635-f40a-4d08-93d6-0b8d358392a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:53.890983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ed635-f40a-4d08-93d6-0b8d358392a4 None admin] RBAC: Adding query filter params (group.id=d1ecd259799446e88c27705eb16e01db, role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2, scope.project.id=dde3279595394b269fd2ccc96531ea28) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:53.891533 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ed635-f40a-4d08-93d6-0b8d358392a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:53.894482 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ed635-f40a-4d08-93d6-0b8d358392a4 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:53.907101 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 187/382] 10.222.0.94 () {56 vars in 1376 bytes} [Wed Aug 24 04:34:53 2022] GET /identity/v3/role_assignments?group.id=d1ecd259799446e88c27705eb16e01db&scope.project.id=dde3279595394b269fd2ccc96531ea28&role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 260 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:53.909845 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c55893-132a-4516-9d1c-141a70e76595 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:53.909845 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c55893-132a-4516-9d1c-141a70e76595 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:53.912771 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c55893-132a-4516-9d1c-141a70e76595 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:53.915057 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 188/383] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:53.926320 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a5bad-7298-41cc-93ac-2fd5b1f5d75f None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:53.926807 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a5bad-7298-41cc-93ac-2fd5b1f5d75f None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:53.927311 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a5bad-7298-41cc-93ac-2fd5b1f5d75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:53.973120 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-de6a5bad-7298-41cc-93ac-2fd5b1f5d75f None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:53.975773 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-de6a5bad-7298-41cc-93ac-2fd5b1f5d75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:54.047479 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64bc98-139d-48af-8d7d-1cf6aad71fc5 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:54.148670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6f6ca-54f4-41fe-bed8-54f911f7d50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:54.149798 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6f6ca-54f4-41fe-bed8-54f911f7d50a None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:54.150265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6f6ca-54f4-41fe-bed8-54f911f7d50a None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:54.150764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6f6ca-54f4-41fe-bed8-54f911f7d50a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:54.181919 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 189/384] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:34:54.190835 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6f6ca-54f4-41fe-bed8-54f911f7d50a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:54.197255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-27f6f6ca-54f4-41fe-bed8-54f911f7d50a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:34:54.197255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:54.197255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:54.197255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:54.197255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:54.197255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:54.197255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:54.197255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:54.197255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:54.197255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:54.197255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:54.197255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:54.197255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:54.197255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:54.197255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:54.197255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:54.198664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:54.198664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:54.198664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:54.198664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:54.198664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:54.198664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:54.198664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:54.198664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:54.198664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:54.198664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:54.198664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:54.198664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:54.198664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:54.198664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:54.198664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:54.198664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:54.199950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:54.199950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:54.199950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:54.199950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:54.199950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:54.199950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:54.199950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:54.199950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:54.199950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:54.199950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:54.199950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:34:54.199950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:34:54.203237 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 196/385] 10.222.0.94 () {56 vars in 1114 bytes} [Wed Aug 24 04:34:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 536 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:34:54.223716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a5bad-7298-41cc-93ac-2fd5b1f5d75f None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:54.427388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:54.447266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a5bad-7298-41cc-93ac-2fd5b1f5d75f None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:54.555105 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750032d-f1de-4825-93b6-d9d60a8a8392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:54.556211 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750032d-f1de-4825-93b6-d9d60a8a8392 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:54.556721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750032d-f1de-4825-93b6-d9d60a8a8392 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:54.557223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750032d-f1de-4825-93b6-d9d60a8a8392 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:54.558596 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750032d-f1de-4825-93b6-d9d60a8a8392 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:54.559158 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750032d-f1de-4825-93b6-d9d60a8a8392 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:54.562547 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750032d-f1de-4825-93b6-d9d60a8a8392 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:54.586895 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 190/386] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:34:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:54.596179 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6f6ca-54f4-41fe-bed8-54f911f7d50a None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:54.684763 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:54.741049 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750032d-f1de-4825-93b6-d9d60a8a8392 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:54.896729 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6f6ca-54f4-41fe-bed8-54f911f7d50a None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:55.029529 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750032d-f1de-4825-93b6-d9d60a8a8392 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:55.066261 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453124f-4da4-4b0a-a32e-ec56fc43c268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:55.067429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453124f-4da4-4b0a-a32e-ec56fc43c268 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:55.067940 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453124f-4da4-4b0a-a32e-ec56fc43c268 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:55.068447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453124f-4da4-4b0a-a32e-ec56fc43c268 None admin] PATH_INFO: `/v3/groups/da03d38c6f0e4724881c4babc6a4d2e4` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:55.076721 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453124f-4da4-4b0a-a32e-ec56fc43c268 None admin] RBAC: Authorizing `identity:get_group(group_id=da03d38c6f0e4724881c4babc6a4d2e4)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:55.079750 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453124f-4da4-4b0a-a32e-ec56fc43c268 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:55.088759 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 197/387] 10.222.0.94 () {56 vars in 1180 bytes} [Wed Aug 24 04:34:54 2022] GET /identity/v3/groups/da03d38c6f0e4724881c4babc6a4d2e4 => generated 226 bytes in 493 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:55.098258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453124f-4da4-4b0a-a32e-ec56fc43c268 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:55.114392 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629d5f0-47a6-4779-beb0-3f6ade6467cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:55.115565 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629d5f0-47a6-4779-beb0-3f6ade6467cf None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:55.116055 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629d5f0-47a6-4779-beb0-3f6ade6467cf None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:55.116552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629d5f0-47a6-4779-beb0-3f6ade6467cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:55.140836 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629d5f0-47a6-4779-beb0-3f6ade6467cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:55.152600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-6629d5f0-47a6-4779-beb0-3f6ade6467cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:34:55.152600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:55.152600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:55.152600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:55.152600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:55.152600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:55.152600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:55.152600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:55.152600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:55.152600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:55.152600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:55.152600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:55.152600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:55.152600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:55.152600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:55.152600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:55.154388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:55.154388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:55.154388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:55.154388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:55.154388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:55.154388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:55.154388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:55.154388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:55.154388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:55.154388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:55.154388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:55.154388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:55.154388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:55.154388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:55.154388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:55.154388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:55.156023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:55.156023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:55.156023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:55.156023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:55.156023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:55.156023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:55.156023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:55.156023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:55.156023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:55.156023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:55.156023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:34:55.156023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:34:55.156023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 191/388] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:34:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:55.173696 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629d5f0-47a6-4779-beb0-3f6ade6467cf None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:55.210243 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:55.411794 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629d5f0-47a6-4779-beb0-3f6ade6467cf None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:55.462168 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453124f-4da4-4b0a-a32e-ec56fc43c268 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:55.477982 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:55.513604 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58e838-7d9c-4686-83c4-c5584c0ad0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:55.516320 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58e838-7d9c-4686-83c4-c5584c0ad0b4 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:55.517190 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58e838-7d9c-4686-83c4-c5584c0ad0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:55.518005 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58e838-7d9c-4686-83c4-c5584c0ad0b4 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:55.519538 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58e838-7d9c-4686-83c4-c5584c0ad0b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:55.525443 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58e838-7d9c-4686-83c4-c5584c0ad0b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:55.528739 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58e838-7d9c-4686-83c4-c5584c0ad0b4 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:55.542826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a583a-4889-4984-aa21-55a38faea15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:55.543938 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a583a-4889-4984-aa21-55a38faea15c None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:55.544435 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a583a-4889-4984-aa21-55a38faea15c None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:55.544923 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a583a-4889-4984-aa21-55a38faea15c None admin] PATH_INFO: `/v3/projects/43dfbfd1802b436791f73a286898fd0a` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:55.547761 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a583a-4889-4984-aa21-55a38faea15c None admin] RBAC: Authorizing `identity:get_project(project_id=43dfbfd1802b436791f73a286898fd0a)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:55.550672 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a583a-4889-4984-aa21-55a38faea15c None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:55.556510 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 198/389] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:55 2022] GET /identity/v3/projects/43dfbfd1802b436791f73a286898fd0a => generated 298 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:55.556757 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 192/390] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:34:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:34:55.564360 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a583a-4889-4984-aa21-55a38faea15c None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:55.580371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58e838-7d9c-4686-83c4-c5584c0ad0b4 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:55.814834 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:55.870702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a583a-4889-4984-aa21-55a38faea15c None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:55.888119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58e838-7d9c-4686-83c4-c5584c0ad0b4 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:55.929599 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275c76e-e304-4b25-92c7-e7d4a0d87302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:55.930389 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275c76e-e304-4b25-92c7-e7d4a0d87302 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:55.930811 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275c76e-e304-4b25-92c7-e7d4a0d87302 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:55.931222 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275c76e-e304-4b25-92c7-e7d4a0d87302 None admin] PATH_INFO: `/v3/groups/da03d38c6f0e4724881c4babc6a4d2e4` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:55.932941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275c76e-e304-4b25-92c7-e7d4a0d87302 None admin] RBAC: Authorizing `identity:get_group(group_id=da03d38c6f0e4724881c4babc6a4d2e4)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:55.936361 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275c76e-e304-4b25-92c7-e7d4a0d87302 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:55.940107 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 199/391] 10.222.0.94 () {56 vars in 1180 bytes} [Wed Aug 24 04:34:55 2022] GET /identity/v3/groups/da03d38c6f0e4724881c4babc6a4d2e4 => generated 226 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:55.946694 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275c76e-e304-4b25-92c7-e7d4a0d87302 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:55.974385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6fa44-d206-40b9-9433-78a09d954fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:55.975502 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6fa44-d206-40b9-9433-78a09d954fe6 None admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:55.976017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6fa44-d206-40b9-9433-78a09d954fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:55.976531 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6fa44-d206-40b9-9433-78a09d954fe6 None admin] PATH_INFO: `/v3/projects/43dfbfd1802b436791f73a286898fd0a/groups/da03d38c6f0e4724881c4babc6a4d2e4/roles/f08394a5dbcf4506a17b78b4416f1680` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:55.989072 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6fa44-d206-40b9-9433-78a09d954fe6 None admin] RBAC: Authorizing `identity:create_grant(project_id=43dfbfd1802b436791f73a286898fd0a, group_id=da03d38c6f0e4724881c4babc6a4d2e4, role_id=f08394a5dbcf4506a17b78b4416f1680)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:55.992222 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6fa44-d206-40b9-9433-78a09d954fe6 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:56.021831 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:56.033579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 193/392] 10.222.0.94 () {58 vars in 1442 bytes} [Wed Aug 24 04:34:55 2022] PUT /identity/v3/projects/43dfbfd1802b436791f73a286898fd0a/groups/da03d38c6f0e4724881c4babc6a4d2e4/roles/f08394a5dbcf4506a17b78b4416f1680 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:34:56.103630 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275c76e-e304-4b25-92c7-e7d4a0d87302 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:56.154526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abce4ca-1e28-46d4-a8bd-7bd74b389f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:56.155998 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abce4ca-1e28-46d4-a8bd-7bd74b389f4a None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:56.156273 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abce4ca-1e28-46d4-a8bd-7bd74b389f4a None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:56.156529 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abce4ca-1e28-46d4-a8bd-7bd74b389f4a None admin] PATH_INFO: `/v3/projects/43dfbfd1802b436791f73a286898fd0a` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:56.158013 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abce4ca-1e28-46d4-a8bd-7bd74b389f4a None admin] RBAC: Authorizing `identity:get_project(project_id=43dfbfd1802b436791f73a286898fd0a)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:56.159557 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abce4ca-1e28-46d4-a8bd-7bd74b389f4a None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:56.162082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 200/393] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:55 2022] GET /identity/v3/projects/43dfbfd1802b436791f73a286898fd0a => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:34:56.168002 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6fa44-d206-40b9-9433-78a09d954fe6 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:56.387002 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6fa44-d206-40b9-9433-78a09d954fe6 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:56.456776 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64328564-e2e2-4d71-a1e2-b7a07583b10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:56.457947 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64328564-e2e2-4d71-a1e2-b7a07583b10b None admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:56.458241 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64328564-e2e2-4d71-a1e2-b7a07583b10b None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:56.458730 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64328564-e2e2-4d71-a1e2-b7a07583b10b None admin] PATH_INFO: `/v3/projects/43dfbfd1802b436791f73a286898fd0a/groups/da03d38c6f0e4724881c4babc6a4d2e4/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:56.461963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64328564-e2e2-4d71-a1e2-b7a07583b10b None admin] RBAC: Authorizing `identity:create_grant(project_id=43dfbfd1802b436791f73a286898fd0a, group_id=da03d38c6f0e4724881c4babc6a4d2e4, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:56.463483 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64328564-e2e2-4d71-a1e2-b7a07583b10b None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:56.471574 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:56.490842 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 194/394] 10.222.0.94 () {58 vars in 1442 bytes} [Wed Aug 24 04:34:56 2022] PUT /identity/v3/projects/43dfbfd1802b436791f73a286898fd0a/groups/da03d38c6f0e4724881c4babc6a4d2e4/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:34:56.560959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf5a80-d8f8-4f9c-b244-3e1220dce766 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:56.561580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf5a80-d8f8-4f9c-b244-3e1220dce766 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:56.562628 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf5a80-d8f8-4f9c-b244-3e1220dce766 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:56.565331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 201/395] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:56.575118 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b5cb7-9985-4573-ae3e-e0882b023886 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:56.575911 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b5cb7-9985-4573-ae3e-e0882b023886 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:56.576220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b5cb7-9985-4573-ae3e-e0882b023886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:56.610167 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-661b5cb7-9985-4573-ae3e-e0882b023886 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:56.611580 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-661b5cb7-9985-4573-ae3e-e0882b023886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:56.743353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 195/396] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:56.940405 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7c87f-329c-4c55-ae44-094595ec62e7 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:56.941189 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7c87f-329c-4c55-ae44-094595ec62e7 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:56.941331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7c87f-329c-4c55-ae44-094595ec62e7 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:56.944437 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 202/397] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:56.951326 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a088478-2969-4b99-97f1-c0024e69d2d6 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:56.951868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a088478-2969-4b99-97f1-c0024e69d2d6 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:56.953003 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a088478-2969-4b99-97f1-c0024e69d2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:56.986158 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-2a088478-2969-4b99-97f1-c0024e69d2d6 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:56.987549 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-2a088478-2969-4b99-97f1-c0024e69d2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:57.136165 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 196/398] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:57.262392 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7c87f-329c-4c55-ae44-094595ec62e7 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:57.511402 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7c87f-329c-4c55-ae44-094595ec62e7 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:57.541806 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:57.582972 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519caf4-1e36-42ba-9d92-1a938586e94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:57.583620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519caf4-1e36-42ba-9d92-1a938586e94c None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:57.583922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519caf4-1e36-42ba-9d92-1a938586e94c None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:57.584192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519caf4-1e36-42ba-9d92-1a938586e94c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:57.601916 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519caf4-1e36-42ba-9d92-1a938586e94c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:57.606803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-1519caf4-1e36-42ba-9d92-1a938586e94c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:34:57.606803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:57.606803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:57.606803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:57.606803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:57.606803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:57.606803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:57.606803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:57.606803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:57.606803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:57.606803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:57.606803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:57.606803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:57.606803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:57.606803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:57.606803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:57.608208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:57.608208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:57.608208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:57.608208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:57.608208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:57.608208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:57.608208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:57.608208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:57.608208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:57.608208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:57.608208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:57.608208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:57.608208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:57.608208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:57.608208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:57.608208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:57.609542 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:57.609542 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:57.609542 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:57.609542 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:57.609542 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:57.609542 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:57.609542 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:57.609542 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:57.609542 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:57.609542 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:57.609542 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:34:57.609542 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:34:57.609542 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 203/399] 10.222.0.94 () {56 vars in 1114 bytes} [Wed Aug 24 04:34:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:57.616814 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a088478-2969-4b99-97f1-c0024e69d2d6 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:57.671511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519caf4-1e36-42ba-9d92-1a938586e94c None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:57.751657 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:57.841719 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a088478-2969-4b99-97f1-c0024e69d2d6 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:57.863049 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519caf4-1e36-42ba-9d92-1a938586e94c None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:57.907687 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ccf87-cebb-4e1b-aad9-59359f36b5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:57.909013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ccf87-cebb-4e1b-aad9-59359f36b5f6 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:57.909143 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ccf87-cebb-4e1b-aad9-59359f36b5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:57.909588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ccf87-cebb-4e1b-aad9-59359f36b5f6 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:57.910727 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ccf87-cebb-4e1b-aad9-59359f36b5f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:57.911480 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ccf87-cebb-4e1b-aad9-59359f36b5f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:57.914229 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ccf87-cebb-4e1b-aad9-59359f36b5f6 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:57.919249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650489a6-e65e-41b6-8690-631f88dba419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:57.920705 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650489a6-e65e-41b6-8690-631f88dba419 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:57.921610 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650489a6-e65e-41b6-8690-631f88dba419 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:57.922425 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650489a6-e65e-41b6-8690-631f88dba419 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:57.932368 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 197/400] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:34:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:57.934826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20688e-7473-4562-9ba8-c08edfc2090a None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:57.935347 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20688e-7473-4562-9ba8-c08edfc2090a None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:57.935852 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20688e-7473-4562-9ba8-c08edfc2090a None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:57.939014 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 198/401] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:34:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:34:57.940253 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20688e-7473-4562-9ba8-c08edfc2090a None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:57.949482 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650489a6-e65e-41b6-8690-631f88dba419 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:57.960740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-650489a6-e65e-41b6-8690-631f88dba419 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:34:57.960740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:57.960740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:57.960740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:57.960740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:57.960740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:57.960740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:57.960740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:57.960740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:57.960740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:57.960740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:57.960740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:57.960740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:57.960740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:57.960740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:57.960740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:57.961918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:57.961918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:57.961918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:57.961918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:57.961918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:57.961918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:57.961918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:57.961918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:57.961918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:57.961918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:57.961918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:57.961918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:57.961918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:57.961918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:57.961918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:57.961918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:57.962743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:57.962743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:57.962743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:57.962743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:57.962743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:57.962743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:57.962743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:57.962743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:57.962743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:57.962743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:57.962743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:34:57.962743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:34:57.966054 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 204/402] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:34:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:57.968098 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6538189-eaa7-4249-be70-53c40e8aa16e None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:57.969288 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6538189-eaa7-4249-be70-53c40e8aa16e None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:57.969822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6538189-eaa7-4249-be70-53c40e8aa16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:57.991960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-b6538189-eaa7-4249-be70-53c40e8aa16e None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:57.993721 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-b6538189-eaa7-4249-be70-53c40e8aa16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:58.027229 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:58.087592 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 205/403] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:34:58.089069 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6538189-eaa7-4249-be70-53c40e8aa16e None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:58.146307 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20688e-7473-4562-9ba8-c08edfc2090a None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:58.183688 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:58.219033 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd93a32-615c-43d1-be92-6f280b61cc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:58.220145 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd93a32-615c-43d1-be92-6f280b61cc04 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:58.220641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd93a32-615c-43d1-be92-6f280b61cc04 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:58.221093 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd93a32-615c-43d1-be92-6f280b61cc04 None admin] PATH_INFO: `/v3/groups/da03d38c6f0e4724881c4babc6a4d2e4` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:58.223293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd93a32-615c-43d1-be92-6f280b61cc04 None admin] RBAC: Authorizing `identity:get_group(group_id=da03d38c6f0e4724881c4babc6a4d2e4)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:58.225988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd93a32-615c-43d1-be92-6f280b61cc04 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:58.229501 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 199/404] 10.222.0.94 () {56 vars in 1180 bytes} [Wed Aug 24 04:34:57 2022] GET /identity/v3/groups/da03d38c6f0e4724881c4babc6a4d2e4 => generated 226 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:58.238472 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd93a32-615c-43d1-be92-6f280b61cc04 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:58.255829 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6538189-eaa7-4249-be70-53c40e8aa16e None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:58.340078 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03b557-b062-4068-8162-e2cbda13f439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:58.341793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03b557-b062-4068-8162-e2cbda13f439 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:58.342558 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03b557-b062-4068-8162-e2cbda13f439 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:58.343872 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03b557-b062-4068-8162-e2cbda13f439 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:58.345549 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03b557-b062-4068-8162-e2cbda13f439 None admin] RBAC: Adding query filter params (name=member) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:58.346452 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03b557-b062-4068-8162-e2cbda13f439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:58.349541 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03b557-b062-4068-8162-e2cbda13f439 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:58.369575 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 206/405] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:34:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:58.380464 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03b557-b062-4068-8162-e2cbda13f439 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:58.447107 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:58.553289 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd93a32-615c-43d1-be92-6f280b61cc04 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:58.661386 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9aceb-af8d-46b7-94c3-f574e8a30866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:58.662466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9aceb-af8d-46b7-94c3-f574e8a30866 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:58.662466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9aceb-af8d-46b7-94c3-f574e8a30866 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:58.662847 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9aceb-af8d-46b7-94c3-f574e8a30866 None admin] PATH_INFO: `/v3/projects/82ce9b40374d42e880f6e6d06d93787e` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:58.664357 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9aceb-af8d-46b7-94c3-f574e8a30866 None admin] RBAC: Authorizing `identity:get_project(project_id=82ce9b40374d42e880f6e6d06d93787e)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:58.665967 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9aceb-af8d-46b7-94c3-f574e8a30866 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:58.668605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 200/406] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:58 2022] GET /identity/v3/projects/82ce9b40374d42e880f6e6d06d93787e => generated 302 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:58.675075 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9aceb-af8d-46b7-94c3-f574e8a30866 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:58.676383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03b557-b062-4068-8162-e2cbda13f439 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:58.734396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cde42-ecfa-40f1-8a40-e5f8ae6adf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:58.735123 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cde42-ecfa-40f1-8a40-e5f8ae6adf4f None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:58.735400 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cde42-ecfa-40f1-8a40-e5f8ae6adf4f None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:58.735674 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cde42-ecfa-40f1-8a40-e5f8ae6adf4f None admin] PATH_INFO: `/v3/groups/da03d38c6f0e4724881c4babc6a4d2e4` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:58.736923 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243cde42-ecfa-40f1-8a40-e5f8ae6adf4f None admin] RBAC: Authorizing `identity:get_group(group_id=da03d38c6f0e4724881c4babc6a4d2e4)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:58.738496 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243cde42-ecfa-40f1-8a40-e5f8ae6adf4f None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:58.745487 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 207/407] 10.222.0.94 () {56 vars in 1180 bytes} [Wed Aug 24 04:34:58 2022] GET /identity/v3/groups/da03d38c6f0e4724881c4babc6a4d2e4 => generated 226 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:58.745487 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cde42-ecfa-40f1-8a40-e5f8ae6adf4f None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:58.792318 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:58.884940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9aceb-af8d-46b7-94c3-f574e8a30866 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:58.885937 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:58.908082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cde42-ecfa-40f1-8a40-e5f8ae6adf4f None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:58.960098 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6810eb-eaa1-43ea-9873-5fe03822f28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:58.961702 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6810eb-eaa1-43ea-9873-5fe03822f28a None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:58.962491 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6810eb-eaa1-43ea-9873-5fe03822f28a None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:58.962990 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6810eb-eaa1-43ea-9873-5fe03822f28a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:58.974177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08504ac8-c13e-4f0a-87dc-b53a8e5f4511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:58.975257 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08504ac8-c13e-4f0a-87dc-b53a8e5f4511 None admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:58.975621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08504ac8-c13e-4f0a-87dc-b53a8e5f4511 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:58.976019 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08504ac8-c13e-4f0a-87dc-b53a8e5f4511 None admin] PATH_INFO: `/v3/projects/82ce9b40374d42e880f6e6d06d93787e/groups/da03d38c6f0e4724881c4babc6a4d2e4/roles/f08394a5dbcf4506a17b78b4416f1680` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:58.979007 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08504ac8-c13e-4f0a-87dc-b53a8e5f4511 None admin] RBAC: Authorizing `identity:create_grant(project_id=82ce9b40374d42e880f6e6d06d93787e, group_id=da03d38c6f0e4724881c4babc6a4d2e4, role_id=f08394a5dbcf4506a17b78b4416f1680)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:58.980754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08504ac8-c13e-4f0a-87dc-b53a8e5f4511 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:58.987537 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6810eb-eaa1-43ea-9873-5fe03822f28a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:34:59.002441 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 208/408] 10.222.0.94 () {58 vars in 1442 bytes} [Wed Aug 24 04:34:58 2022] PUT /identity/v3/projects/82ce9b40374d42e880f6e6d06d93787e/groups/da03d38c6f0e4724881c4babc6a4d2e4/roles/f08394a5dbcf4506a17b78b4416f1680 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:34:59.004070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-ef6810eb-eaa1-43ea-9873-5fe03822f28a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:34:59.004070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:34:59.004070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:34:59.004070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:34:59.004070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:34:59.004070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:34:59.004070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:34:59.004070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:34:59.004070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:34:59.004070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:34:59.004070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:34:59.004070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:34:59.004070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:34:59.004070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:34:59.004070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:34:59.004070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:34:59.006559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:34:59.006559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:34:59.006559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:34:59.006559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:34:59.006559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:34:59.006559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:34:59.006559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:34:59.006559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:34:59.006559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:34:59.006559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:34:59.006559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:34:59.006559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:34:59.006559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:34:59.006559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:34:59.006559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:34:59.006559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:34:59.008602 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:34:59.008602 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:34:59.008602 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:34:59.008602 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:34:59.008602 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:34:59.008602 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:34:59.008602 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:34:59.008602 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:34:59.008602 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:34:59.008602 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:34:59.008602 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:34:59.008602 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:34:59.010063 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08504ac8-c13e-4f0a-87dc-b53a8e5f4511 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:59.010195 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 201/409] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:34:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:34:59.018005 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6810eb-eaa1-43ea-9873-5fe03822f28a None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:59.163649 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08504ac8-c13e-4f0a-87dc-b53a8e5f4511 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:59.229994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8d02f-c3f8-4383-a5c6-46214e791ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:59.230819 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8d02f-c3f8-4383-a5c6-46214e791ac8 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:59.231348 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8d02f-c3f8-4383-a5c6-46214e791ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:59.231854 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8d02f-c3f8-4383-a5c6-46214e791ac8 None admin] PATH_INFO: `/v3/projects/82ce9b40374d42e880f6e6d06d93787e` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:59.234834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8d02f-c3f8-4383-a5c6-46214e791ac8 None admin] RBAC: Authorizing `identity:get_project(project_id=82ce9b40374d42e880f6e6d06d93787e)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:59.236906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8d02f-c3f8-4383-a5c6-46214e791ac8 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:59.240149 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 209/410] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:59 2022] GET /identity/v3/projects/82ce9b40374d42e880f6e6d06d93787e => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:59.250773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8d02f-c3f8-4383-a5c6-46214e791ac8 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:59.301533 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:59.378508 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6810eb-eaa1-43ea-9873-5fe03822f28a None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:59.412981 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:59.478586 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a0505-7615-47b0-87f7-cd532ed9de71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:59.479325 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a0505-7615-47b0-87f7-cd532ed9de71 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:59.479603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a0505-7615-47b0-87f7-cd532ed9de71 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:59.479915 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a0505-7615-47b0-87f7-cd532ed9de71 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:59.481026 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a0505-7615-47b0-87f7-cd532ed9de71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:59.481583 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a0505-7615-47b0-87f7-cd532ed9de71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:59.484165 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a0505-7615-47b0-87f7-cd532ed9de71 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:59.488197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8d02f-c3f8-4383-a5c6-46214e791ac8 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:59.495361 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 202/411] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:34:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 478 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:59.502541 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a0505-7615-47b0-87f7-cd532ed9de71 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:59.545110 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8facf1-48e7-4701-a795-0f9042860dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:59.546659 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8facf1-48e7-4701-a795-0f9042860dce None admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:59.547264 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8facf1-48e7-4701-a795-0f9042860dce None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:59.548112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8facf1-48e7-4701-a795-0f9042860dce None admin] PATH_INFO: `/v3/projects/82ce9b40374d42e880f6e6d06d93787e/groups/da03d38c6f0e4724881c4babc6a4d2e4/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:59.551201 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8facf1-48e7-4701-a795-0f9042860dce None admin] RBAC: Authorizing `identity:create_grant(project_id=82ce9b40374d42e880f6e6d06d93787e, group_id=da03d38c6f0e4724881c4babc6a4d2e4, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:59.555319 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8facf1-48e7-4701-a795-0f9042860dce None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:59.581435 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 210/412] 10.222.0.94 () {58 vars in 1442 bytes} [Wed Aug 24 04:34:59 2022] PUT /identity/v3/projects/82ce9b40374d42e880f6e6d06d93787e/groups/da03d38c6f0e4724881c4babc6a4d2e4/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:34:59.696197 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a0505-7615-47b0-87f7-cd532ed9de71 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:59.783552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc82b5-d7c5-4601-a868-c27de4e34bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:59.784816 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc82b5-d7c5-4601-a868-c27de4e34bec None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:59.785322 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc82b5-d7c5-4601-a868-c27de4e34bec None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:59.786070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc82b5-d7c5-4601-a868-c27de4e34bec None admin] PATH_INFO: `/v3/groups/d1ecd259799446e88c27705eb16e01db` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:59.789988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc82b5-d7c5-4601-a868-c27de4e34bec None admin] RBAC: Authorizing `identity:get_group(group_id=d1ecd259799446e88c27705eb16e01db)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:59.792451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc82b5-d7c5-4601-a868-c27de4e34bec None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:59.795719 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 203/413] 10.222.0.94 () {56 vars in 1180 bytes} [Wed Aug 24 04:34:59 2022] GET /identity/v3/groups/d1ecd259799446e88c27705eb16e01db => generated 229 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:34:59.805087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8facf1-48e7-4701-a795-0f9042860dce None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:00.022425 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b52233-d501-4230-bc2d-23aba45ed53b None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:00.022912 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b52233-d501-4230-bc2d-23aba45ed53b None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:00.023372 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b52233-d501-4230-bc2d-23aba45ed53b None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:00.026510 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 204/414] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:00.037574 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0295e89-0905-4f72-99ed-1a31828ba734 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:00.037837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:00.039467 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0295e89-0905-4f72-99ed-1a31828ba734 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:00.040536 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0295e89-0905-4f72-99ed-1a31828ba734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:00.094471 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-f0295e89-0905-4f72-99ed-1a31828ba734 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:00.096624 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-f0295e89-0905-4f72-99ed-1a31828ba734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:00.096844 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8facf1-48e7-4701-a795-0f9042860dce None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:00.170216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:00.178823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92a3d0-f3ce-4648-96aa-8811b0e7dd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:00.179962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92a3d0-f3ce-4648-96aa-8811b0e7dd72 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:00.180479 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92a3d0-f3ce-4648-96aa-8811b0e7dd72 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:00.181028 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92a3d0-f3ce-4648-96aa-8811b0e7dd72 None admin] PATH_INFO: `/v3/projects/dde3279595394b269fd2ccc96531ea28` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:00.190937 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92a3d0-f3ce-4648-96aa-8811b0e7dd72 None admin] RBAC: Authorizing `identity:get_project(project_id=dde3279595394b269fd2ccc96531ea28)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:00.193605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92a3d0-f3ce-4648-96aa-8811b0e7dd72 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:00.205812 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 211/415] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:34:59 2022] GET /identity/v3/projects/dde3279595394b269fd2ccc96531ea28 => generated 344 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:00.215078 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92a3d0-f3ce-4648-96aa-8811b0e7dd72 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:00.217212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 205/416] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:00.430531 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92a3d0-f3ce-4648-96aa-8811b0e7dd72 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:00.458586 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fa868-a6fe-40e5-ba8e-654bc7f37828 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:00.459047 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fa868-a6fe-40e5-ba8e-654bc7f37828 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:00.459526 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fa868-a6fe-40e5-ba8e-654bc7f37828 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:00.462125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 206/417] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:00.475265 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55295370-d139-4678-b079-da86981905d2 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:00.475756 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55295370-d139-4678-b079-da86981905d2 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:00.476238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55295370-d139-4678-b079-da86981905d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:00.532127 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-55295370-d139-4678-b079-da86981905d2 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:00.534287 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-55295370-d139-4678-b079-da86981905d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:00.570513 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ba84c-cf6f-4c50-b566-ffc93a926e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:00.571688 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ba84c-cf6f-4c50-b566-ffc93a926e8d None admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:00.572147 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ba84c-cf6f-4c50-b566-ffc93a926e8d None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:00.572589 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ba84c-cf6f-4c50-b566-ffc93a926e8d None admin] PATH_INFO: `/v3/projects/dde3279595394b269fd2ccc96531ea28/groups/d1ecd259799446e88c27705eb16e01db/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:00.578081 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ba84c-cf6f-4c50-b566-ffc93a926e8d None admin] RBAC: Authorizing `identity:create_grant(project_id=dde3279595394b269fd2ccc96531ea28, group_id=d1ecd259799446e88c27705eb16e01db, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:00.581273 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ba84c-cf6f-4c50-b566-ffc93a926e8d None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:00.612819 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 212/418] 10.222.0.94 () {58 vars in 1442 bytes} [Wed Aug 24 04:35:00 2022] PUT /identity/v3/projects/dde3279595394b269fd2ccc96531ea28/groups/d1ecd259799446e88c27705eb16e01db/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:35:00.783118 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 207/419] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:01.016316 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ba84c-cf6f-4c50-b566-ffc93a926e8d None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:01.035278 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:01.281966 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ba84c-cf6f-4c50-b566-ffc93a926e8d None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:01.370996 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213513a-f695-4f51-ac6c-e5b2842cac89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:01.372113 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213513a-f695-4f51-ac6c-e5b2842cac89 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:01.372589 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213513a-f695-4f51-ac6c-e5b2842cac89 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:01.373067 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213513a-f695-4f51-ac6c-e5b2842cac89 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:01.406442 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213513a-f695-4f51-ac6c-e5b2842cac89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:01.406442 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-e213513a-f695-4f51-ac6c-e5b2842cac89 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:35:01.406442 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:01.406442 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:01.406442 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:01.406442 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:01.406442 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:01.406442 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:01.406442 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:01.406442 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:01.406442 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:01.406442 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:01.406442 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:01.406442 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:01.407936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:01.407936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:01.407936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:01.407936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:01.407936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:01.407936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:01.407936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:01.407936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:01.407936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:01.407936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:01.407936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:01.407936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:01.407936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:01.407936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:01.407936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:01.407936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:01.407936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:01.410043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:01.410043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:01.410043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:01.410043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:01.410043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:01.410043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:01.410043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:01.410043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:01.410043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:01.410043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:01.410043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:01.410043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:01.410043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:35:01.410043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:01.410043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 213/420] 10.222.0.94 () {56 vars in 1114 bytes} [Wed Aug 24 04:35:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:01.418829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55295370-d139-4678-b079-da86981905d2 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:01.486246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213513a-f695-4f51-ac6c-e5b2842cac89 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:01.676598 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55295370-d139-4678-b079-da86981905d2 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:01.682504 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:01.754251 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0c6ed-312d-4e78-9ce4-42918f97d4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:01.758488 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0c6ed-312d-4e78-9ce4-42918f97d4bb None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:01.761274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0c6ed-312d-4e78-9ce4-42918f97d4bb None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:01.763743 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0c6ed-312d-4e78-9ce4-42918f97d4bb None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:01.765832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0c6ed-312d-4e78-9ce4-42918f97d4bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:01.769475 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0c6ed-312d-4e78-9ce4-42918f97d4bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:01.774093 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0c6ed-312d-4e78-9ce4-42918f97d4bb None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:01.799021 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 208/421] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:35:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:01.800873 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:01.810272 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0c6ed-312d-4e78-9ce4-42918f97d4bb None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:01.907611 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213513a-f695-4f51-ac6c-e5b2842cac89 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:02.004405 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f1c49-434b-4a10-8463-e9a044ac5aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:02.006029 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f1c49-434b-4a10-8463-e9a044ac5aff None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:02.006815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f1c49-434b-4a10-8463-e9a044ac5aff None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:02.007310 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f1c49-434b-4a10-8463-e9a044ac5aff None admin] PATH_INFO: `/v3/roles/member` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:02.052670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f1c49-434b-4a10-8463-e9a044ac5aff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:02.065695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-b43f1c49-434b-4a10-8463-e9a044ac5aff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:35:02.065695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:02.065695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:02.065695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:02.065695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:02.065695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:02.065695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:02.065695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:02.065695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:02.065695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:02.065695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:02.065695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:02.065695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:02.065695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:02.065695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:02.065695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:02.067483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:02.067483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:02.067483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:02.067483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:02.067483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:02.067483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:02.067483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:02.067483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:02.067483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:02.067483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:02.067483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:02.067483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:02.067483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:02.067483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:02.067483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:02.067483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:02.069106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:02.069106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:02.069106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:02.069106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:02.069106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:02.069106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:02.069106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:02.069106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:02.069106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:02.069106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:02.069106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:35:02.069106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:02.075020 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 214/422] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 590 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:35:02.084883 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f1c49-434b-4a10-8463-e9a044ac5aff None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:02.191412 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0c6ed-312d-4e78-9ce4-42918f97d4bb None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:02.328178 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4e664-1d16-49b8-be4e-d9f2d52111be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:02.330544 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4e664-1d16-49b8-be4e-d9f2d52111be None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:02.331428 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4e664-1d16-49b8-be4e-d9f2d52111be None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:02.334529 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4e664-1d16-49b8-be4e-d9f2d52111be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:02.462279 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:02.467345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f1c49-434b-4a10-8463-e9a044ac5aff None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:02.578331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:02.589725 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34064a11-bd5a-419d-8f0d-e6c51b94b73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:02.591244 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34064a11-bd5a-419d-8f0d-e6c51b94b73e None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:02.592050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34064a11-bd5a-419d-8f0d-e6c51b94b73e None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:02.594036 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34064a11-bd5a-419d-8f0d-e6c51b94b73e None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:02.595775 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34064a11-bd5a-419d-8f0d-e6c51b94b73e None admin] RBAC: Adding query filter params (name=member) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:02.596629 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34064a11-bd5a-419d-8f0d-e6c51b94b73e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:02.600235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34064a11-bd5a-419d-8f0d-e6c51b94b73e None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:02.616835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4e664-1d16-49b8-be4e-d9f2d52111be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:02.619633 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4e664-1d16-49b8-be4e-d9f2d52111be None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:02.624582 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 215/423] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:35:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 540 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:35:02.633482 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34064a11-bd5a-419d-8f0d-e6c51b94b73e None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:02.927724 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34064a11-bd5a-419d-8f0d-e6c51b94b73e None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:03.053750 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55724b5a-6bca-49f6-8fed-caa4e9a09841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:03.054898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55724b5a-6bca-49f6-8fed-caa4e9a09841 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:03.055355 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55724b5a-6bca-49f6-8fed-caa4e9a09841 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:03.055799 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55724b5a-6bca-49f6-8fed-caa4e9a09841 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:03.061867 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 209/424] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1252 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:03.070050 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4e664-1d16-49b8-be4e-d9f2d52111be None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:03.219284 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:03.227320 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:03.260193 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55724b5a-6bca-49f6-8fed-caa4e9a09841 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:03.264244 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55724b5a-6bca-49f6-8fed-caa4e9a09841 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:03.307002 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4e664-1d16-49b8-be4e-d9f2d52111be None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:03.397623 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7a816-87df-49b8-af19-11c3619c02ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:03.399105 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7a816-87df-49b8-af19-11c3619c02ed None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:03.399825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7a816-87df-49b8-af19-11c3619c02ed None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:03.400534 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7a816-87df-49b8-af19-11c3619c02ed None admin] PATH_INFO: `/v3/projects/43dfbfd1802b436791f73a286898fd0a` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:03.403212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7a816-87df-49b8-af19-11c3619c02ed None admin] RBAC: Authorizing `identity:get_project(project_id=43dfbfd1802b436791f73a286898fd0a)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:03.406646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7a816-87df-49b8-af19-11c3619c02ed None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:03.410432 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 210/425] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:35:03 2022] GET /identity/v3/projects/43dfbfd1802b436791f73a286898fd0a => generated 298 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:35:03.413586 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba62cc2-5d45-4910-a5de-b6b21893bea3 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:03.414413 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba62cc2-5d45-4910-a5de-b6b21893bea3 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:03.415162 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba62cc2-5d45-4910-a5de-b6b21893bea3 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:03.425007 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 211/426] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:03.428616 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba62cc2-5d45-4910-a5de-b6b21893bea3 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:03.514015 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 216/427] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 873 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:03.517962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626814f-469c-44ea-8cbc-44fcdc7e0698 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:03.518448 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626814f-469c-44ea-8cbc-44fcdc7e0698 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:03.518928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626814f-469c-44ea-8cbc-44fcdc7e0698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:03.556737 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-d626814f-469c-44ea-8cbc-44fcdc7e0698 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:03.558925 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-d626814f-469c-44ea-8cbc-44fcdc7e0698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:03.670616 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba62cc2-5d45-4910-a5de-b6b21893bea3 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:03.729078 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 217/428] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:03.731270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626814f-469c-44ea-8cbc-44fcdc7e0698 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:03.745341 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadefd83-d892-44be-af40-4bc692b8dc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:03.747654 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadefd83-d892-44be-af40-4bc692b8dc39 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:03.748260 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadefd83-d892-44be-af40-4bc692b8dc39 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:03.748847 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadefd83-d892-44be-af40-4bc692b8dc39 None admin] PATH_INFO: `/v3/groups/da03d38c6f0e4724881c4babc6a4d2e4` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:03.751314 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadefd83-d892-44be-af40-4bc692b8dc39 None admin] RBAC: Authorizing `identity:get_group(group_id=da03d38c6f0e4724881c4babc6a4d2e4)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:03.755238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadefd83-d892-44be-af40-4bc692b8dc39 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:03.760162 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 212/429] 10.222.0.94 () {56 vars in 1180 bytes} [Wed Aug 24 04:35:03 2022] GET /identity/v3/groups/da03d38c6f0e4724881c4babc6a4d2e4 => generated 226 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:03.763103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447b2a9-ac3b-497b-bb54-da453ad76a72 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:03.763703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447b2a9-ac3b-497b-bb54-da453ad76a72 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:03.764362 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447b2a9-ac3b-497b-bb54-da453ad76a72 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:03.769818 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 213/430] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:03.771954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447b2a9-ac3b-497b-bb54-da453ad76a72 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:03.777716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:03.784886 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:03.946283 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626814f-469c-44ea-8cbc-44fcdc7e0698 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:03.993236 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919291e8-6413-411f-97d8-435b48f5b57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:03.994457 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919291e8-6413-411f-97d8-435b48f5b57e None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:03.995009 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919291e8-6413-411f-97d8-435b48f5b57e None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:03.995507 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919291e8-6413-411f-97d8-435b48f5b57e None admin] PATH_INFO: `/v3/projects/43dfbfd1802b436791f73a286898fd0a` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:03.997668 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919291e8-6413-411f-97d8-435b48f5b57e None admin] RBAC: Authorizing `identity:get_project(project_id=43dfbfd1802b436791f73a286898fd0a)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:04.000540 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919291e8-6413-411f-97d8-435b48f5b57e None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:04.009444 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 218/431] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:35:03 2022] GET /identity/v3/projects/43dfbfd1802b436791f73a286898fd0a => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:04.009444 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82c46f-d4df-4b59-92b1-e372a6f96986 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:04.009444 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82c46f-d4df-4b59-92b1-e372a6f96986 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:04.009444 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82c46f-d4df-4b59-92b1-e372a6f96986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:04.033155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447b2a9-ac3b-497b-bb54-da453ad76a72 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:04.035003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-bb82c46f-d4df-4b59-92b1-e372a6f96986 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:04.037029 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-bb82c46f-d4df-4b59-92b1-e372a6f96986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:04.108499 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b915f-8d02-4b3f-88ac-be039f602ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:04.110733 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b915f-8d02-4b3f-88ac-be039f602ac9 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:04.111612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b915f-8d02-4b3f-88ac-be039f602ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:04.112385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b915f-8d02-4b3f-88ac-be039f602ac9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:04.114302 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b915f-8d02-4b3f-88ac-be039f602ac9 None admin] RBAC: Adding query filter params (group.id=da03d38c6f0e4724881c4babc6a4d2e4, role.id=f08394a5dbcf4506a17b78b4416f1680, scope.project.id=43dfbfd1802b436791f73a286898fd0a) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:04.115230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b915f-8d02-4b3f-88ac-be039f602ac9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:04.118408 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b915f-8d02-4b3f-88ac-be039f602ac9 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:04.131733 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 214/432] 10.222.0.94 () {56 vars in 1376 bytes} [Wed Aug 24 04:35:03 2022] GET /identity/v3/role_assignments?group.id=da03d38c6f0e4724881c4babc6a4d2e4&scope.project.id=43dfbfd1802b436791f73a286898fd0a&role.id=f08394a5dbcf4506a17b78b4416f1680 => generated 611 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:04.133904 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b915f-8d02-4b3f-88ac-be039f602ac9 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:04.172276 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 219/433] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:04.302476 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:04.309887 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82c46f-d4df-4b59-92b1-e372a6f96986 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:04.350001 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:04.386291 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b915f-8d02-4b3f-88ac-be039f602ac9 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:04.478254 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343c723-b0fa-41a3-b7ff-ee6302657d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:04.481443 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343c723-b0fa-41a3-b7ff-ee6302657d31 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:04.481443 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343c723-b0fa-41a3-b7ff-ee6302657d31 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:04.481443 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343c723-b0fa-41a3-b7ff-ee6302657d31 None admin] PATH_INFO: `/v3/groups/da03d38c6f0e4724881c4babc6a4d2e4` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:04.484270 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343c723-b0fa-41a3-b7ff-ee6302657d31 None admin] RBAC: Authorizing `identity:get_group(group_id=da03d38c6f0e4724881c4babc6a4d2e4)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:04.489178 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343c723-b0fa-41a3-b7ff-ee6302657d31 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:04.496651 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 215/434] 10.222.0.94 () {56 vars in 1180 bytes} [Wed Aug 24 04:35:04 2022] GET /identity/v3/groups/da03d38c6f0e4724881c4babc6a4d2e4 => generated 226 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:04.496902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0b103-2931-4bf1-a567-03ae63402327 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:04.497335 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0b103-2931-4bf1-a567-03ae63402327 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:04.498022 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0b103-2931-4bf1-a567-03ae63402327 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:04.500601 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 216/435] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:04.505744 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0b103-2931-4bf1-a567-03ae63402327 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:04.575321 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82c46f-d4df-4b59-92b1-e372a6f96986 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:04.648815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693b709-4e65-4625-bd2b-7e5f4cd93d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:04.650475 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693b709-4e65-4625-bd2b-7e5f4cd93d3a None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:04.650952 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693b709-4e65-4625-bd2b-7e5f4cd93d3a None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:04.651451 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693b709-4e65-4625-bd2b-7e5f4cd93d3a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:04.672535 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693b709-4e65-4625-bd2b-7e5f4cd93d3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:04.685494 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-9693b709-4e65-4625-bd2b-7e5f4cd93d3a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:35:04.685494 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:04.685494 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:04.685494 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:04.685494 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:04.685494 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:04.685494 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:04.685494 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:04.685494 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:04.685494 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:04.685494 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:04.685494 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:04.685494 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:04.685494 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:04.685494 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:04.685494 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:04.687376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:04.687376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:04.687376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:04.687376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:04.687376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:04.687376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:04.687376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:04.687376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:04.687376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:04.687376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:04.687376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:04.687376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:04.687376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:04.687376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:04.687376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:04.687376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:04.689005 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:04.689005 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:04.689005 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:04.689005 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:04.689005 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:04.689005 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:04.689005 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:04.689005 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:04.689005 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:04.689005 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:04.689005 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:35:04.689005 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:04.689005 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 220/436] 10.222.0.94 () {56 vars in 1114 bytes} [Wed Aug 24 04:35:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:35:04.691790 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c57d5-0cb9-4889-81a7-4340460857d2 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:04.691790 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c57d5-0cb9-4889-81a7-4340460857d2 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:04.691790 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c57d5-0cb9-4889-81a7-4340460857d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:04.723703 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-5e9c57d5-0cb9-4889-81a7-4340460857d2 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:04.725900 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-5e9c57d5-0cb9-4889-81a7-4340460857d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:04.737642 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0b103-2931-4bf1-a567-03ae63402327 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:04.807090 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d0d1b-dc0a-4b7f-95bc-4da492020016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:04.808017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d0d1b-dc0a-4b7f-95bc-4da492020016 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:04.808511 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d0d1b-dc0a-4b7f-95bc-4da492020016 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:04.808997 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d0d1b-dc0a-4b7f-95bc-4da492020016 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:04.810452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d0d1b-dc0a-4b7f-95bc-4da492020016 None admin] RBAC: Adding query filter params (group.id=da03d38c6f0e4724881c4babc6a4d2e4, role.id=1a586b803a1e429f82b85f386d7564fb, scope.project.id=43dfbfd1802b436791f73a286898fd0a) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:04.811017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d0d1b-dc0a-4b7f-95bc-4da492020016 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:04.813954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d0d1b-dc0a-4b7f-95bc-4da492020016 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:04.818319 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:04.829790 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 217/437] 10.222.0.94 () {56 vars in 1376 bytes} [Wed Aug 24 04:35:04 2022] GET /identity/v3/role_assignments?group.id=da03d38c6f0e4724881c4babc6a4d2e4&scope.project.id=43dfbfd1802b436791f73a286898fd0a&role.id=1a586b803a1e429f82b85f386d7564fb => generated 611 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:04.831261 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d0d1b-dc0a-4b7f-95bc-4da492020016 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:04.866892 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 221/438] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:04.868528 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c57d5-0cb9-4889-81a7-4340460857d2 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:04.891680 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:05.043442 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d0d1b-dc0a-4b7f-95bc-4da492020016 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:05.076169 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c57d5-0cb9-4889-81a7-4340460857d2 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:05.122627 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec71247-c2b9-4c62-a078-cf233ce5d0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:05.123395 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec71247-c2b9-4c62-a078-cf233ce5d0e0 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:05.123532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec71247-c2b9-4c62-a078-cf233ce5d0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:05.124369 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec71247-c2b9-4c62-a078-cf233ce5d0e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:05.142563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec71247-c2b9-4c62-a078-cf233ce5d0e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:05.153673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-fec71247-c2b9-4c62-a078-cf233ce5d0e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:35:05.153673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:05.153673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:05.153673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:05.153673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:05.153673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:05.153673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:05.153673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:05.153673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:05.153673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:05.153673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:05.153673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:05.153673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:05.153673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:05.153673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:05.153673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:05.156080 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:05.156080 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:05.156080 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:05.156080 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:05.156080 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:05.156080 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:05.156080 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:05.156080 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:05.156080 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:05.156080 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:05.156080 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:05.156080 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:05.156080 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:05.156080 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:05.156080 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:05.156080 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:05.157676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:05.157676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:05.157676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:05.157676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:05.157676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:05.157676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:05.157676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:05.157676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:05.157676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:05.157676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:05.157676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:35:05.157676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:05.158839 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d30fad-2b9f-499d-8bbb-880e0f44147c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:05.158839 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d30fad-2b9f-499d-8bbb-880e0f44147c None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:05.158839 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d30fad-2b9f-499d-8bbb-880e0f44147c None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:05.158839 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d30fad-2b9f-499d-8bbb-880e0f44147c None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:05.160301 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d30fad-2b9f-499d-8bbb-880e0f44147c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:05.160301 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d30fad-2b9f-499d-8bbb-880e0f44147c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:05.160929 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d30fad-2b9f-499d-8bbb-880e0f44147c None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:05.162762 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 218/439] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:05.171163 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec71247-c2b9-4c62-a078-cf233ce5d0e0 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:05.179566 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 222/440] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:35:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:05.191933 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d30fad-2b9f-499d-8bbb-880e0f44147c None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:05.310013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:05.329077 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:05.407498 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec71247-c2b9-4c62-a078-cf233ce5d0e0 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:05.412198 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d30fad-2b9f-499d-8bbb-880e0f44147c None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:05.493241 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e73752-afbe-4bc9-9d9d-8ecd9a552e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:05.493859 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f7e79-696f-493b-8ba5-8d9a0258193a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:05.494492 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e73752-afbe-4bc9-9d9d-8ecd9a552e5d None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:05.494748 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f7e79-696f-493b-8ba5-8d9a0258193a None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:05.495196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f7e79-696f-493b-8ba5-8d9a0258193a None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:05.496807 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f7e79-696f-493b-8ba5-8d9a0258193a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:05.496993 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e73752-afbe-4bc9-9d9d-8ecd9a552e5d None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:05.496993 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e73752-afbe-4bc9-9d9d-8ecd9a552e5d None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:05.497712 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e73752-afbe-4bc9-9d9d-8ecd9a552e5d None admin] RBAC: Adding query filter params (name=member) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:05.498257 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e73752-afbe-4bc9-9d9d-8ecd9a552e5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:05.501540 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e73752-afbe-4bc9-9d9d-8ecd9a552e5d None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:05.518733 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 219/441] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:35:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:05.520387 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e73752-afbe-4bc9-9d9d-8ecd9a552e5d None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:05.655679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f7e79-696f-493b-8ba5-8d9a0258193a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:05.658720 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f7e79-696f-493b-8ba5-8d9a0258193a None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:05.742285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e73752-afbe-4bc9-9d9d-8ecd9a552e5d None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:05.771744 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:05.795047 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039b781-e2d7-454b-ab5e-b0f11e0ff9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:05.796129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039b781-e2d7-454b-ab5e-b0f11e0ff9c8 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:05.796635 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039b781-e2d7-454b-ab5e-b0f11e0ff9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:05.797141 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039b781-e2d7-454b-ab5e-b0f11e0ff9c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:05.806017 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:05.813164 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039b781-e2d7-454b-ab5e-b0f11e0ff9c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:05.819668 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-0039b781-e2d7-454b-ab5e-b0f11e0ff9c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:35:05.819668 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:05.819668 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:05.819668 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:05.819668 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:05.819668 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:05.819668 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:05.819668 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:05.819668 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:05.819668 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:05.819668 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:05.819668 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:05.819668 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:05.819668 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:05.819668 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:05.819668 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:05.821564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:05.821564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:05.821564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:05.821564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:05.821564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:05.821564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:05.821564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:05.821564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:05.821564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:05.821564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:05.821564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:05.821564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:05.821564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:05.821564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:05.821564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:05.821564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:05.823125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:05.823125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:05.823125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:05.823125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:05.823125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:05.823125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:05.823125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:05.823125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:05.823125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:05.823125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:05.823125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:35:05.823125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:05.823125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 220/442] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:35:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:05.823125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039b781-e2d7-454b-ab5e-b0f11e0ff9c8 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:05.882206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 223/443] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:05.883905 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f7e79-696f-493b-8ba5-8d9a0258193a None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:06.005634 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039b781-e2d7-454b-ab5e-b0f11e0ff9c8 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:06.068347 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78780097-d5b6-4b43-aa11-f09ed206d0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:06.069462 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78780097-d5b6-4b43-aa11-f09ed206d0de None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:06.069937 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78780097-d5b6-4b43-aa11-f09ed206d0de None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:06.070414 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78780097-d5b6-4b43-aa11-f09ed206d0de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:06.079992 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f7e79-696f-493b-8ba5-8d9a0258193a None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:06.131340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655c69c-168f-49ab-a980-1e7e464dbede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:06.132315 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655c69c-168f-49ab-a980-1e7e464dbede None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:06.132602 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655c69c-168f-49ab-a980-1e7e464dbede None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:06.133093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655c69c-168f-49ab-a980-1e7e464dbede None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:06.134340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655c69c-168f-49ab-a980-1e7e464dbede None admin] RBAC: Adding query filter params (name=admin) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:06.134887 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655c69c-168f-49ab-a980-1e7e464dbede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:06.137502 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655c69c-168f-49ab-a980-1e7e464dbede None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:06.153198 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 224/444] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:06.154804 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655c69c-168f-49ab-a980-1e7e464dbede None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:06.165922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:06.207985 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:06.211183 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78780097-d5b6-4b43-aa11-f09ed206d0de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:06.214160 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78780097-d5b6-4b43-aa11-f09ed206d0de None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:06.356441 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655c69c-168f-49ab-a980-1e7e464dbede None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:06.422711 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 221/445] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:06.424357 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78780097-d5b6-4b43-aa11-f09ed206d0de None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:06.432203 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b9977-240e-4496-9f4a-dbe4fc188668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:06.433302 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b9977-240e-4496-9f4a-dbe4fc188668 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:06.433852 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b9977-240e-4496-9f4a-dbe4fc188668 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:06.434357 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b9977-240e-4496-9f4a-dbe4fc188668 None admin] PATH_INFO: `/v3/projects/82ce9b40374d42e880f6e6d06d93787e` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:06.438083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b9977-240e-4496-9f4a-dbe4fc188668 None admin] RBAC: Authorizing `identity:get_project(project_id=82ce9b40374d42e880f6e6d06d93787e)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:06.440989 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b9977-240e-4496-9f4a-dbe4fc188668 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:06.444235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 225/446] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:35:06 2022] GET /identity/v3/projects/82ce9b40374d42e880f6e6d06d93787e => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:06.445777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b9977-240e-4496-9f4a-dbe4fc188668 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:06.556620 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:06.597758 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78780097-d5b6-4b43-aa11-f09ed206d0de None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:06.612170 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:06.617288 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b9977-240e-4496-9f4a-dbe4fc188668 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:06.668367 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c79d4b-5639-48cb-8039-17ae0844d256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:06.669706 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c79d4b-5639-48cb-8039-17ae0844d256 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:06.669996 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c79d4b-5639-48cb-8039-17ae0844d256 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:06.670532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c79d4b-5639-48cb-8039-17ae0844d256 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:06.696605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d72e4-2993-472a-976a-f2eb17e33d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:06.697771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d72e4-2993-472a-976a-f2eb17e33d1a None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:06.698259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d72e4-2993-472a-976a-f2eb17e33d1a None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:06.698762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d72e4-2993-472a-976a-f2eb17e33d1a None admin] PATH_INFO: `/v3/projects/82ce9b40374d42e880f6e6d06d93787e` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:06.700987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d72e4-2993-472a-976a-f2eb17e33d1a None admin] RBAC: Authorizing `identity:get_project(project_id=82ce9b40374d42e880f6e6d06d93787e)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:06.704530 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d72e4-2993-472a-976a-f2eb17e33d1a None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:06.707852 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 226/447] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:35:06 2022] GET /identity/v3/projects/82ce9b40374d42e880f6e6d06d93787e => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:06.709718 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d72e4-2993-472a-976a-f2eb17e33d1a None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:06.780268 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c79d4b-5639-48cb-8039-17ae0844d256 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:06.782945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c79d4b-5639-48cb-8039-17ae0844d256 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:06.908626 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d72e4-2993-472a-976a-f2eb17e33d1a None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:06.932530 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:06.972228 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 222/448] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:06.973791 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c79d4b-5639-48cb-8039-17ae0844d256 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:06.983589 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a891a1-e62d-424c-9ed1-3a519960fd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:06.984594 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a891a1-e62d-424c-9ed1-3a519960fd7f None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:06.985029 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a891a1-e62d-424c-9ed1-3a519960fd7f None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:06.985579 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a891a1-e62d-424c-9ed1-3a519960fd7f None admin] PATH_INFO: `/v3/groups/da03d38c6f0e4724881c4babc6a4d2e4` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:06.987721 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a891a1-e62d-424c-9ed1-3a519960fd7f None admin] RBAC: Authorizing `identity:get_group(group_id=da03d38c6f0e4724881c4babc6a4d2e4)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:06.990375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a891a1-e62d-424c-9ed1-3a519960fd7f None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:06.993324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 227/449] 10.222.0.94 () {56 vars in 1180 bytes} [Wed Aug 24 04:35:06 2022] GET /identity/v3/groups/da03d38c6f0e4724881c4babc6a4d2e4 => generated 226 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:06.994825 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a891a1-e62d-424c-9ed1-3a519960fd7f None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:07.067179 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:07.175604 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c79d4b-5639-48cb-8039-17ae0844d256 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:07.208759 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a891a1-e62d-424c-9ed1-3a519960fd7f None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:07.244288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c38d0b-705e-4f0a-b8c6-ad739a127204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:07.245397 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c38d0b-705e-4f0a-b8c6-ad739a127204 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:07.245884 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c38d0b-705e-4f0a-b8c6-ad739a127204 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:07.246380 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c38d0b-705e-4f0a-b8c6-ad739a127204 None admin] PATH_INFO: `/v3/groups/da03d38c6f0e4724881c4babc6a4d2e4` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:07.248466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c38d0b-705e-4f0a-b8c6-ad739a127204 None admin] RBAC: Authorizing `identity:get_group(group_id=da03d38c6f0e4724881c4babc6a4d2e4)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:07.251276 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c38d0b-705e-4f0a-b8c6-ad739a127204 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:07.254417 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 223/450] 10.222.0.94 () {56 vars in 1180 bytes} [Wed Aug 24 04:35:06 2022] GET /identity/v3/groups/da03d38c6f0e4724881c4babc6a4d2e4 => generated 226 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:07.255892 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c38d0b-705e-4f0a-b8c6-ad739a127204 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:07.271770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1573029-ab94-457c-92fa-95a87ef2d777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:07.272860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1573029-ab94-457c-92fa-95a87ef2d777 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:07.273363 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1573029-ab94-457c-92fa-95a87ef2d777 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:07.273905 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1573029-ab94-457c-92fa-95a87ef2d777 None admin] PATH_INFO: `/v3/projects/dde3279595394b269fd2ccc96531ea28` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:07.276043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1573029-ab94-457c-92fa-95a87ef2d777 None admin] RBAC: Authorizing `identity:get_project(project_id=dde3279595394b269fd2ccc96531ea28)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:07.278761 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1573029-ab94-457c-92fa-95a87ef2d777 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:07.287867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 228/451] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:35:06 2022] GET /identity/v3/projects/dde3279595394b269fd2ccc96531ea28 => generated 344 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:07.287867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1573029-ab94-457c-92fa-95a87ef2d777 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:07.349439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:07.443407 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c38d0b-705e-4f0a-b8c6-ad739a127204 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:07.471840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1573029-ab94-457c-92fa-95a87ef2d777 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:07.475203 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:07.492695 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f27cbb-49df-4590-88f0-3a0359b4b4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:07.493811 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f27cbb-49df-4590-88f0-3a0359b4b4fa None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:07.494218 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f27cbb-49df-4590-88f0-3a0359b4b4fa None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:07.494709 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f27cbb-49df-4590-88f0-3a0359b4b4fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:07.496177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f27cbb-49df-4590-88f0-3a0359b4b4fa None admin] RBAC: Adding query filter params (group.id=da03d38c6f0e4724881c4babc6a4d2e4, role.id=f08394a5dbcf4506a17b78b4416f1680, scope.project.id=82ce9b40374d42e880f6e6d06d93787e) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:07.496737 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f27cbb-49df-4590-88f0-3a0359b4b4fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:07.499241 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f27cbb-49df-4590-88f0-3a0359b4b4fa None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:07.509144 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 224/452] 10.222.0.94 () {56 vars in 1376 bytes} [Wed Aug 24 04:35:07 2022] GET /identity/v3/role_assignments?group.id=da03d38c6f0e4724881c4babc6a4d2e4&scope.project.id=82ce9b40374d42e880f6e6d06d93787e&role.id=f08394a5dbcf4506a17b78b4416f1680 => generated 611 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:07.510522 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f27cbb-49df-4590-88f0-3a0359b4b4fa None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:07.544245 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944209be-8fb6-4034-a34c-ac8a84a9c26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:07.545874 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944209be-8fb6-4034-a34c-ac8a84a9c26f None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:07.546390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944209be-8fb6-4034-a34c-ac8a84a9c26f None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:07.546898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944209be-8fb6-4034-a34c-ac8a84a9c26f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:07.548274 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944209be-8fb6-4034-a34c-ac8a84a9c26f None admin] RBAC: Adding query filter params (group.id=da03d38c6f0e4724881c4babc6a4d2e4, role.id=1a586b803a1e429f82b85f386d7564fb, scope.project.id=82ce9b40374d42e880f6e6d06d93787e) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:07.548804 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944209be-8fb6-4034-a34c-ac8a84a9c26f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:07.551653 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944209be-8fb6-4034-a34c-ac8a84a9c26f None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:07.564500 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 229/453] 10.222.0.94 () {56 vars in 1376 bytes} [Wed Aug 24 04:35:07 2022] GET /identity/v3/role_assignments?group.id=da03d38c6f0e4724881c4babc6a4d2e4&scope.project.id=82ce9b40374d42e880f6e6d06d93787e&role.id=1a586b803a1e429f82b85f386d7564fb => generated 611 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:07.724641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f27cbb-49df-4590-88f0-3a0359b4b4fa None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:07.758420 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:07.807359 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b41fc-efc6-40a9-a5d0-db285429adbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:07.808427 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b41fc-efc6-40a9-a5d0-db285429adbf None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:07.808965 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b41fc-efc6-40a9-a5d0-db285429adbf None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:07.809497 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b41fc-efc6-40a9-a5d0-db285429adbf None admin] PATH_INFO: `/v3/groups/d1ecd259799446e88c27705eb16e01db` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:07.812274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b41fc-efc6-40a9-a5d0-db285429adbf None admin] RBAC: Authorizing `identity:get_group(group_id=d1ecd259799446e88c27705eb16e01db)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:07.815154 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b41fc-efc6-40a9-a5d0-db285429adbf None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:07.818823 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 225/454] 10.222.0.94 () {56 vars in 1180 bytes} [Wed Aug 24 04:35:07 2022] GET /identity/v3/groups/d1ecd259799446e88c27705eb16e01db => generated 229 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:07.829344 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944209be-8fb6-4034-a34c-ac8a84a9c26f None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:08.034562 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944209be-8fb6-4034-a34c-ac8a84a9c26f None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:08.107559 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0f15a-5280-4440-a901-07d482a34140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:08.108848 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0f15a-5280-4440-a901-07d482a34140 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:08.109363 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0f15a-5280-4440-a901-07d482a34140 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:08.109922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0f15a-5280-4440-a901-07d482a34140 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:08.111016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0f15a-5280-4440-a901-07d482a34140 None admin] RBAC: Adding query filter params (group.id=d1ecd259799446e88c27705eb16e01db, role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2, scope.project.id=dde3279595394b269fd2ccc96531ea28) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:08.115104 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0f15a-5280-4440-a901-07d482a34140 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:08.115104 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0f15a-5280-4440-a901-07d482a34140 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:08.123100 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 230/455] 10.222.0.94 () {56 vars in 1376 bytes} [Wed Aug 24 04:35:07 2022] GET /identity/v3/role_assignments?group.id=d1ecd259799446e88c27705eb16e01db&scope.project.id=dde3279595394b269fd2ccc96531ea28&role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 611 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:12.192012 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124f243-cc22-4f72-83da-897a80fc3984 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:12.193689 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124f243-cc22-4f72-83da-897a80fc3984 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:12.194419 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124f243-cc22-4f72-83da-897a80fc3984 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:12.197739 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 226/456] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:12.207673 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd560ed9-5997-4a49-89e6-68ac81cef529 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:12.209388 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd560ed9-5997-4a49-89e6-68ac81cef529 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:12.210222 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd560ed9-5997-4a49-89e6-68ac81cef529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:12.251696 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-dd560ed9-5997-4a49-89e6-68ac81cef529 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:12.254095 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-dd560ed9-5997-4a49-89e6-68ac81cef529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:12.320323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:12.439219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 231/457] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:12.788868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8b272-13d8-4101-a7a0-696d4c156ddd None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:12.789732 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8b272-13d8-4101-a7a0-696d4c156ddd None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:12.790263 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8b272-13d8-4101-a7a0-696d4c156ddd None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:12.792692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 227/458] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:12.803271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e7a72-7f93-4788-b1b4-b692c5a105b3 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:12.804272 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e7a72-7f93-4788-b1b4-b692c5a105b3 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:12.804795 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e7a72-7f93-4788-b1b4-b692c5a105b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:12.823329 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ce4a4-2b82-491c-9149-2cec7cd417cc None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:12.824260 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ce4a4-2b82-491c-9149-2cec7cd417cc None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:12.825024 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ce4a4-2b82-491c-9149-2cec7cd417cc None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:12.828687 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 228/459] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:35:12.837926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfba90-637e-4b05-8654-a4d55d839add None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:12.838292 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-9c7e7a72-7f93-4788-b1b4-b692c5a105b3 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:12.838641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfba90-637e-4b05-8654-a4d55d839add None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:12.839219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfba90-637e-4b05-8654-a4d55d839add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:12.840920 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-9c7e7a72-7f93-4788-b1b4-b692c5a105b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:12.903674 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-fabfba90-637e-4b05-8654-a4d55d839add None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:12.907008 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-fabfba90-637e-4b05-8654-a4d55d839add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:13.081706 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 232/460] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:13.138304 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e7a72-7f93-4788-b1b4-b692c5a105b3 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:13.143226 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 229/461] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:13.344836 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:13.371282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e7a72-7f93-4788-b1b4-b692c5a105b3 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:13.464836 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c0f61-8867-46ae-aa28-e082ce3eab30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:13.466466 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c0f61-8867-46ae-aa28-e082ce3eab30 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:13.467902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c0f61-8867-46ae-aa28-e082ce3eab30 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:13.468697 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c0f61-8867-46ae-aa28-e082ce3eab30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:13.496686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c0f61-8867-46ae-aa28-e082ce3eab30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:13.499980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c0f61-8867-46ae-aa28-e082ce3eab30 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:13.538044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-5e1c0f61-8867-46ae-aa28-e082ce3eab30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:13.538044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:13.538044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:13.538044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:13.538044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:13.538044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:13.538044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:13.538044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:13.538044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:13.538044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:13.538044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:13.538044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:13.538044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:13.538044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:13.538044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:13.538044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:13.539797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:13.539797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:13.539797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:13.539797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:13.539797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:13.539797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:13.539797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:13.539797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:13.539797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:13.539797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:13.539797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:13.539797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:13.539797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:13.539797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:13.539797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:13.539797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:13.539797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:13.541523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:13.541523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:13.541523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:13.545001 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 233/462] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:35:13.555538 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabfba90-637e-4b05-8654-a4d55d839add None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:13.564065 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c0f61-8867-46ae-aa28-e082ce3eab30 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:13.768715 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabfba90-637e-4b05-8654-a4d55d839add None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:13.790598 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:13.796389 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c0f61-8867-46ae-aa28-e082ce3eab30 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:13.831239 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e0265-f4f3-4c7b-a21a-8ad2f825f21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:13.831967 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e0265-f4f3-4c7b-a21a-8ad2f825f21d None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:13.832252 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e0265-f4f3-4c7b-a21a-8ad2f825f21d None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:13.832513 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e0265-f4f3-4c7b-a21a-8ad2f825f21d None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:13.833176 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e0265-f4f3-4c7b-a21a-8ad2f825f21d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:13.833589 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e0265-f4f3-4c7b-a21a-8ad2f825f21d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:13.835407 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e0265-f4f3-4c7b-a21a-8ad2f825f21d None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:13.853649 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 230/463] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:13.855175 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c240c40-d231-48c7-8871-a5da97df3fa1 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:13.855749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c240c40-d231-48c7-8871-a5da97df3fa1 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:13.855923 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c240c40-d231-48c7-8871-a5da97df3fa1 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:13.858684 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 231/464] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:13.863805 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf297f22-50c5-460e-b9c2-d74f9f32afa6 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:13.863805 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf297f22-50c5-460e-b9c2-d74f9f32afa6 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:13.863805 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf297f22-50c5-460e-b9c2-d74f9f32afa6 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:13.863805 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 232/465] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:13.864447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf297f22-50c5-460e-b9c2-d74f9f32afa6 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:13.871835 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b611d3-9a12-4fbe-a392-c33529318359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:13.872911 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b611d3-9a12-4fbe-a392-c33529318359 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:13.873976 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b611d3-9a12-4fbe-a392-c33529318359 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:13.874574 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b611d3-9a12-4fbe-a392-c33529318359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:13.896289 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b611d3-9a12-4fbe-a392-c33529318359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:13.898043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b611d3-9a12-4fbe-a392-c33529318359 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:13.900520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:13.920860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-e5b611d3-9a12-4fbe-a392-c33529318359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:13.920860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:13.920860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:13.920860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:13.920860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:13.920860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:13.920860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:13.920860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:13.920860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:13.920860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:13.920860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:13.920860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:13.920860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:13.920860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:13.920860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:13.920860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:13.923254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:13.923254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:13.923254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:13.923254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:13.923254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:13.923254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:13.923254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:13.923254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:13.923254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:13.923254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:13.923254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:13.923254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:13.923254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:13.923254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:13.923254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:13.923254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:13.923254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:13.924991 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:13.924991 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:13.924991 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:13.924991 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 234/466] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:35:13.924991 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b611d3-9a12-4fbe-a392-c33529318359 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:14.033061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf297f22-50c5-460e-b9c2-d74f9f32afa6 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:14.098589 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1a945-b108-4bbe-8eb3-1efb08e4779f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:14.099684 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1a945-b108-4bbe-8eb3-1efb08e4779f None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:14.100189 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1a945-b108-4bbe-8eb3-1efb08e4779f None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:14.100705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1a945-b108-4bbe-8eb3-1efb08e4779f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:14.104850 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b611d3-9a12-4fbe-a392-c33529318359 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:14.120588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1a945-b108-4bbe-8eb3-1efb08e4779f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:14.123636 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1a945-b108-4bbe-8eb3-1efb08e4779f None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:14.152087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-dfe1a945-b108-4bbe-8eb3-1efb08e4779f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:14.152087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:14.152087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:14.152087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:14.152087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:14.152087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:14.152087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:14.152087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:14.152087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:14.152087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:14.152087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:14.152087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:14.152087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:14.152087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:14.152087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:14.152087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:14.154114 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:14.154114 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:14.154114 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:14.154114 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:14.154114 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:14.154114 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:14.154114 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:14.154114 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:14.154114 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:14.154114 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:14.154114 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:14.154114 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:14.154114 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:14.154114 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:14.154114 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:14.154114 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:14.154114 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:14.156380 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:14.156380 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:14.156380 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:14.156380 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 233/467] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:14.156778 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0001063-afc8-45b4-b81c-436a354f639e None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:14.157166 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0001063-afc8-45b4-b81c-436a354f639e None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:14.157626 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0001063-afc8-45b4-b81c-436a354f639e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:14.166327 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39fa34-d89f-48cc-9944-60f686529c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:14.167471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39fa34-d89f-48cc-9944-60f686529c96 None admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:14.167844 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39fa34-d89f-48cc-9944-60f686529c96 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:14.168296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39fa34-d89f-48cc-9944-60f686529c96 None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:14.169328 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39fa34-d89f-48cc-9944-60f686529c96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:14.172435 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39fa34-d89f-48cc-9944-60f686529c96 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:14.187712 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-d0001063-afc8-45b4-b81c-436a354f639e None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:14.189840 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-d0001063-afc8-45b4-b81c-436a354f639e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:14.209958 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 235/468] 10.222.0.94 () {60 vars in 1132 bytes} [Wed Aug 24 04:35:13 2022] POST /identity/v3/users => generated 246 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:35:14.212383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1f7e9-dddd-4015-a043-2b6f9857dbe7 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:14.212890 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1f7e9-dddd-4015-a043-2b6f9857dbe7 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:14.213373 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1f7e9-dddd-4015-a043-2b6f9857dbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:14.228448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:14.244183 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-15f1f7e9-dddd-4015-a043-2b6f9857dbe7 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:14.246140 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-15f1f7e9-dddd-4015-a043-2b6f9857dbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:14.313096 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 234/469] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:14.314039 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0001063-afc8-45b4-b81c-436a354f639e None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:14.327353 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:14.367058 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 236/470] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:14.368683 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1f7e9-dddd-4015-a043-2b6f9857dbe7 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:14.541321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0001063-afc8-45b4-b81c-436a354f639e None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:14.581503 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1f7e9-dddd-4015-a043-2b6f9857dbe7 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:14.630298 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb8ae8-96a8-41fa-9305-b7e1fa4b1dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:14.631314 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb8ae8-96a8-41fa-9305-b7e1fa4b1dd4 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:14.631904 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb8ae8-96a8-41fa-9305-b7e1fa4b1dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:14.632295 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb8ae8-96a8-41fa-9305-b7e1fa4b1dd4 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:14.633036 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b57be-269f-41fc-8142-064d7fbe1d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:14.633605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb8ae8-96a8-41fa-9305-b7e1fa4b1dd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:14.633884 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b57be-269f-41fc-8142-064d7fbe1d69 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:14.634138 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb8ae8-96a8-41fa-9305-b7e1fa4b1dd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:14.634394 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b57be-269f-41fc-8142-064d7fbe1d69 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:14.634775 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b57be-269f-41fc-8142-064d7fbe1d69 None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:14.635849 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b57be-269f-41fc-8142-064d7fbe1d69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:14.636248 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b57be-269f-41fc-8142-064d7fbe1d69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:14.636653 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb8ae8-96a8-41fa-9305-b7e1fa4b1dd4 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:14.637901 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b57be-269f-41fc-8142-064d7fbe1d69 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:14.660841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 235/471] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:14.661296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 237/472] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:14.667789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb8ae8-96a8-41fa-9305-b7e1fa4b1dd4 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:14.669126 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b57be-269f-41fc-8142-064d7fbe1d69 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:14.697188 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:14.759861 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:14.833350 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb8ae8-96a8-41fa-9305-b7e1fa4b1dd4 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:14.839750 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b57be-269f-41fc-8142-064d7fbe1d69 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:14.875120 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319f55b-ef7d-4575-8f4b-71c64a30eb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:14.876185 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319f55b-ef7d-4575-8f4b-71c64a30eb57 None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:14.876668 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319f55b-ef7d-4575-8f4b-71c64a30eb57 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:14.877517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319f55b-ef7d-4575-8f4b-71c64a30eb57 None admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:14.878409 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319f55b-ef7d-4575-8f4b-71c64a30eb57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:14.879924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319f55b-ef7d-4575-8f4b-71c64a30eb57 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:14.882998 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf605990-0b4b-462d-b72b-a480fad19e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:14.883824 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf605990-0b4b-462d-b72b-a480fad19e4a None admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:14.884246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf605990-0b4b-462d-b72b-a480fad19e4a None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:14.884687 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf605990-0b4b-462d-b72b-a480fad19e4a None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:14.885520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf605990-0b4b-462d-b72b-a480fad19e4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:14.887177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf605990-0b4b-462d-b72b-a480fad19e4a None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:14.906269 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 236/473] 10.222.0.94 () {60 vars in 1132 bytes} [Wed Aug 24 04:35:14 2022] POST /identity/v3/users => generated 248 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:35:14.913019 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319f55b-ef7d-4575-8f4b-71c64a30eb57 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:14.929539 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 238/474] 10.222.0.94 () {60 vars in 1132 bytes} [Wed Aug 24 04:35:14 2022] POST /identity/v3/users => generated 248 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:35:14.931020 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf605990-0b4b-462d-b72b-a480fad19e4a None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:15.033994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:15.095788 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:15.106956 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf605990-0b4b-462d-b72b-a480fad19e4a None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:15.115647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319f55b-ef7d-4575-8f4b-71c64a30eb57 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:15.169883 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe3b3b-6ceb-4097-bcb4-04effb52ff0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:15.170520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe3b3b-6ceb-4097-bcb4-04effb52ff0e None admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:15.170791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe3b3b-6ceb-4097-bcb4-04effb52ff0e None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:15.171047 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe3b3b-6ceb-4097-bcb4-04effb52ff0e None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:15.171770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe3b3b-6ceb-4097-bcb4-04effb52ff0e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:15.173264 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe3b3b-6ceb-4097-bcb4-04effb52ff0e None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:15.183675 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a72bb-704a-4abd-8bed-3f278df6bc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:15.184282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.sql.core [None req-e3fe3b3b-6ceb-4097-bcb4-04effb52ff0e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 04:35:15.184282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 04:35:15.184282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [parameters: {'id': 'b855ec5adcbe461293b92dcd73825d1e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 04:35:15.184282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93411) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 04:35:15.184727 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a72bb-704a-4abd-8bed-3f278df6bc1f None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:15.184727 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a72bb-704a-4abd-8bed-3f278df6bc1f None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:15.185025 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a72bb-704a-4abd-8bed-3f278df6bc1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:15.203812 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a72bb-704a-4abd-8bed-3f278df6bc1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:15.206016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a72bb-704a-4abd-8bed-3f278df6bc1f None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:15.210462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-e3fe3b3b-6ceb-4097-bcb4-04effb52ff0e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 04:35:15.210462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:15.210462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:35:15.210462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:35:15.210462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:35:15.210462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:35:15.210462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:35:15.210462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:35:15.210462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:35:15.210462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:35:15.210462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:35:15.210462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:35:15.210462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:35:15.210462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application result.read() Aug 24 04:35:15.210462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:35:15.211438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:35:15.211438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:35:15.211438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:35:15.211438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:35:15.211438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:35:15.211438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:35:15.211438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:35:15.211438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 04:35:15.211438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:15.211438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 04:35:15.211438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:15.211438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:15.211438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 04:35:15.211438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 04:35:15.211438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 04:35:15.211438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 04:35:15.211438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:35:15.211438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:35:15.212532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 04:35:15.212532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application yield resource Aug 24 04:35:15.212532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:35:15.212532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:35:15.212532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 04:35:15.212532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 04:35:15.212532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 04:35:15.212532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 04:35:15.212532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 04:35:15.212532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise self.value Aug 24 04:35:15.212532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 04:35:15.212532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 04:35:15.212532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 04:35:15.212532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application session.commit() Aug 24 04:35:15.212532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 04:35:15.212532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 04:35:15.212532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 04:35:15.213980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 04:35:15.213980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 04:35:15.213980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self.session.flush() Aug 24 04:35:15.213980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 04:35:15.213980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 04:35:15.213980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 04:35:15.213980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 04:35:15.213980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 04:35:15.213980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application compat.raise_( Aug 24 04:35:15.213980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:35:15.213980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception Aug 24 04:35:15.213980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 04:35:15.213980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 04:35:15.213980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 04:35:15.213980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 04:35:15.213980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 04:35:15.213980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 04:35:15.214910 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 04:35:15.214910 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 04:35:15.214910 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 04:35:15.214910 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 04:35:15.214910 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 04:35:15.214910 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 04:35:15.214910 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 04:35:15.214910 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 04:35:15.214910 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 04:35:15.214910 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 04:35:15.214910 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 04:35:15.214910 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 04:35:15.214910 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 04:35:15.214910 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 04:35:15.214910 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:35:15.214910 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception Aug 24 04:35:15.216025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:35:15.216025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:35:15.216025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:35:15.216025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:35:15.216025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:35:15.216025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:35:15.216025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:35:15.216025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:35:15.216025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:35:15.216025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:35:15.216025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:35:15.216025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application result.read() Aug 24 04:35:15.216025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:35:15.216025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:35:15.216025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:35:15.216025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:35:15.220471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:35:15.220471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:35:15.220471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:35:15.220471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:35:15.220471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 04:35:15.220471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 04:35:15.220471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [parameters: {'id': 'b855ec5adcbe461293b92dcd73825d1e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 04:35:15.220471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 04:35:15.220471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:15.220471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:35:15.220471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:15.220471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:15.220471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:15.220471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:15.220471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:15.220471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:15.223034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:15.223034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:15.223034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:15.223034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:15.223034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:15.223034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:15.223034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 04:35:15.223034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 04:35:15.223034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:15.223034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:15.223034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 04:35:15.223034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 04:35:15.223034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 04:35:15.223034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 04:35:15.223034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 04:35:15.223034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:15.225841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 239/475] 10.222.0.94 () {60 vars in 1131 bytes} [Wed Aug 24 04:35:14 2022] POST /identity/v3/roles => generated 144 bytes in 286 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:15.227783 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe3b3b-6ceb-4097-bcb4-04effb52ff0e None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:15.244439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-131a72bb-704a-4abd-8bed-3f278df6bc1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:15.244439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:15.244439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:15.244439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:15.244439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:15.244439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:15.244439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:15.244439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:15.244439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:15.244439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:15.244439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:15.244439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:15.244439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:15.244439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:15.244439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:15.244439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:15.246066 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:15.246066 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:15.246066 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:15.246066 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:15.246066 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:15.246066 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:15.246066 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:15.246066 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:15.246066 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:15.246066 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:15.246066 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:15.246066 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:15.246066 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:15.246066 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:15.246066 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:15.246066 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:15.246066 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:15.247164 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:15.247164 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:15.247164 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:15.250493 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 237/476] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:15.258561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a72bb-704a-4abd-8bed-3f278df6bc1f None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:15.397560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe3b3b-6ceb-4097-bcb4-04effb52ff0e None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:15.433842 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a72bb-704a-4abd-8bed-3f278df6bc1f None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:15.452361 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5185ae-c3bf-45a6-9ce0-a9e2ea372c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:15.452627 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5185ae-c3bf-45a6-9ce0-a9e2ea372c35 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:15.452889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5185ae-c3bf-45a6-9ce0-a9e2ea372c35 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:15.453123 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5185ae-c3bf-45a6-9ce0-a9e2ea372c35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:15.473613 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5185ae-c3bf-45a6-9ce0-a9e2ea372c35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:15.480257 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-4c5185ae-c3bf-45a6-9ce0-a9e2ea372c35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:35:15.480257 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:15.480257 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:15.480257 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:15.480257 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:15.480257 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:15.480257 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:15.480257 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:15.480257 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:15.480257 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:15.480257 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:15.480257 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:15.480257 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:15.480257 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:15.480257 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:15.480257 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:15.482115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:15.482115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:15.482115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:15.482115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:15.482115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:15.482115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:15.482115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:15.482115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:15.482115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:15.482115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:15.482115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:15.482115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:15.482115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:15.482115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:15.482115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:15.482115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:15.484282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:15.484282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:15.484282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:15.484282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:15.484282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:15.484282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:15.484282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:15.484282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:15.484282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:15.484282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:15.484282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:35:15.484282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:15.487032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:15.493513 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 240/477] 10.222.0.94 () {56 vars in 1114 bytes} [Wed Aug 24 04:35:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:35:15.496964 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5185ae-c3bf-45a6-9ce0-a9e2ea372c35 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:15.524212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5823b-1d0f-4d75-a245-3d9478e76dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:15.524911 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5823b-1d0f-4d75-a245-3d9478e76dd7 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:15.525279 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5823b-1d0f-4d75-a245-3d9478e76dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:15.525675 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5823b-1d0f-4d75-a245-3d9478e76dd7 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:15.526676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5823b-1d0f-4d75-a245-3d9478e76dd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:15.527094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5823b-1d0f-4d75-a245-3d9478e76dd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:15.532074 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5823b-1d0f-4d75-a245-3d9478e76dd7 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:15.554733 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:15.566441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 238/478] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:15.586473 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5823b-1d0f-4d75-a245-3d9478e76dd7 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:15.709927 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5185ae-c3bf-45a6-9ce0-a9e2ea372c35 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:15.754931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba7125-495c-49f9-9949-09742c3153f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:15.755710 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba7125-495c-49f9-9949-09742c3153f2 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:15.756000 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba7125-495c-49f9-9949-09742c3153f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:15.756273 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba7125-495c-49f9-9949-09742c3153f2 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:15.756996 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba7125-495c-49f9-9949-09742c3153f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:15.757298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba7125-495c-49f9-9949-09742c3153f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:15.759054 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba7125-495c-49f9-9949-09742c3153f2 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:15.781974 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 241/479] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:35:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:15.885035 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5823b-1d0f-4d75-a245-3d9478e76dd7 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:15.965596 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48196fc-0dfd-4542-889f-af89b3d3a570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:15.966539 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48196fc-0dfd-4542-889f-af89b3d3a570 None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:15.967530 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48196fc-0dfd-4542-889f-af89b3d3a570 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:15.968098 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48196fc-0dfd-4542-889f-af89b3d3a570 None admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:15.969223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48196fc-0dfd-4542-889f-af89b3d3a570 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:15.972155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48196fc-0dfd-4542-889f-af89b3d3a570 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:16.012761 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 239/480] 10.222.0.94 () {60 vars in 1132 bytes} [Wed Aug 24 04:35:15 2022] POST /identity/v3/users => generated 249 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:35:17.812550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6e84d-c548-4d0d-8e7d-147c181eea76 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:17.813332 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6e84d-c548-4d0d-8e7d-147c181eea76 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:17.813757 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6e84d-c548-4d0d-8e7d-147c181eea76 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:17.816762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 242/481] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:17.823257 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af3b58-c82e-42db-addd-2561cab622da None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:17.824290 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af3b58-c82e-42db-addd-2561cab622da None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:17.824290 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af3b58-c82e-42db-addd-2561cab622da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:17.853286 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-29af3b58-c82e-42db-addd-2561cab622da None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:17.854636 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-29af3b58-c82e-42db-addd-2561cab622da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:17.902603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:18.009907 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 240/482] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:35:18.631945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6e84d-c548-4d0d-8e7d-147c181eea76 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:18.817980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:18.856889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6e84d-c548-4d0d-8e7d-147c181eea76 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:18.908043 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1c34d-7561-4a1e-a9a7-6605ff80f0a3 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:18.908733 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1c34d-7561-4a1e-a9a7-6605ff80f0a3 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:18.908855 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1c34d-7561-4a1e-a9a7-6605ff80f0a3 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:18.912060 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 241/483] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:18.921542 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ab53e-4049-4515-96ed-770eab4ef5ab None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:18.922031 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ab53e-4049-4515-96ed-770eab4ef5ab None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:18.922499 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ab53e-4049-4515-96ed-770eab4ef5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:18.935746 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b4d2e-ed76-49b3-9da3-d4c6eadc34aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:18.937378 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b4d2e-ed76-49b3-9da3-d4c6eadc34aa None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:18.938301 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b4d2e-ed76-49b3-9da3-d4c6eadc34aa None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:18.939067 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b4d2e-ed76-49b3-9da3-d4c6eadc34aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:18.962856 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b4d2e-ed76-49b3-9da3-d4c6eadc34aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:18.973832 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-069b4d2e-ed76-49b3-9da3-d4c6eadc34aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:18.973832 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:18.973832 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:18.973832 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:18.973832 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:18.973832 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:18.973832 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:18.973832 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:18.973832 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:18.973832 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:18.973832 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:18.973832 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:18.973832 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:18.973832 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:18.973832 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:18.973832 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:18.975635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:18.975635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:18.975635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:18.975635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:18.975635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:18.975635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:18.975635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:18.975635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:18.975635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:18.975635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:18.975635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:18.975635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:18.975635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:18.975635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:18.975635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:18.975635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:18.977138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:18.977138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:18.977138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:18.977138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:18.977138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:18.977138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:18.977138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:18.977138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:18.977138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:18.977138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:18.977138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:18.977138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:18.981935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 243/484] 10.222.0.94 () {56 vars in 1102 bytes} [Wed Aug 24 04:35:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:18.989445 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf987a5-6f3e-404d-9f04-10e8b6b2d1a6 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:18.989445 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf987a5-6f3e-404d-9f04-10e8b6b2d1a6 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:18.989445 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf987a5-6f3e-404d-9f04-10e8b6b2d1a6 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:18.991847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 244/485] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:35:18.995229 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf987a5-6f3e-404d-9f04-10e8b6b2d1a6 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:18.999182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-486ab53e-4049-4515-96ed-770eab4ef5ab None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:19.002068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-486ab53e-4049-4515-96ed-770eab4ef5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:19.145588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 242/486] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:19.148124 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb274e86-4c8c-4042-b92e-d9ae93ba2da1 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:19.148773 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb274e86-4c8c-4042-b92e-d9ae93ba2da1 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:19.149113 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb274e86-4c8c-4042-b92e-d9ae93ba2da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:19.190284 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf987a5-6f3e-404d-9f04-10e8b6b2d1a6 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:19.219483 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-fb274e86-4c8c-4042-b92e-d9ae93ba2da1 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:19.222016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-fb274e86-4c8c-4042-b92e-d9ae93ba2da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:19.239060 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1405bf-dc13-4962-a4fc-3c720b2205fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:19.240244 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1405bf-dc13-4962-a4fc-3c720b2205fd None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:19.240783 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1405bf-dc13-4962-a4fc-3c720b2205fd None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:19.241282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1405bf-dc13-4962-a4fc-3c720b2205fd None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:19.242283 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1405bf-dc13-4962-a4fc-3c720b2205fd None admin] RBAC: Adding query filter params (name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:19.242841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1405bf-dc13-4962-a4fc-3c720b2205fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:19.245063 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1405bf-dc13-4962-a4fc-3c720b2205fd None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:19.270101 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 245/487] 10.222.0.94 () {56 vars in 1103 bytes} [Wed Aug 24 04:35:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:19.276176 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1405bf-dc13-4962-a4fc-3c720b2205fd None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:19.310031 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:19.377560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 243/488] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:19.582356 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1405bf-dc13-4962-a4fc-3c720b2205fd None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:19.639930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df694f9-064a-40d2-b9d5-80cd6ead0937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:19.640663 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df694f9-064a-40d2-b9d5-80cd6ead0937 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:19.640985 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df694f9-064a-40d2-b9d5-80cd6ead0937 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:19.641266 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df694f9-064a-40d2-b9d5-80cd6ead0937 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:19.666476 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df694f9-064a-40d2-b9d5-80cd6ead0937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:19.668256 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df694f9-064a-40d2-b9d5-80cd6ead0937 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:19.693512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-1df694f9-064a-40d2-b9d5-80cd6ead0937 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:19.693512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:19.693512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:19.693512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:19.693512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:19.693512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:19.693512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:19.693512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:19.693512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:19.693512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:19.693512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:19.693512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:19.693512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:19.693512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:19.693512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:19.693512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:19.695249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:19.695249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:19.695249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:19.695249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:19.695249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:19.695249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:19.695249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:19.695249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:19.695249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:19.695249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:19.695249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:19.695249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:19.695249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:19.695249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:19.695249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:19.695249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:19.695249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:19.696913 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:19.696913 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:19.696913 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:19.696913 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 246/489] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 420 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:35:19.708808 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb274e86-4c8c-4042-b92e-d9ae93ba2da1 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:19.802056 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:19.850035 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df694f9-064a-40d2-b9d5-80cd6ead0937 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:19.941462 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb274e86-4c8c-4042-b92e-d9ae93ba2da1 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:19.984519 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:20.003559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fcc60-efb6-41f2-8617-32093ce0d744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:20.004552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fcc60-efb6-41f2-8617-32093ce0d744 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:20.004997 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fcc60-efb6-41f2-8617-32093ce0d744 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:20.005482 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fcc60-efb6-41f2-8617-32093ce0d744 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:20.006702 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fcc60-efb6-41f2-8617-32093ce0d744 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:20.007177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fcc60-efb6-41f2-8617-32093ce0d744 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:20.009262 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fcc60-efb6-41f2-8617-32093ce0d744 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:20.029123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 244/490] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:20.030717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fcc60-efb6-41f2-8617-32093ce0d744 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:20.086653 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df694f9-064a-40d2-b9d5-80cd6ead0937 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:20.161385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76887b2-e218-4e5c-a007-99d7bca4d936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:20.162405 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76887b2-e218-4e5c-a007-99d7bca4d936 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:20.162811 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76887b2-e218-4e5c-a007-99d7bca4d936 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:20.163323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76887b2-e218-4e5c-a007-99d7bca4d936 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:20.185872 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76887b2-e218-4e5c-a007-99d7bca4d936 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:20.196514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-b76887b2-e218-4e5c-a007-99d7bca4d936 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:20.196514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:20.196514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:20.196514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:20.196514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:20.196514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:20.196514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:20.196514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:20.196514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:20.196514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:20.196514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:20.196514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:20.196514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:20.196514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:20.196514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:20.196514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:20.198484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:20.198484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:20.198484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:20.198484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:20.198484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:20.198484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:20.198484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:20.198484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:20.198484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:20.198484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:20.198484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:20.198484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:20.198484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:20.198484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:20.198484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:20.198484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:20.200043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:20.200043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:20.200043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:20.200043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:20.200043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:20.200043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:20.200043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:20.200043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:20.200043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:20.200043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:20.200043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:20.200043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:20.200043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 247/491] 10.222.0.94 () {56 vars in 1102 bytes} [Wed Aug 24 04:35:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:20.203737 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39589d93-1a3a-47df-bc33-0be3565ea00d None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:20.204215 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39589d93-1a3a-47df-bc33-0be3565ea00d None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:20.204776 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39589d93-1a3a-47df-bc33-0be3565ea00d None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:20.209173 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 248/492] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:20.209173 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39589d93-1a3a-47df-bc33-0be3565ea00d None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:20.218700 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:20.238726 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fcc60-efb6-41f2-8617-32093ce0d744 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:20.298316 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8fc64-f7c0-45ad-8a9f-6b21270e1e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:20.299416 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8fc64-f7c0-45ad-8a9f-6b21270e1e75 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:20.299915 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8fc64-f7c0-45ad-8a9f-6b21270e1e75 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:20.300389 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8fc64-f7c0-45ad-8a9f-6b21270e1e75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:20.319510 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8fc64-f7c0-45ad-8a9f-6b21270e1e75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:20.329599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-0ed8fc64-f7c0-45ad-8a9f-6b21270e1e75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:20.329599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:20.329599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:20.329599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:20.329599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:20.329599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:20.329599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:20.329599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:20.329599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:20.329599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:20.329599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:20.329599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:20.329599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:20.329599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:20.329599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:20.329599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:20.331391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:20.331391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:20.331391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:20.331391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:20.331391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:20.331391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:20.331391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:20.331391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:20.331391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:20.331391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:20.331391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:20.331391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:20.331391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:20.331391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:20.331391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:20.331391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:20.333954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:20.333954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:20.333954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:20.333954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:20.333954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:20.333954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:20.333954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:20.333954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:20.333954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:20.333954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:20.333954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:20.333954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:20.333954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 245/493] 10.222.0.94 () {56 vars in 1102 bytes} [Wed Aug 24 04:35:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:20.333954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe0508-292f-45d8-b858-9ae29b863f81 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:20.335571 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe0508-292f-45d8-b858-9ae29b863f81 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:20.335571 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe0508-292f-45d8-b858-9ae29b863f81 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:20.336626 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 246/494] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:20.339524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe0508-292f-45d8-b858-9ae29b863f81 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:20.383200 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39589d93-1a3a-47df-bc33-0be3565ea00d None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:20.419377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:20.460147 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e742d-2958-4381-914c-c2a71517b423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:20.461241 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e742d-2958-4381-914c-c2a71517b423 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:20.461765 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e742d-2958-4381-914c-c2a71517b423 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:20.462231 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e742d-2958-4381-914c-c2a71517b423 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:20.477088 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e742d-2958-4381-914c-c2a71517b423 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:20.479974 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e742d-2958-4381-914c-c2a71517b423 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:20.508375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-fd5e742d-2958-4381-914c-c2a71517b423 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:35:20.508375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:20.508375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:20.508375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:20.508375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:20.508375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:20.508375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:20.508375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:20.508375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:20.508375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:20.508375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:20.508375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:20.508375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:35:20.508375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:35:20.508375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:35:20.508375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:35:20.510218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:20.510218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:20.510218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:35:20.510218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:20.510218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:35:20.510218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:20.510218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:20.510218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:20.510218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:20.510218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:20.510218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:20.510218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:20.510218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:20.510218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:20.510218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:20.510218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:20.510218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:20.510218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:20.511902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:20.511902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:20.511902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:35:20.511902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:35:20.511902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:35:20.511902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:35:20.511902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:35:20.511902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:35:20.511902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:35:20.511902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:20.511902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 249/495] 10.222.0.94 () {56 vars in 1093 bytes} [Wed Aug 24 04:35:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:20.514709 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280684b-1c9f-437a-9dfe-6ffd71438497 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:20.515096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280684b-1c9f-437a-9dfe-6ffd71438497 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:20.515658 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280684b-1c9f-437a-9dfe-6ffd71438497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:20.548076 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe0508-292f-45d8-b858-9ae29b863f81 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:20.549358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-3280684b-1c9f-437a-9dfe-6ffd71438497 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:20.551164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-3280684b-1c9f-437a-9dfe-6ffd71438497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:20.615159 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382a2cd-50c7-482b-89c7-a1b1acd795fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:20.616136 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382a2cd-50c7-482b-89c7-a1b1acd795fb None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:20.616606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382a2cd-50c7-482b-89c7-a1b1acd795fb None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:20.617056 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382a2cd-50c7-482b-89c7-a1b1acd795fb None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:20.618181 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382a2cd-50c7-482b-89c7-a1b1acd795fb None admin] RBAC: Adding query filter params (name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:20.618670 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382a2cd-50c7-482b-89c7-a1b1acd795fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:20.621118 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382a2cd-50c7-482b-89c7-a1b1acd795fb None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:20.633370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 247/496] 10.222.0.94 () {56 vars in 1103 bytes} [Wed Aug 24 04:35:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:20.634535 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382a2cd-50c7-482b-89c7-a1b1acd795fb None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:20.651145 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:20.674649 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 250/497] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:20.678267 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597812a0-49ce-47b9-b9bb-b529410305fa None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:20.678727 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597812a0-49ce-47b9-b9bb-b529410305fa None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:20.679258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597812a0-49ce-47b9-b9bb-b529410305fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:20.716936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-597812a0-49ce-47b9-b9bb-b529410305fa None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:20.716936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-597812a0-49ce-47b9-b9bb-b529410305fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:20.848485 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382a2cd-50c7-482b-89c7-a1b1acd795fb None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:20.869997 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 251/498] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:20.872827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597812a0-49ce-47b9-b9bb-b529410305fa None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:20.923738 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2ac14-6c4b-4a8f-b8a6-7ebecc0eef54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:20.925398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2ac14-6c4b-4a8f-b8a6-7ebecc0eef54 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:20.926354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2ac14-6c4b-4a8f-b8a6-7ebecc0eef54 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:20.927154 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2ac14-6c4b-4a8f-b8a6-7ebecc0eef54 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:20.928705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2ac14-6c4b-4a8f-b8a6-7ebecc0eef54 None admin] RBAC: Adding query filter params (name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:20.929529 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2ac14-6c4b-4a8f-b8a6-7ebecc0eef54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:20.931966 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2ac14-6c4b-4a8f-b8a6-7ebecc0eef54 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:20.947755 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:20.958069 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 248/499] 10.222.0.94 () {56 vars in 1103 bytes} [Wed Aug 24 04:35:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:20.960600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2ac14-6c4b-4a8f-b8a6-7ebecc0eef54 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:21.082984 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597812a0-49ce-47b9-b9bb-b529410305fa None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:21.097516 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:21.149390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5af61-be12-4106-834e-96991658610d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:21.150543 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5af61-be12-4106-834e-96991658610d None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:21.151006 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5af61-be12-4106-834e-96991658610d None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:21.151499 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5af61-be12-4106-834e-96991658610d None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:21.152910 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5af61-be12-4106-834e-96991658610d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:21.153487 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5af61-be12-4106-834e-96991658610d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:21.155772 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5af61-be12-4106-834e-96991658610d None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:21.163485 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2ac14-6c4b-4a8f-b8a6-7ebecc0eef54 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:21.203817 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 252/500] 10.222.0.94 () {56 vars in 1133 bytes} [Wed Aug 24 04:35:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:21.205053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5af61-be12-4106-834e-96991658610d None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:21.234694 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c862710-9013-4e86-a826-8a2e12ce9cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:21.235788 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c862710-9013-4e86-a826-8a2e12ce9cd2 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:21.236295 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c862710-9013-4e86-a826-8a2e12ce9cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:21.237197 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c862710-9013-4e86-a826-8a2e12ce9cd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:21.253587 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c862710-9013-4e86-a826-8a2e12ce9cd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:21.255197 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c862710-9013-4e86-a826-8a2e12ce9cd2 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:21.272023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-3c862710-9013-4e86-a826-8a2e12ce9cd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:21.272023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:21.272023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:21.272023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:21.272023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:21.272023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:21.272023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:21.272023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:21.272023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:21.272023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:21.272023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:21.272023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:21.272023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:21.272023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:21.272023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:21.272023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:21.273825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:21.273825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:21.273825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:21.273825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:21.273825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:21.273825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:21.273825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:21.273825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:21.273825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:21.273825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:21.273825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:21.273825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:21.273825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:21.273825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:21.273825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:21.273825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:21.273825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:21.275544 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:21.275544 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:21.275544 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:21.275544 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 249/501] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:21.275544 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c862710-9013-4e86-a826-8a2e12ce9cd2 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:21.344593 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:21.355237 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5af61-be12-4106-834e-96991658610d None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:21.408961 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ca28f-8b26-4a96-bab9-5e9a4e1f0bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:21.409898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ca28f-8b26-4a96-bab9-5e9a4e1f0bd0 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:21.410181 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ca28f-8b26-4a96-bab9-5e9a4e1f0bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:21.410454 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ca28f-8b26-4a96-bab9-5e9a4e1f0bd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:21.423939 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ca28f-8b26-4a96-bab9-5e9a4e1f0bd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:21.424925 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c862710-9013-4e86-a826-8a2e12ce9cd2 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:21.425460 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ca28f-8b26-4a96-bab9-5e9a4e1f0bd0 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:21.444259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-2a2ca28f-8b26-4a96-bab9-5e9a4e1f0bd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:21.444259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:21.444259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:21.444259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:21.444259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:21.444259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:21.444259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:21.444259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:21.444259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:21.444259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:21.444259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:21.444259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:21.444259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:21.444259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:21.444259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:21.444259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:21.446324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:21.446324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:21.446324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:21.446324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:21.446324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:21.446324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:21.446324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:21.446324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:21.446324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:21.446324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:21.446324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:21.446324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:21.446324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:21.446324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:21.446324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:21.446324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:21.446324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:21.448318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:21.448318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:21.448318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:21.448318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 253/502] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:21.448318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ca28f-8b26-4a96-bab9-5e9a4e1f0bd0 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:21.472552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:21.493242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8242e-ad04-4efd-a3c9-23424240c830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:21.494321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8242e-ad04-4efd-a3c9-23424240c830 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:21.494776 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8242e-ad04-4efd-a3c9-23424240c830 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:21.495262 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8242e-ad04-4efd-a3c9-23424240c830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:21.517022 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8242e-ad04-4efd-a3c9-23424240c830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:21.518565 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8242e-ad04-4efd-a3c9-23424240c830 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:21.539150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-9df8242e-ad04-4efd-a3c9-23424240c830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:21.539150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:21.539150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:21.539150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:21.539150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:21.539150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:21.539150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:21.539150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:21.539150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:21.539150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:21.539150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:21.539150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:21.539150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:21.539150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:21.539150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:21.539150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:21.540560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:21.540560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:21.540560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:21.540560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:21.540560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:21.540560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:21.540560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:21.540560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:21.540560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:21.540560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:21.540560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:21.540560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:21.540560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:21.540560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:21.540560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:21.540560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:21.540560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:21.546130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:21.546130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:21.546130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:21.546130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 250/503] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:21.546130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8242e-ad04-4efd-a3c9-23424240c830 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:21.600707 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ca28f-8b26-4a96-bab9-5e9a4e1f0bd0 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:21.642663 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509a2ae-2065-446a-8e27-3b9b6dc67b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:21.643295 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509a2ae-2065-446a-8e27-3b9b6dc67b62 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:21.643557 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509a2ae-2065-446a-8e27-3b9b6dc67b62 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:21.644638 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509a2ae-2065-446a-8e27-3b9b6dc67b62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:21.665951 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:21.708485 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8242e-ad04-4efd-a3c9-23424240c830 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:21.756539 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d653ab-fe8e-4cec-8167-794a5d581c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:21.757591 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d653ab-fe8e-4cec-8167-794a5d581c32 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:21.758085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d653ab-fe8e-4cec-8167-794a5d581c32 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:21.758514 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d653ab-fe8e-4cec-8167-794a5d581c32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:21.761489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509a2ae-2065-446a-8e27-3b9b6dc67b62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:21.763004 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509a2ae-2065-446a-8e27-3b9b6dc67b62 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:21.779129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d653ab-fe8e-4cec-8167-794a5d581c32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:21.789926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-f5d653ab-fe8e-4cec-8167-794a5d581c32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:21.789926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:21.789926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:21.789926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:21.789926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:21.789926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:21.789926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:21.789926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:21.789926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:21.789926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:21.789926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:21.789926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:21.789926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:21.789926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:21.789926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:21.789926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:21.791247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:21.791247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:21.791247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:21.791247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:21.791247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:21.791247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:21.791247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:21.791247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:21.791247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:21.791247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:21.791247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:21.791247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:21.791247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:21.791247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:21.791247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:21.791247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:21.792126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:21.792126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:21.792126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:21.792126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:21.792126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:21.792126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:21.792126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:21.792126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:21.792126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:21.792126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:21.792126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:21.792126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:21.792126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 251/504] 10.222.0.94 () {56 vars in 1102 bytes} [Wed Aug 24 04:35:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:21.793658 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d653ab-fe8e-4cec-8167-794a5d581c32 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:21.841518 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:21.945520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 254/505] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:21.946879 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509a2ae-2065-446a-8e27-3b9b6dc67b62 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:21.958382 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d653ab-fe8e-4cec-8167-794a5d581c32 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:22.012431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40b7ed-fc81-4390-b0ec-1d01863b81cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:22.013947 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40b7ed-fc81-4390-b0ec-1d01863b81cb None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:22.014582 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40b7ed-fc81-4390-b0ec-1d01863b81cb None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:22.014946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40b7ed-fc81-4390-b0ec-1d01863b81cb None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:22.015774 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40b7ed-fc81-4390-b0ec-1d01863b81cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:22.016234 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40b7ed-fc81-4390-b0ec-1d01863b81cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:22.018533 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40b7ed-fc81-4390-b0ec-1d01863b81cb None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:22.024276 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:22.036814 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 252/506] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:22.038366 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40b7ed-fc81-4390-b0ec-1d01863b81cb None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:22.112866 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509a2ae-2065-446a-8e27-3b9b6dc67b62 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:22.160029 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e2a62-fd63-4059-a743-8e0008ededa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:22.160745 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e2a62-fd63-4059-a743-8e0008ededa2 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:22.161474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e2a62-fd63-4059-a743-8e0008ededa2 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:22.161686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e2a62-fd63-4059-a743-8e0008ededa2 None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:22.162451 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e2a62-fd63-4059-a743-8e0008ededa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:22.162860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e2a62-fd63-4059-a743-8e0008ededa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:22.164310 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e2a62-fd63-4059-a743-8e0008ededa2 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:22.177848 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 255/507] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:22.179041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e2a62-fd63-4059-a743-8e0008ededa2 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:22.229967 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:22.241645 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40b7ed-fc81-4390-b0ec-1d01863b81cb None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:22.295417 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c9f5b-a537-49e4-9394-f15471f5c1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:22.296376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c9f5b-a537-49e4-9394-f15471f5c1d6 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:22.296812 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c9f5b-a537-49e4-9394-f15471f5c1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:22.297236 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c9f5b-a537-49e4-9394-f15471f5c1d6 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:22.298358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c9f5b-a537-49e4-9394-f15471f5c1d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:22.298832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c9f5b-a537-49e4-9394-f15471f5c1d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:22.301117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c9f5b-a537-49e4-9394-f15471f5c1d6 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:22.321956 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 253/508] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:22.324300 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c9f5b-a537-49e4-9394-f15471f5c1d6 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:22.368679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e2a62-fd63-4059-a743-8e0008ededa2 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:22.384729 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:22.424710 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e22c3f-b84a-477a-8f2b-6ef5707337bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:22.425487 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e22c3f-b84a-477a-8f2b-6ef5707337bd None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:22.425864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e22c3f-b84a-477a-8f2b-6ef5707337bd None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:22.426217 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e22c3f-b84a-477a-8f2b-6ef5707337bd None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:22.426968 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e22c3f-b84a-477a-8f2b-6ef5707337bd None admin] RBAC: Adding query filter params (name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:22.427558 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e22c3f-b84a-477a-8f2b-6ef5707337bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:22.429025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e22c3f-b84a-477a-8f2b-6ef5707337bd None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:22.441903 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 256/509] 10.222.0.94 () {56 vars in 1103 bytes} [Wed Aug 24 04:35:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:22.444705 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e22c3f-b84a-477a-8f2b-6ef5707337bd None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:22.490275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c9f5b-a537-49e4-9394-f15471f5c1d6 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:22.531014 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09e54f-bce1-47ad-8711-9ee9c7a49fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:22.531669 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09e54f-bce1-47ad-8711-9ee9c7a49fc3 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:22.531948 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09e54f-bce1-47ad-8711-9ee9c7a49fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:22.532219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09e54f-bce1-47ad-8711-9ee9c7a49fc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:22.548539 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09e54f-bce1-47ad-8711-9ee9c7a49fc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:22.550852 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09e54f-bce1-47ad-8711-9ee9c7a49fc3 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:22.578011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-9e09e54f-bce1-47ad-8711-9ee9c7a49fc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:22.578011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:22.578011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:22.578011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:22.578011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:22.578011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:22.578011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:22.578011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:22.578011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:22.578011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:22.578011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:22.578011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:22.578011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:22.578011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:22.578011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:22.578011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:22.579963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:22.579963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:22.579963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:22.579963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:22.579963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:22.579963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:22.579963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:22.579963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:22.579963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:22.579963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:22.579963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:22.579963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:22.579963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:22.579963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:22.579963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:22.579963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:22.579963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:22.581578 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:22.581578 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:22.581578 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:22.581578 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 254/510] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:22.581578 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09e54f-bce1-47ad-8711-9ee9c7a49fc3 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:22.591985 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:22.601078 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e22c3f-b84a-477a-8f2b-6ef5707337bd None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:22.652817 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12036c-34b1-41eb-9f2a-56f6ec600266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:22.654160 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12036c-34b1-41eb-9f2a-56f6ec600266 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:22.654625 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12036c-34b1-41eb-9f2a-56f6ec600266 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:22.655144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12036c-34b1-41eb-9f2a-56f6ec600266 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:22.665198 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12036c-34b1-41eb-9f2a-56f6ec600266 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:22.667591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12036c-34b1-41eb-9f2a-56f6ec600266 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:22.690660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-4f12036c-34b1-41eb-9f2a-56f6ec600266 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:35:22.690660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:22.690660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:22.690660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:22.690660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:22.690660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:22.690660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:22.690660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:22.690660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:22.690660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:22.690660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:22.690660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:22.690660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:35:22.690660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:35:22.690660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:35:22.690660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:35:22.692377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:22.692377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:22.692377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:35:22.692377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:22.692377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:35:22.692377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:22.692377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:22.692377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:22.692377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:22.692377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:22.692377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:22.692377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:22.692377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:22.692377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:22.692377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:22.692377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:22.692377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:22.692377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:22.694815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:22.694815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:22.694815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:35:22.694815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:35:22.694815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:35:22.694815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:35:22.694815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:35:22.694815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:35:22.694815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:35:22.694815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:22.694815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 257/511] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:22.694815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12036c-34b1-41eb-9f2a-56f6ec600266 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:22.743781 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:22.764762 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09e54f-bce1-47ad-8711-9ee9c7a49fc3 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:22.815183 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16475223-e83b-410b-9ae0-e11ffd2a24cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:22.815869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16475223-e83b-410b-9ae0-e11ffd2a24cf None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:22.816158 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16475223-e83b-410b-9ae0-e11ffd2a24cf None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:22.816435 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16475223-e83b-410b-9ae0-e11ffd2a24cf None admin] PATH_INFO: `/v3/users/glance` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:22.825717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16475223-e83b-410b-9ae0-e11ffd2a24cf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:22.827229 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16475223-e83b-410b-9ae0-e11ffd2a24cf None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:22.842606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-16475223-e83b-410b-9ae0-e11ffd2a24cf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:35:22.842606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:22.842606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:22.842606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:22.842606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:22.842606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:22.842606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:22.842606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:22.842606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:22.842606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:22.842606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:22.842606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:22.842606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:35:22.842606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:35:22.842606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:35:22.842606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:35:22.844215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:22.844215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:22.844215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:35:22.844215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:22.844215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:35:22.844215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:22.844215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:22.844215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:22.844215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:22.844215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:22.844215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:22.844215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:22.844215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:22.844215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:22.844215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:22.844215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:22.844215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:22.844215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:22.845939 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:22.845939 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:22.845939 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:35:22.845939 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:35:22.845939 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:35:22.845939 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:35:22.845939 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:35:22.845939 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:35:22.845939 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:35:22.845939 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:22.845939 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 255/512] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:22.845939 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16475223-e83b-410b-9ae0-e11ffd2a24cf None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:22.880274 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12036c-34b1-41eb-9f2a-56f6ec600266 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:22.934206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401c005-0652-4fe1-860b-2ee4c08ed622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:22.935727 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401c005-0652-4fe1-860b-2ee4c08ed622 None admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:22.936097 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401c005-0652-4fe1-860b-2ee4c08ed622 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:22.936480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401c005-0652-4fe1-860b-2ee4c08ed622 None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:22.937364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401c005-0652-4fe1-860b-2ee4c08ed622 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:22.939339 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401c005-0652-4fe1-860b-2ee4c08ed622 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:22.946105 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:22.973491 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 258/513] 10.222.0.94 () {60 vars in 1132 bytes} [Wed Aug 24 04:35:22 2022] POST /identity/v3/users => generated 247 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:35:22.973491 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401c005-0652-4fe1-860b-2ee4c08ed622 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:23.019515 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16475223-e83b-410b-9ae0-e11ffd2a24cf None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:23.081454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c1b43-17dc-4123-89af-eb03a607202c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:23.082481 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c1b43-17dc-4123-89af-eb03a607202c None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:23.083005 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c1b43-17dc-4123-89af-eb03a607202c None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:23.083525 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c1b43-17dc-4123-89af-eb03a607202c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:23.106160 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c1b43-17dc-4123-89af-eb03a607202c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:23.110270 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c1b43-17dc-4123-89af-eb03a607202c None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:23.141924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-fd8c1b43-17dc-4123-89af-eb03a607202c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:23.141924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:23.141924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:23.141924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:23.141924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:23.141924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:23.141924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:23.141924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:23.141924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:23.141924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:23.141924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:23.141924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:23.141924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:23.141924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:23.141924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:23.141924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:23.142927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:23.142927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:23.142927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:23.142927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:23.142927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:23.142927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:23.142927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:23.142927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:23.142927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:23.142927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:23.142927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:23.142927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:23.142927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:23.142927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:23.142927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:23.142927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:23.142927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:23.143905 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:23.143905 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:23.143905 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:23.146203 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 256/514] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:23.147915 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c1b43-17dc-4123-89af-eb03a607202c None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:23.155686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:23.189516 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401c005-0652-4fe1-860b-2ee4c08ed622 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:23.254007 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f3250-c73d-4785-9c02-0ec12e95bc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:23.254628 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f3250-c73d-4785-9c02-0ec12e95bc3a None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:23.254905 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f3250-c73d-4785-9c02-0ec12e95bc3a None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:23.255174 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f3250-c73d-4785-9c02-0ec12e95bc3a None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:23.255862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f3250-c73d-4785-9c02-0ec12e95bc3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:23.256168 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f3250-c73d-4785-9c02-0ec12e95bc3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:23.257715 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f3250-c73d-4785-9c02-0ec12e95bc3a None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:23.273432 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 259/515] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:23.277811 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f3250-c73d-4785-9c02-0ec12e95bc3a None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:23.347757 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c1b43-17dc-4123-89af-eb03a607202c None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:23.381624 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:23.413317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c9fc5-d9f0-4764-9ed4-bde3747db808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:23.414538 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c9fc5-d9f0-4764-9ed4-bde3747db808 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:23.415044 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c9fc5-d9f0-4764-9ed4-bde3747db808 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:23.415506 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c9fc5-d9f0-4764-9ed4-bde3747db808 None admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:23.416962 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c9fc5-d9f0-4764-9ed4-bde3747db808 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:23.417321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c9fc5-d9f0-4764-9ed4-bde3747db808 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:23.421555 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c9fc5-d9f0-4764-9ed4-bde3747db808 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:23.436908 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f3250-c73d-4785-9c02-0ec12e95bc3a None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:23.487150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 257/516] 10.222.0.94 () {56 vars in 1137 bytes} [Wed Aug 24 04:35:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:23.489051 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c9fc5-d9f0-4764-9ed4-bde3747db808 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:23.499628 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da922034-0074-42b3-883f-502edbfe493a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:23.500759 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da922034-0074-42b3-883f-502edbfe493a None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:23.501445 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da922034-0074-42b3-883f-502edbfe493a None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:23.502063 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da922034-0074-42b3-883f-502edbfe493a None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:23.503535 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da922034-0074-42b3-883f-502edbfe493a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:23.504085 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da922034-0074-42b3-883f-502edbfe493a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:23.506991 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da922034-0074-42b3-883f-502edbfe493a None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:23.545716 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 260/517] 10.222.0.94 () {56 vars in 1137 bytes} [Wed Aug 24 04:35:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:23.545716 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da922034-0074-42b3-883f-502edbfe493a None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:23.549341 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:23.652389 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c9fc5-d9f0-4764-9ed4-bde3747db808 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:23.722131 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da922034-0074-42b3-883f-502edbfe493a None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:23.728482 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b4a8c-b8cb-4973-8312-225d2b6d12d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:23.729645 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b4a8c-b8cb-4973-8312-225d2b6d12d1 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:23.730205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b4a8c-b8cb-4973-8312-225d2b6d12d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:23.730783 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b4a8c-b8cb-4973-8312-225d2b6d12d1 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:23.733314 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b4a8c-b8cb-4973-8312-225d2b6d12d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:23.733314 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b4a8c-b8cb-4973-8312-225d2b6d12d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:23.736709 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b4a8c-b8cb-4973-8312-225d2b6d12d1 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:23.765524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 258/518] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:23.765524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b4a8c-b8cb-4973-8312-225d2b6d12d1 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:23.796852 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd163f4b-34bf-4301-96e8-0f1349f3d201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:23.798008 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd163f4b-34bf-4301-96e8-0f1349f3d201 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:23.798446 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd163f4b-34bf-4301-96e8-0f1349f3d201 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:23.798918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd163f4b-34bf-4301-96e8-0f1349f3d201 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:23.811954 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd163f4b-34bf-4301-96e8-0f1349f3d201 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:23.814820 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd163f4b-34bf-4301-96e8-0f1349f3d201 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:23.837590 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:23.838897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-fd163f4b-34bf-4301-96e8-0f1349f3d201 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:23.838897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:23.838897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:23.838897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:23.838897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:23.838897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:23.838897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:23.838897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:23.838897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:23.838897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:23.838897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:23.838897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:23.838897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:35:23.838897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:35:23.838897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:35:23.840509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:35:23.840509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:23.840509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:23.840509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:23.840509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:23.840509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:23.840509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:23.840509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:23.840509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:23.840509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:23.840509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:23.840509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:23.840509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:23.840509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:23.840509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:23.840509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:23.840509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:23.844777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:35:23.844777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:35:23.844777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:35:23.844777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:35:23.844777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:35:23.844777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:35:23.844777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:23.844777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:23.844777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 261/519] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:35:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:23.844777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd163f4b-34bf-4301-96e8-0f1349f3d201 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:23.977107 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:23.978554 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b4a8c-b8cb-4973-8312-225d2b6d12d1 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:24.033619 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd74b6-1ec4-4d7a-934a-a51bb178f12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:24.034793 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd74b6-1ec4-4d7a-934a-a51bb178f12a None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:24.034793 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd74b6-1ec4-4d7a-934a-a51bb178f12a None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:24.035272 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd74b6-1ec4-4d7a-934a-a51bb178f12a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:24.061834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd163f4b-34bf-4301-96e8-0f1349f3d201 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:24.134205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41ad3c-21a4-4490-a66a-c8652a4f1b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:24.135166 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41ad3c-21a4-4490-a66a-c8652a4f1b27 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:24.135667 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41ad3c-21a4-4490-a66a-c8652a4f1b27 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:24.136149 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41ad3c-21a4-4490-a66a-c8652a4f1b27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:24.194232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd74b6-1ec4-4d7a-934a-a51bb178f12a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:24.200218 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd74b6-1ec4-4d7a-934a-a51bb178f12a None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:24.261587 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:24.300898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41ad3c-21a4-4490-a66a-c8652a4f1b27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:24.304334 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41ad3c-21a4-4490-a66a-c8652a4f1b27 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:24.363187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 259/520] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:24.365101 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd74b6-1ec4-4d7a-934a-a51bb178f12a None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:24.443279 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:24.517912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 262/521] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 676 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:24.522431 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41ad3c-21a4-4490-a66a-c8652a4f1b27 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:24.533392 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd74b6-1ec4-4d7a-934a-a51bb178f12a None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:24.592149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b5607-2729-4d08-b9d4-8795a9e3dabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:24.593386 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b5607-2729-4d08-b9d4-8795a9e3dabb None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:24.593901 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b5607-2729-4d08-b9d4-8795a9e3dabb None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:24.594389 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b5607-2729-4d08-b9d4-8795a9e3dabb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:24.599056 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:24.607405 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b5607-2729-4d08-b9d4-8795a9e3dabb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:24.609627 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b5607-2729-4d08-b9d4-8795a9e3dabb None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:24.627474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-9e2b5607-2729-4d08-b9d4-8795a9e3dabb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:35:24.627474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:24.627474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:24.627474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:24.627474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:24.627474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:24.627474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:24.627474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:24.627474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:24.627474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:24.627474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:24.627474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:24.627474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:35:24.627474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:35:24.627474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:35:24.627474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:35:24.630813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:24.630813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:24.630813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:35:24.630813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:24.630813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:35:24.630813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:24.630813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:24.630813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:24.630813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:24.630813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:24.630813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:24.630813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:24.630813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:24.630813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:24.630813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:24.630813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:24.630813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:24.630813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:24.632835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:24.632835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:24.632835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:35:24.632835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:35:24.632835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:35:24.632835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:35:24.632835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:35:24.632835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:35:24.632835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:35:24.632835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:24.632835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 260/522] 10.222.0.94 () {56 vars in 1102 bytes} [Wed Aug 24 04:35:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:24.632835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b5607-2729-4d08-b9d4-8795a9e3dabb None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:24.748202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41ad3c-21a4-4490-a66a-c8652a4f1b27 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:24.809645 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b5607-2729-4d08-b9d4-8795a9e3dabb None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:24.815578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061a246-ff09-4919-9818-868511fac688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:24.816635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061a246-ff09-4919-9818-868511fac688 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:24.817101 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061a246-ff09-4919-9818-868511fac688 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:24.817624 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061a246-ff09-4919-9818-868511fac688 None admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:24.818961 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061a246-ff09-4919-9818-868511fac688 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:24.819527 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061a246-ff09-4919-9818-868511fac688 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:24.822525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061a246-ff09-4919-9818-868511fac688 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:24.854570 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830ba45-6c2b-439b-bddb-3777ca9da648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:24.855228 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830ba45-6c2b-439b-bddb-3777ca9da648 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:24.855512 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830ba45-6c2b-439b-bddb-3777ca9da648 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:24.855887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830ba45-6c2b-439b-bddb-3777ca9da648 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:24.865769 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 263/523] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:35:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:24.865769 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061a246-ff09-4919-9818-868511fac688 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:24.878697 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830ba45-6c2b-439b-bddb-3777ca9da648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:24.880197 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830ba45-6c2b-439b-bddb-3777ca9da648 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:24.899868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-c830ba45-6c2b-439b-bddb-3777ca9da648 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:24.899868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:24.899868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:24.899868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:24.899868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:24.899868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:24.899868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:24.899868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:24.899868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:24.899868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:24.899868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:24.899868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:24.899868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:24.899868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:24.899868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:24.899868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:24.901089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:24.901089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:24.901089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:24.901089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:24.901089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:24.901089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:24.901089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:24.901089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:24.901089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:24.901089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:24.901089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:24.901089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:24.901089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:24.901089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:24.901089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:24.901089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:24.901089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:24.902896 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:24.902896 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:24.902896 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:24.902896 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 261/524] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:24.902896 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830ba45-6c2b-439b-bddb-3777ca9da648 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:24.918149 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:25.004487 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:25.032445 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061a246-ff09-4919-9818-868511fac688 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:25.078859 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ca15e-b8a4-4e98-a47b-4994dad15e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:25.079423 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ca15e-b8a4-4e98-a47b-4994dad15e41 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:25.079795 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ca15e-b8a4-4e98-a47b-4994dad15e41 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:25.079983 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ca15e-b8a4-4e98-a47b-4994dad15e41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:25.088148 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830ba45-6c2b-439b-bddb-3777ca9da648 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:25.095328 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ca15e-b8a4-4e98-a47b-4994dad15e41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:25.096882 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ca15e-b8a4-4e98-a47b-4994dad15e41 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:25.116935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-076ca15e-b8a4-4e98-a47b-4994dad15e41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:25.116935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:25.116935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:25.116935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:25.116935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:25.116935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:25.116935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:25.116935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:25.116935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:25.116935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:25.116935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:25.116935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:25.116935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:25.116935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:25.116935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:25.116935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:25.119025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:25.119025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:25.119025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:25.119025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:25.119025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:25.119025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:25.119025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:25.119025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:25.119025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:25.119025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:25.119025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:25.119025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:25.119025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:25.119025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:25.119025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:25.119025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:25.119025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:25.120757 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:25.120757 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:25.120757 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:25.120757 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 264/525] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:25.120757 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ca15e-b8a4-4e98-a47b-4994dad15e41 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:25.135759 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb209b7c-791b-437c-a5c3-f257c98eca9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:25.136382 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb209b7c-791b-437c-a5c3-f257c98eca9e None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:25.136672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb209b7c-791b-437c-a5c3-f257c98eca9e None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:25.136944 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb209b7c-791b-437c-a5c3-f257c98eca9e None admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:25.137746 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb209b7c-791b-437c-a5c3-f257c98eca9e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:25.138171 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb209b7c-791b-437c-a5c3-f257c98eca9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:25.139777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb209b7c-791b-437c-a5c3-f257c98eca9e None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:25.174992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 262/526] 10.222.0.94 () {56 vars in 1139 bytes} [Wed Aug 24 04:35:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:25.174992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb209b7c-791b-437c-a5c3-f257c98eca9e None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:25.271501 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:25.299753 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb209b7c-791b-437c-a5c3-f257c98eca9e None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:25.304841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ca15e-b8a4-4e98-a47b-4994dad15e41 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:25.310387 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:25.351672 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060b79b-5092-495c-a595-0bafee3f3971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:25.351962 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c0652-f29c-4a4a-a985-b04ff96076d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:25.352349 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060b79b-5092-495c-a595-0bafee3f3971 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:25.352542 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c0652-f29c-4a4a-a985-b04ff96076d9 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:25.352679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060b79b-5092-495c-a595-0bafee3f3971 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:25.352815 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c0652-f29c-4a4a-a985-b04ff96076d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:25.352963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060b79b-5092-495c-a595-0bafee3f3971 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:25.353096 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c0652-f29c-4a4a-a985-b04ff96076d9 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:25.353581 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c0652-f29c-4a4a-a985-b04ff96076d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:25.353750 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060b79b-5092-495c-a595-0bafee3f3971 None admin] RBAC: Adding query filter params (role.id=5e5c4aa158a845b981b0e847f8bd47a6, scope.project.id=4416325d266642f3a786ff9f16c827aa, user.id=5bdbda2b9c8f48338c5117585a229cb6) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:25.353879 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c0652-f29c-4a4a-a985-b04ff96076d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:25.354020 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060b79b-5092-495c-a595-0bafee3f3971 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:25.355332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c0652-f29c-4a4a-a985-b04ff96076d9 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:25.355513 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060b79b-5092-495c-a595-0bafee3f3971 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:25.364807 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 265/527] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:35:25 2022] GET /identity/v3/role_assignments?user.id=5bdbda2b9c8f48338c5117585a229cb6&scope.project.id=4416325d266642f3a786ff9f16c827aa&role.id=5e5c4aa158a845b981b0e847f8bd47a6 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:25.368926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060b79b-5092-495c-a595-0bafee3f3971 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:25.376657 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 263/528] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:25.380402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c0652-f29c-4a4a-a985-b04ff96076d9 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:25.536275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c0652-f29c-4a4a-a985-b04ff96076d9 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:25.576999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060b79b-5092-495c-a595-0bafee3f3971 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:25.608257 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eeda76-b7c5-485b-9993-5895c529fc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:25.608798 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eeda76-b7c5-485b-9993-5895c529fc12 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:25.609082 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eeda76-b7c5-485b-9993-5895c529fc12 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:25.609357 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eeda76-b7c5-485b-9993-5895c529fc12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:25.636910 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b1187-b8a5-4ad4-84e7-ac2f9826162b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:25.637277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b1187-b8a5-4ad4-84e7-ac2f9826162b None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:25.637594 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b1187-b8a5-4ad4-84e7-ac2f9826162b None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:25.638046 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b1187-b8a5-4ad4-84e7-ac2f9826162b None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:25.638655 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b1187-b8a5-4ad4-84e7-ac2f9826162b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:25.639042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b1187-b8a5-4ad4-84e7-ac2f9826162b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:25.640536 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b1187-b8a5-4ad4-84e7-ac2f9826162b None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:25.650443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:25.660911 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:25.670945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 266/529] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:25.671563 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b1187-b8a5-4ad4-84e7-ac2f9826162b None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:25.740090 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eeda76-b7c5-485b-9993-5895c529fc12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:25.742649 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eeda76-b7c5-485b-9993-5895c529fc12 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:25.853213 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b1187-b8a5-4ad4-84e7-ac2f9826162b None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:25.907631 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a459f7-1fb0-407c-bddc-9c7b2d3b7d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:25.907631 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a459f7-1fb0-407c-bddc-9c7b2d3b7d6d None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:25.907631 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a459f7-1fb0-407c-bddc-9c7b2d3b7d6d None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:25.907631 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a459f7-1fb0-407c-bddc-9c7b2d3b7d6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:25.916526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a459f7-1fb0-407c-bddc-9c7b2d3b7d6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:25.918083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a459f7-1fb0-407c-bddc-9c7b2d3b7d6d None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:25.932331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-92a459f7-1fb0-407c-bddc-9c7b2d3b7d6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:25.932331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:25.932331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:25.932331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:25.932331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:25.932331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:25.932331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:25.932331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:25.932331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:25.932331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:25.932331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:25.932331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:25.932331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:35:25.932331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:35:25.932331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:35:25.934470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:35:25.934470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:25.934470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:25.934470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:25.934470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:25.934470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:25.934470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:25.934470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:25.934470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:25.934470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:25.934470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:25.934470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:25.934470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:25.934470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:25.934470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:25.934470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:25.934470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:25.937125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:35:25.937125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:35:25.937125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:35:25.937125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:35:25.937125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:35:25.937125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:35:25.937125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:25.937125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:25.937125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 267/530] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:35:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:25.937125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c29742-3a9f-4369-bcab-7fb18fef7384 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:25.937125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c29742-3a9f-4369-bcab-7fb18fef7384 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:25.944687 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c29742-3a9f-4369-bcab-7fb18fef7384 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:25.944687 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 268/531] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:25.944687 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c29742-3a9f-4369-bcab-7fb18fef7384 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:25.963028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 264/532] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:25.964796 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eeda76-b7c5-485b-9993-5895c529fc12 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:26.066966 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:26.067176 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:26.128095 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eeda76-b7c5-485b-9993-5895c529fc12 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:26.148109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c29742-3a9f-4369-bcab-7fb18fef7384 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:26.185193 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dcc42-89ef-446f-96b1-26e06b0bb318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:26.185834 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dcc42-89ef-446f-96b1-26e06b0bb318 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:26.186211 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dcc42-89ef-446f-96b1-26e06b0bb318 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:26.186557 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dcc42-89ef-446f-96b1-26e06b0bb318 None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:26.187381 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9dcc42-89ef-446f-96b1-26e06b0bb318 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:26.187690 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9dcc42-89ef-446f-96b1-26e06b0bb318 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:26.189238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9dcc42-89ef-446f-96b1-26e06b0bb318 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:26.203566 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e46c87-a9ac-44df-b5be-fbdb0008c4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:26.204926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e46c87-a9ac-44df-b5be-fbdb0008c4f9 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:26.205653 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e46c87-a9ac-44df-b5be-fbdb0008c4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:26.206373 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e46c87-a9ac-44df-b5be-fbdb0008c4f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:26.211487 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 265/533] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:35:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:26.213186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93f54c-4f02-4ca2-b00c-d9c9ee8ee681 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:26.213514 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93f54c-4f02-4ca2-b00c-d9c9ee8ee681 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:26.213793 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93f54c-4f02-4ca2-b00c-d9c9ee8ee681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:26.227780 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e46c87-a9ac-44df-b5be-fbdb0008c4f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:26.230947 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e46c87-a9ac-44df-b5be-fbdb0008c4f9 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:26.236104 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-5d93f54c-4f02-4ca2-b00c-d9c9ee8ee681 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:26.237337 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-5d93f54c-4f02-4ca2-b00c-d9c9ee8ee681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:26.256210 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-13e46c87-a9ac-44df-b5be-fbdb0008c4f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:26.256210 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:26.256210 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:26.256210 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:26.256210 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:26.256210 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:26.256210 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:26.256210 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:26.256210 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:26.256210 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:26.256210 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:26.256210 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:26.256210 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:35:26.256210 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:35:26.256210 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:35:26.257157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:35:26.257157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:26.257157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:26.257157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:26.257157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:26.257157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:26.257157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:26.257157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:26.257157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:26.257157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:26.257157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:26.257157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:26.257157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:26.257157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:26.257157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:26.257157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:26.257157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:26.258194 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:35:26.258194 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:35:26.258194 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:35:26.258194 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:35:26.258194 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:35:26.258194 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:35:26.258194 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:26.258194 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:26.261810 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 269/534] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:35:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:26.264600 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e46c87-a9ac-44df-b5be-fbdb0008c4f9 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:26.333454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 266/535] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:26.333454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93f54c-4f02-4ca2-b00c-d9c9ee8ee681 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:26.428556 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:26.480747 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e46c87-a9ac-44df-b5be-fbdb0008c4f9 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:26.506308 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93f54c-4f02-4ca2-b00c-d9c9ee8ee681 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:26.517525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:26.547256 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490db111-bdb4-42fa-ab8b-f81a332d8119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:26.548816 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490db111-bdb4-42fa-ab8b-f81a332d8119 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:26.549464 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490db111-bdb4-42fa-ab8b-f81a332d8119 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:26.550053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490db111-bdb4-42fa-ab8b-f81a332d8119 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:26.554407 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741babd-d82c-4f92-aecd-549c219d73ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:26.555030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741babd-d82c-4f92-aecd-549c219d73ea None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:26.555417 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741babd-d82c-4f92-aecd-549c219d73ea None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:26.555804 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741babd-d82c-4f92-aecd-549c219d73ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:26.556560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741babd-d82c-4f92-aecd-549c219d73ea None admin] RBAC: Adding query filter params (role.id=5e5c4aa158a845b981b0e847f8bd47a6, scope.project.id=4416325d266642f3a786ff9f16c827aa, user.id=6d36675e4e6045158add36ac528d6c7b) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:26.556877 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741babd-d82c-4f92-aecd-549c219d73ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:26.558441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741babd-d82c-4f92-aecd-549c219d73ea None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:26.564165 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490db111-bdb4-42fa-ab8b-f81a332d8119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:26.573550 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 267/536] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:35:26 2022] GET /identity/v3/role_assignments?user.id=6d36675e4e6045158add36ac528d6c7b&scope.project.id=4416325d266642f3a786ff9f16c827aa&role.id=5e5c4aa158a845b981b0e847f8bd47a6 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:26.573550 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741babd-d82c-4f92-aecd-549c219d73ea None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:26.575917 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490db111-bdb4-42fa-ab8b-f81a332d8119 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:26.621828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-490db111-bdb4-42fa-ab8b-f81a332d8119 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:26.621828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:26.621828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:26.621828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:26.621828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:26.621828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:26.621828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:26.621828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:26.621828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:26.621828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:26.621828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:26.621828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:26.621828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:26.621828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:26.621828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:26.621828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:26.623335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:26.623335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:26.623335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:26.623335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:26.623335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:26.623335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:26.623335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:26.623335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:26.623335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:26.623335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:26.623335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:26.623335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:26.623335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:26.623335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:26.623335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:26.623335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:26.623335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:26.624177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:26.624177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:26.624177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:26.628364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 270/537] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:26.634980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490db111-bdb4-42fa-ab8b-f81a332d8119 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:26.742210 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741babd-d82c-4f92-aecd-549c219d73ea None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:26.773105 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:26.786907 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490db111-bdb4-42fa-ab8b-f81a332d8119 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:26.794786 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f774c-389d-41b6-804b-e6184ecd25f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:26.796361 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f774c-389d-41b6-804b-e6184ecd25f8 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:26.797085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f774c-389d-41b6-804b-e6184ecd25f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:26.797366 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f774c-389d-41b6-804b-e6184ecd25f8 None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:26.798115 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f774c-389d-41b6-804b-e6184ecd25f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:26.798417 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f774c-389d-41b6-804b-e6184ecd25f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:26.800346 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f774c-389d-41b6-804b-e6184ecd25f8 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:26.816488 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 268/538] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:35:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:26.816908 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f774c-389d-41b6-804b-e6184ecd25f8 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:26.835420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046b4a9-741e-4e6a-8a3f-ed4d7401c93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:26.836042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046b4a9-741e-4e6a-8a3f-ed4d7401c93d None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:26.836392 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046b4a9-741e-4e6a-8a3f-ed4d7401c93d None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:26.836828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046b4a9-741e-4e6a-8a3f-ed4d7401c93d None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:26.837532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046b4a9-741e-4e6a-8a3f-ed4d7401c93d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:26.837848 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046b4a9-741e-4e6a-8a3f-ed4d7401c93d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:26.839464 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046b4a9-741e-4e6a-8a3f-ed4d7401c93d None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:26.856343 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 271/539] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:26.858175 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046b4a9-741e-4e6a-8a3f-ed4d7401c93d None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:26.930954 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:26.975157 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f774c-389d-41b6-804b-e6184ecd25f8 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:27.021983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f7ed8-5c0f-41c9-a02a-673e4ba36532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:27.022636 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f7ed8-5c0f-41c9-a02a-673e4ba36532 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:27.023059 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f7ed8-5c0f-41c9-a02a-673e4ba36532 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:27.023469 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f7ed8-5c0f-41c9-a02a-673e4ba36532 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:27.033768 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046b4a9-741e-4e6a-8a3f-ed4d7401c93d None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:27.037513 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f7ed8-5c0f-41c9-a02a-673e4ba36532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:27.042563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-6d5f7ed8-5c0f-41c9-a02a-673e4ba36532 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:27.042563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:27.042563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:27.042563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:27.042563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:27.042563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:27.042563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:27.042563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:27.042563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:27.042563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:27.042563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:27.042563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:27.042563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:27.042563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:27.042563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:27.042563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:27.043496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:27.043496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:27.043496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:27.043496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:27.043496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:27.043496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:27.043496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:27.043496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:27.043496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:27.043496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:27.043496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:27.043496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:27.043496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:27.043496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:27.043496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:27.043496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:27.045216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:27.045216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:27.045216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:27.045216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:27.045216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:27.045216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:27.045216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:27.045216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:27.045216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:27.045216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:27.045216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:27.045216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:27.045216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 269/540] 10.222.0.94 () {56 vars in 1102 bytes} [Wed Aug 24 04:35:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:27.045920 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f7ed8-5c0f-41c9-a02a-673e4ba36532 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:27.087278 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b40d3-b4f7-404f-9e42-573ae8159516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:27.088322 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b40d3-b4f7-404f-9e42-573ae8159516 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:27.088779 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b40d3-b4f7-404f-9e42-573ae8159516 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:27.089273 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b40d3-b4f7-404f-9e42-573ae8159516 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:27.090232 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b40d3-b4f7-404f-9e42-573ae8159516 None admin] RBAC: Adding query filter params (role.id=5e5c4aa158a845b981b0e847f8bd47a6, scope.project.id=4416325d266642f3a786ff9f16c827aa, user.id=bbec984d81c84035887220056b3790ec) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:27.090574 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b40d3-b4f7-404f-9e42-573ae8159516 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:27.093382 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b40d3-b4f7-404f-9e42-573ae8159516 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:27.103212 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 272/541] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:35:26 2022] GET /identity/v3/role_assignments?user.id=bbec984d81c84035887220056b3790ec&scope.project.id=4416325d266642f3a786ff9f16c827aa&role.id=5e5c4aa158a845b981b0e847f8bd47a6 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:27.104385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b40d3-b4f7-404f-9e42-573ae8159516 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:27.122835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:27.304158 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f7ed8-5c0f-41c9-a02a-673e4ba36532 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:27.331137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:27.348016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b40d3-b4f7-404f-9e42-573ae8159516 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:27.392577 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461bc56f-cf61-4fbf-aa6a-b779c40ae2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:27.393613 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bc56f-cf61-4fbf-aa6a-b779c40ae2c7 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:27.394115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bc56f-cf61-4fbf-aa6a-b779c40ae2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:27.394625 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bc56f-cf61-4fbf-aa6a-b779c40ae2c7 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:27.395501 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461bc56f-cf61-4fbf-aa6a-b779c40ae2c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:27.396334 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461bc56f-cf61-4fbf-aa6a-b779c40ae2c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:27.398118 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461bc56f-cf61-4fbf-aa6a-b779c40ae2c7 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:27.401999 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f00467-1889-499f-a104-9325972965fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:27.402851 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f00467-1889-499f-a104-9325972965fc None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:27.403177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f00467-1889-499f-a104-9325972965fc None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:27.404070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f00467-1889-499f-a104-9325972965fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:27.413941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 273/542] 10.222.0.94 () {56 vars in 1103 bytes} [Wed Aug 24 04:35:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:27.417334 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461bc56f-cf61-4fbf-aa6a-b779c40ae2c7 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:27.436246 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f00467-1889-499f-a104-9325972965fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:27.439506 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f00467-1889-499f-a104-9325972965fc None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:27.487123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-82f00467-1889-499f-a104-9325972965fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:27.487123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:27.487123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:27.487123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:27.487123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:27.487123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:27.487123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:27.487123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:27.487123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:27.487123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:27.487123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:27.487123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:27.487123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:35:27.487123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:35:27.487123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:35:27.488054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:35:27.488054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:27.488054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:27.488054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:27.488054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:27.488054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:27.488054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:27.488054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:27.488054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:27.488054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:27.488054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:27.488054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:27.488054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:27.488054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:27.488054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:27.488054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:27.488054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:27.489034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:35:27.489034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:35:27.489034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:35:27.489034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:35:27.489034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:35:27.489034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:35:27.489034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:27.489034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:27.489034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 270/543] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:35:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 443 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:27.495110 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f00467-1889-499f-a104-9325972965fc None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:27.543671 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461bc56f-cf61-4fbf-aa6a-b779c40ae2c7 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:27.589208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687f94f-e4a2-40a3-9a6a-76f8efaa8e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:27.590264 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687f94f-e4a2-40a3-9a6a-76f8efaa8e65 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:27.590691 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687f94f-e4a2-40a3-9a6a-76f8efaa8e65 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:27.591139 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687f94f-e4a2-40a3-9a6a-76f8efaa8e65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:27.618222 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687f94f-e4a2-40a3-9a6a-76f8efaa8e65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:27.620865 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687f94f-e4a2-40a3-9a6a-76f8efaa8e65 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:27.659689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-f687f94f-e4a2-40a3-9a6a-76f8efaa8e65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:27.659689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:27.659689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:27.659689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:27.659689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:27.659689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:27.659689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:27.659689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:27.659689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:27.659689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:27.659689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:27.659689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:27.659689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:27.659689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:27.659689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:27.659689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:27.660896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:27.660896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:27.660896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:27.660896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:27.660896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:27.660896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:27.660896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:27.660896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:27.660896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:27.660896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:27.660896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:27.660896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:27.660896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:27.660896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:27.660896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:27.660896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:27.660896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:27.662444 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:27.662444 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:27.662444 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:27.671157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 274/544] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:35:27.674230 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687f94f-e4a2-40a3-9a6a-76f8efaa8e65 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:27.705831 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:27.782755 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:27.788877 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f00467-1889-499f-a104-9325972965fc None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:27.843029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7521a28-01d1-404a-97e4-ea391fbfdd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:27.844063 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7521a28-01d1-404a-97e4-ea391fbfdd22 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:27.844565 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7521a28-01d1-404a-97e4-ea391fbfdd22 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:27.845218 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7521a28-01d1-404a-97e4-ea391fbfdd22 None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:27.846283 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7521a28-01d1-404a-97e4-ea391fbfdd22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:27.846914 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7521a28-01d1-404a-97e4-ea391fbfdd22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:27.848576 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7521a28-01d1-404a-97e4-ea391fbfdd22 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:27.863944 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 271/545] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:35:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:35:27.865623 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4de7fe-2542-493f-856b-5b9a7b322f69 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:27.866175 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4de7fe-2542-493f-856b-5b9a7b322f69 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:27.866684 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4de7fe-2542-493f-856b-5b9a7b322f69 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:27.868489 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 272/546] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:27.877432 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8885eaa-d187-4e4f-b056-6c0dfc501571 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:27.877432 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8885eaa-d187-4e4f-b056-6c0dfc501571 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:27.877432 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8885eaa-d187-4e4f-b056-6c0dfc501571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:27.897536 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-f8885eaa-d187-4e4f-b056-6c0dfc501571 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:27.898757 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-f8885eaa-d187-4e4f-b056-6c0dfc501571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:27.954497 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687f94f-e4a2-40a3-9a6a-76f8efaa8e65 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:27.999959 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 273/547] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:28.001380 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8885eaa-d187-4e4f-b056-6c0dfc501571 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:28.021060 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c50c18-620e-40e5-aa54-d9579ad1436e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:28.021863 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c50c18-620e-40e5-aa54-d9579ad1436e None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:28.022150 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c50c18-620e-40e5-aa54-d9579ad1436e None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:28.022423 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c50c18-620e-40e5-aa54-d9579ad1436e None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:28.023202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c50c18-620e-40e5-aa54-d9579ad1436e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:28.023507 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c50c18-620e-40e5-aa54-d9579ad1436e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:28.025068 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c50c18-620e-40e5-aa54-d9579ad1436e None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:28.044351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 275/548] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:28.052705 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c50c18-620e-40e5-aa54-d9579ad1436e None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:28.176291 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:28.256202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c50c18-620e-40e5-aa54-d9579ad1436e None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:28.318001 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:28.326767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504d010-e813-4977-b2eb-18155e67c335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:28.327728 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504d010-e813-4977-b2eb-18155e67c335 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:28.328020 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504d010-e813-4977-b2eb-18155e67c335 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:28.328299 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504d010-e813-4977-b2eb-18155e67c335 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:28.347003 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8885eaa-d187-4e4f-b056-6c0dfc501571 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:28.350864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504d010-e813-4977-b2eb-18155e67c335 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:28.352653 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504d010-e813-4977-b2eb-18155e67c335 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:28.381103 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-b504d010-e813-4977-b2eb-18155e67c335 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:35:28.381103 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:28.381103 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:28.381103 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:28.381103 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:28.381103 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:28.381103 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:28.381103 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:28.381103 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:28.381103 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:28.381103 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:28.381103 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:28.381103 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:35:28.381103 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:35:28.381103 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:35:28.381103 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:35:28.384735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:28.384735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:28.384735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:35:28.384735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:28.384735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:35:28.384735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:28.384735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:28.384735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:28.384735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:28.384735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:28.384735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:28.384735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:28.384735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:28.384735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:28.384735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:28.384735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:28.384735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:28.384735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:28.394019 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:28.394019 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:28.394019 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:35:28.394019 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:35:28.394019 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:35:28.394019 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:35:28.394019 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:35:28.394019 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:35:28.394019 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:35:28.394019 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:28.394019 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 276/549] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:35:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:35:28.394019 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504d010-e813-4977-b2eb-18155e67c335 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:28.425355 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa47ac-643d-43b1-86e8-23fd77243d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:28.426573 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa47ac-643d-43b1-86e8-23fd77243d43 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:28.426995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa47ac-643d-43b1-86e8-23fd77243d43 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:28.428311 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa47ac-643d-43b1-86e8-23fd77243d43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:28.430039 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa47ac-643d-43b1-86e8-23fd77243d43 None admin] RBAC: Adding query filter params (role.id=5e5c4aa158a845b981b0e847f8bd47a6, scope.project.id=4416325d266642f3a786ff9f16c827aa, user.id=0742c7ecf68d40a38c8947a05eee2797) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:28.430628 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa47ac-643d-43b1-86e8-23fd77243d43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:28.434014 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa47ac-643d-43b1-86e8-23fd77243d43 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:28.453725 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 274/550] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:35:27 2022] GET /identity/v3/role_assignments?user.id=0742c7ecf68d40a38c8947a05eee2797&scope.project.id=4416325d266642f3a786ff9f16c827aa&role.id=5e5c4aa158a845b981b0e847f8bd47a6 => generated 259 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:28.553674 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa47ac-643d-43b1-86e8-23fd77243d43 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:28.648390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504d010-e813-4977-b2eb-18155e67c335 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:28.708886 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:28.741434 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1560f-b605-4670-a9bb-40ce15ca5d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:28.742406 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1560f-b605-4670-a9bb-40ce15ca5d7b None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:28.742994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1560f-b605-4670-a9bb-40ce15ca5d7b None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:28.743446 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1560f-b605-4670-a9bb-40ce15ca5d7b None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:28.744919 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1560f-b605-4670-a9bb-40ce15ca5d7b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:28.745461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1560f-b605-4670-a9bb-40ce15ca5d7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:28.748246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1560f-b605-4670-a9bb-40ce15ca5d7b None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:28.807297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa47ac-643d-43b1-86e8-23fd77243d43 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:28.818244 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 277/551] 10.222.0.94 () {56 vars in 1135 bytes} [Wed Aug 24 04:35:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:35:28.826273 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1560f-b605-4670-a9bb-40ce15ca5d7b None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:28.912604 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01561f1-5fae-4004-ac3d-863d2f28bfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:28.914294 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01561f1-5fae-4004-ac3d-863d2f28bfb3 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:28.915475 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01561f1-5fae-4004-ac3d-863d2f28bfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:28.918046 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01561f1-5fae-4004-ac3d-863d2f28bfb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:28.960554 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01561f1-5fae-4004-ac3d-863d2f28bfb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:28.974946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-b01561f1-5fae-4004-ac3d-863d2f28bfb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:28.974946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:28.974946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:28.974946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:28.974946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:28.974946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:28.974946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:28.974946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:28.974946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:28.974946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:28.974946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:28.974946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:28.974946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:28.974946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:28.974946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:28.974946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:28.976817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:28.976817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:28.976817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:28.976817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:28.976817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:28.976817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:28.976817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:28.976817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:28.976817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:28.976817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:28.976817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:28.976817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:28.976817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:28.976817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:28.976817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:28.976817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:28.978456 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:28.978456 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:28.978456 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:28.978456 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:28.978456 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:28.978456 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:28.978456 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:28.978456 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:28.978456 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:28.978456 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:28.978456 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:28.978456 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:28.983862 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 275/552] 10.222.0.94 () {56 vars in 1102 bytes} [Wed Aug 24 04:35:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 431 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:35:28.992404 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01561f1-5fae-4004-ac3d-863d2f28bfb3 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:29.030004 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:29.176383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01561f1-5fae-4004-ac3d-863d2f28bfb3 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:29.221485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1560f-b605-4670-a9bb-40ce15ca5d7b None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:29.272853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2b119-d37e-4df1-b9aa-821d9202a06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:29.273950 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2b119-d37e-4df1-b9aa-821d9202a06f None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:29.274467 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2b119-d37e-4df1-b9aa-821d9202a06f None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:29.274954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2b119-d37e-4df1-b9aa-821d9202a06f None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:29.279879 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2b119-d37e-4df1-b9aa-821d9202a06f None admin] RBAC: Adding query filter params (name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:29.280498 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2b119-d37e-4df1-b9aa-821d9202a06f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:29.283256 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2b119-d37e-4df1-b9aa-821d9202a06f None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:29.321499 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 276/553] 10.222.0.94 () {56 vars in 1103 bytes} [Wed Aug 24 04:35:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:29.332000 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2b119-d37e-4df1-b9aa-821d9202a06f None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:29.354638 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de45088-7fea-4fed-8433-7307fed6e93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:29.355627 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de45088-7fea-4fed-8433-7307fed6e93f None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:29.356080 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de45088-7fea-4fed-8433-7307fed6e93f None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:29.356586 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de45088-7fea-4fed-8433-7307fed6e93f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:29.511105 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:29.543071 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:29.555034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de45088-7fea-4fed-8433-7307fed6e93f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:29.557012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de45088-7fea-4fed-8433-7307fed6e93f None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:29.623354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2b119-d37e-4df1-b9aa-821d9202a06f None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:29.729441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97a30d-5384-48f8-9ab0-97dedcc126d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:29.729441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97a30d-5384-48f8-9ab0-97dedcc126d1 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:29.729441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97a30d-5384-48f8-9ab0-97dedcc126d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:29.729441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97a30d-5384-48f8-9ab0-97dedcc126d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:29.751507 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97a30d-5384-48f8-9ab0-97dedcc126d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:29.753158 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97a30d-5384-48f8-9ab0-97dedcc126d1 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:29.781130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-ab97a30d-5384-48f8-9ab0-97dedcc126d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:29.781130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:29.781130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:29.781130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:29.781130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:29.781130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:29.781130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:29.781130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:29.781130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:29.781130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:29.781130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:29.781130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:29.781130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:29.781130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:29.781130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:29.781130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:29.782940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:29.782940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:29.782940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:29.782940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:29.782940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:29.782940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:29.782940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:29.782940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:29.782940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:29.782940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:29.782940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:29.782940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:29.782940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:29.782940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:29.782940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:29.782940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:29.782940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:29.784975 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:29.784975 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:29.784975 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:29.784975 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 277/554] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 453 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:35:29.797544 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97a30d-5384-48f8-9ab0-97dedcc126d1 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:29.858404 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 278/555] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1033 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:29.860662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff979d6-6c42-400c-9ee3-5415d94b07d6 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:29.861260 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff979d6-6c42-400c-9ee3-5415d94b07d6 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:29.861869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff979d6-6c42-400c-9ee3-5415d94b07d6 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:29.867020 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 279/556] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:29.867020 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff979d6-6c42-400c-9ee3-5415d94b07d6 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:29.993681 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97a30d-5384-48f8-9ab0-97dedcc126d1 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:30.029388 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:30.050946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:30.069366 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff979d6-6c42-400c-9ee3-5415d94b07d6 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:30.069717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203aae6b-37b9-4fe6-a7f0-2fb1fe8a07a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:30.070813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203aae6b-37b9-4fe6-a7f0-2fb1fe8a07a8 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:30.071363 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203aae6b-37b9-4fe6-a7f0-2fb1fe8a07a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:30.071896 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203aae6b-37b9-4fe6-a7f0-2fb1fe8a07a8 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:30.073116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203aae6b-37b9-4fe6-a7f0-2fb1fe8a07a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:30.073723 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203aae6b-37b9-4fe6-a7f0-2fb1fe8a07a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:30.077089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203aae6b-37b9-4fe6-a7f0-2fb1fe8a07a8 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:30.103521 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 278/557] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:30.106140 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fe18b-1ccf-4733-abd6-647578e14540 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:30.106477 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fe18b-1ccf-4733-abd6-647578e14540 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:30.106824 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fe18b-1ccf-4733-abd6-647578e14540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:30.133035 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e6a0a-6fbd-4ee6-81d0-9d0fedfa469e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:30.133885 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e6a0a-6fbd-4ee6-81d0-9d0fedfa469e None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:30.134310 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e6a0a-6fbd-4ee6-81d0-9d0fedfa469e None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:30.134741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e6a0a-6fbd-4ee6-81d0-9d0fedfa469e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:30.139887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-219fe18b-1ccf-4733-abd6-647578e14540 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:30.142131 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-219fe18b-1ccf-4733-abd6-647578e14540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:30.152401 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e6a0a-6fbd-4ee6-81d0-9d0fedfa469e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:30.154679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e6a0a-6fbd-4ee6-81d0-9d0fedfa469e None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:30.183286 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-f63e6a0a-6fbd-4ee6-81d0-9d0fedfa469e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:30.183286 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:30.183286 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:30.183286 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:30.183286 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:30.183286 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:30.183286 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:30.183286 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:30.183286 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:30.183286 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:30.183286 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:30.183286 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:30.183286 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:30.183286 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:30.183286 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:30.183286 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:30.186942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:30.186942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:30.186942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:30.186942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:30.186942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:30.186942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:30.186942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:30.186942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:30.186942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:30.186942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:30.186942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:30.186942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:30.186942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:30.186942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:30.186942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:30.186942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:30.186942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:30.189088 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:30.189088 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:30.189088 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:30.189088 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 280/558] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:30.197681 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e6a0a-6fbd-4ee6-81d0-9d0fedfa469e None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:30.271240 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 279/559] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:30.272165 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fe18b-1ccf-4733-abd6-647578e14540 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:30.353599 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e6a0a-6fbd-4ee6-81d0-9d0fedfa469e None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:30.399050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b678c85-aba6-4025-97fc-1e26a5947ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:30.400083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b678c85-aba6-4025-97fc-1e26a5947ebc None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:30.400569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b678c85-aba6-4025-97fc-1e26a5947ebc None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:30.401048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b678c85-aba6-4025-97fc-1e26a5947ebc None admin] PATH_INFO: `/v3/users/nova` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:30.411978 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b678c85-aba6-4025-97fc-1e26a5947ebc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:30.413854 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b678c85-aba6-4025-97fc-1e26a5947ebc None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:30.416110 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:30.428384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-2b678c85-aba6-4025-97fc-1e26a5947ebc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:35:30.428384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:30.428384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:30.428384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:30.428384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:30.428384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:30.428384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:30.428384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:30.428384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:30.428384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:30.428384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:30.428384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:30.428384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:35:30.428384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:35:30.428384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:35:30.428384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:35:30.429646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:30.429646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:30.429646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:35:30.429646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:30.429646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:35:30.429646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:30.429646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:30.429646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:30.429646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:30.429646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:30.429646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:30.429646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:30.429646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:30.429646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:30.429646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:30.429646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:30.429646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:30.429646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:30.430756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:30.430756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:30.430756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:35:30.430756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:35:30.430756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:35:30.430756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:35:30.430756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:35:30.430756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:35:30.430756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:35:30.430756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:30.433518 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 281/560] 10.222.0.94 () {56 vars in 1093 bytes} [Wed Aug 24 04:35:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:30.436246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad40137-cc95-449b-8037-4caac45757a4 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:30.436789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad40137-cc95-449b-8037-4caac45757a4 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:30.437304 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad40137-cc95-449b-8037-4caac45757a4 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:30.439187 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 282/561] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:30.445772 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74fd2f-c508-4ae2-bbb7-24ce06c54bd6 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:30.446792 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74fd2f-c508-4ae2-bbb7-24ce06c54bd6 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:30.447294 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74fd2f-c508-4ae2-bbb7-24ce06c54bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:30.466977 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fe18b-1ccf-4733-abd6-647578e14540 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:30.473387 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-3b74fd2f-c508-4ae2-bbb7-24ce06c54bd6 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:30.475613 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-3b74fd2f-c508-4ae2-bbb7-24ce06c54bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:30.509219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:30.518208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b9555-dd3c-45e8-abd5-1ee72b092430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:30.518926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b9555-dd3c-45e8-abd5-1ee72b092430 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:30.519386 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b9555-dd3c-45e8-abd5-1ee72b092430 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:30.519646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b9555-dd3c-45e8-abd5-1ee72b092430 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:30.520857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b9555-dd3c-45e8-abd5-1ee72b092430 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:30.521170 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b9555-dd3c-45e8-abd5-1ee72b092430 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:30.528058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b9555-dd3c-45e8-abd5-1ee72b092430 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:30.550042 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 280/562] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:30.550990 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b9555-dd3c-45e8-abd5-1ee72b092430 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:30.593712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 283/563] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:30.595689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74fd2f-c508-4ae2-bbb7-24ce06c54bd6 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:30.738711 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b9555-dd3c-45e8-abd5-1ee72b092430 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:30.786715 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fa700-3462-4d99-87c4-8d35314470a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:30.787985 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fa700-3462-4d99-87c4-8d35314470a6 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:30.788474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fa700-3462-4d99-87c4-8d35314470a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:30.788943 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fa700-3462-4d99-87c4-8d35314470a6 None admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:30.790698 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fa700-3462-4d99-87c4-8d35314470a6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:30.791774 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fa700-3462-4d99-87c4-8d35314470a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:30.794294 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fa700-3462-4d99-87c4-8d35314470a6 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:30.800407 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74fd2f-c508-4ae2-bbb7-24ce06c54bd6 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:30.824568 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 281/564] 10.222.0.94 () {56 vars in 1133 bytes} [Wed Aug 24 04:35:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:30.826501 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fa700-3462-4d99-87c4-8d35314470a6 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:30.857488 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:30.874645 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e16f9-f1d2-4654-bf2e-2612e559d365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:30.876219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e16f9-f1d2-4654-bf2e-2612e559d365 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:30.877486 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e16f9-f1d2-4654-bf2e-2612e559d365 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:30.878270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e16f9-f1d2-4654-bf2e-2612e559d365 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:30.894646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e16f9-f1d2-4654-bf2e-2612e559d365 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:30.897958 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e16f9-f1d2-4654-bf2e-2612e559d365 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:30.906663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:30.927214 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-c30e16f9-f1d2-4654-bf2e-2612e559d365 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:30.927214 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:30.927214 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:30.927214 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:30.927214 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:30.927214 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:30.927214 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:30.927214 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:30.927214 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:30.927214 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:30.927214 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:30.927214 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:30.927214 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:35:30.927214 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:35:30.927214 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:35:30.928218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:35:30.928218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:30.928218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:30.928218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:30.928218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:30.928218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:30.928218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:30.928218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:30.928218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:30.928218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:30.928218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:30.928218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:30.928218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:30.928218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:30.928218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:30.928218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:30.928218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:30.929354 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:35:30.929354 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:35:30.929354 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:35:30.929354 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:35:30.929354 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:35:30.929354 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:35:30.929354 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:30.929354 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:30.929354 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 284/565] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:35:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:30.931027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e16f9-f1d2-4654-bf2e-2612e559d365 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:31.062761 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fa700-3462-4d99-87c4-8d35314470a6 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:31.130771 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd60572-4563-4c09-9b29-ccf49ddd6924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:31.131786 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd60572-4563-4c09-9b29-ccf49ddd6924 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:31.132239 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd60572-4563-4c09-9b29-ccf49ddd6924 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:31.132685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd60572-4563-4c09-9b29-ccf49ddd6924 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:31.153355 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd60572-4563-4c09-9b29-ccf49ddd6924 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:31.156120 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e16f9-f1d2-4654-bf2e-2612e559d365 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:31.163415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-fcd60572-4563-4c09-9b29-ccf49ddd6924 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:31.163415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:31.163415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:31.163415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:31.163415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:31.163415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:31.163415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:31.163415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:31.163415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:31.163415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:31.163415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:31.163415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:31.163415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:31.163415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:31.163415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:31.163415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:31.165219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:31.165219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:31.165219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:31.165219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:31.165219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:31.165219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:31.165219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:31.165219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:31.165219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:31.165219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:31.165219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:31.165219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:31.165219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:31.165219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:31.165219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:31.165219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:31.166882 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:31.166882 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:31.166882 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:31.166882 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:31.166882 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:31.166882 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:31.166882 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:31.166882 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:31.166882 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:31.166882 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:31.166882 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:31.166882 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:31.166882 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 282/566] 10.222.0.94 () {56 vars in 1102 bytes} [Wed Aug 24 04:35:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:31.166882 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd60572-4563-4c09-9b29-ccf49ddd6924 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:31.222396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf656d-7904-465d-9071-d0db96ab812b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:31.223003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf656d-7904-465d-9071-d0db96ab812b None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:31.223300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf656d-7904-465d-9071-d0db96ab812b None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:31.224136 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf656d-7904-465d-9071-d0db96ab812b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:31.239994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf656d-7904-465d-9071-d0db96ab812b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:31.241561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf656d-7904-465d-9071-d0db96ab812b None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:31.266205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-7bbf656d-7904-465d-9071-d0db96ab812b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:31.266205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:31.266205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:31.266205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:31.266205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:31.266205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:31.266205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:31.266205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:31.266205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:31.266205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:31.266205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:31.266205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:31.266205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:31.266205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:31.266205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:31.266205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:31.268447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:31.268447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:31.268447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:31.268447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:31.268447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:31.268447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:31.268447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:31.268447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:31.268447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:31.268447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:31.268447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:31.268447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:31.268447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:31.268447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:31.268447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:31.268447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:31.268447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:31.271795 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:31.271795 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:31.271795 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:31.271795 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 285/567] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:31.271795 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf656d-7904-465d-9071-d0db96ab812b None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:31.347673 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:31.378061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:31.388143 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd60572-4563-4c09-9b29-ccf49ddd6924 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:31.466873 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf656d-7904-465d-9071-d0db96ab812b None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:31.468105 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3493a3-26f6-4628-94ea-b0b17ef0be45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:31.468105 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3493a3-26f6-4628-94ea-b0b17ef0be45 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:31.470910 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3493a3-26f6-4628-94ea-b0b17ef0be45 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:31.470910 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3493a3-26f6-4628-94ea-b0b17ef0be45 None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:31.470910 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3493a3-26f6-4628-94ea-b0b17ef0be45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:31.470910 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3493a3-26f6-4628-94ea-b0b17ef0be45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:31.473578 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3493a3-26f6-4628-94ea-b0b17ef0be45 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:31.499451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 283/568] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:35:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:31.501107 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3493a3-26f6-4628-94ea-b0b17ef0be45 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:31.549394 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d57478-d77e-43d7-8761-4426ae9c0127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:31.550108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d57478-d77e-43d7-8761-4426ae9c0127 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:31.550393 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d57478-d77e-43d7-8761-4426ae9c0127 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:31.550842 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d57478-d77e-43d7-8761-4426ae9c0127 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:31.571465 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d57478-d77e-43d7-8761-4426ae9c0127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:31.581466 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-99d57478-d77e-43d7-8761-4426ae9c0127 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:31.581466 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:31.581466 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:31.581466 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:31.581466 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:31.581466 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:31.581466 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:31.581466 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:31.581466 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:31.581466 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:31.581466 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:31.581466 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:31.581466 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:31.581466 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:31.581466 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:31.581466 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:31.583712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:31.583712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:31.583712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:31.583712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:31.583712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:31.583712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:31.583712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:31.583712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:31.583712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:31.583712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:31.583712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:31.583712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:31.583712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:31.583712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:31.583712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:31.583712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:31.585912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:31.585912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:31.585912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:31.585912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:31.585912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:31.585912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:31.585912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:31.585912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:31.585912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:31.585912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:31.585912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:31.585912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:31.585912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 286/569] 10.222.0.94 () {56 vars in 1102 bytes} [Wed Aug 24 04:35:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:31.585912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d57478-d77e-43d7-8761-4426ae9c0127 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:31.712273 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3493a3-26f6-4628-94ea-b0b17ef0be45 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:31.765735 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691ed39-0e6e-4013-9aaa-178e3eeaeedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:31.766365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691ed39-0e6e-4013-9aaa-178e3eeaeedc None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:31.766642 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691ed39-0e6e-4013-9aaa-178e3eeaeedc None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:31.766937 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691ed39-0e6e-4013-9aaa-178e3eeaeedc None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:31.767606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691ed39-0e6e-4013-9aaa-178e3eeaeedc None admin] RBAC: Adding query filter params (name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:31.767915 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691ed39-0e6e-4013-9aaa-178e3eeaeedc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:31.769367 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691ed39-0e6e-4013-9aaa-178e3eeaeedc None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:31.774456 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:31.780176 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 284/570] 10.222.0.94 () {56 vars in 1103 bytes} [Wed Aug 24 04:35:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:31.781161 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d57478-d77e-43d7-8761-4426ae9c0127 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:31.781325 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691ed39-0e6e-4013-9aaa-178e3eeaeedc None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:31.812932 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:31.849693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f0521-e9ac-4cc2-a8b6-e839454f0616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:31.850314 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f0521-e9ac-4cc2-a8b6-e839454f0616 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:31.850591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f0521-e9ac-4cc2-a8b6-e839454f0616 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:31.850857 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f0521-e9ac-4cc2-a8b6-e839454f0616 None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:31.851535 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f0521-e9ac-4cc2-a8b6-e839454f0616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:31.852548 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f0521-e9ac-4cc2-a8b6-e839454f0616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:31.854067 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f0521-e9ac-4cc2-a8b6-e839454f0616 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:31.874149 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 287/571] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:31.875743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f0521-e9ac-4cc2-a8b6-e839454f0616 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:31.974680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691ed39-0e6e-4013-9aaa-178e3eeaeedc None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:32.050134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b94a95-bb5d-4c69-af6d-cf3c8b2fb920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:32.051146 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b94a95-bb5d-4c69-af6d-cf3c8b2fb920 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:32.051627 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b94a95-bb5d-4c69-af6d-cf3c8b2fb920 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:32.052104 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b94a95-bb5d-4c69-af6d-cf3c8b2fb920 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:32.053564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b94a95-bb5d-4c69-af6d-cf3c8b2fb920 None admin] RBAC: Adding query filter params (role.id=5e5c4aa158a845b981b0e847f8bd47a6, scope.project.id=4416325d266642f3a786ff9f16c827aa, user.id=40d2202203204b06a41e57b9d1a300fc) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:32.054118 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b94a95-bb5d-4c69-af6d-cf3c8b2fb920 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:32.056950 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b94a95-bb5d-4c69-af6d-cf3c8b2fb920 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:32.068353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 285/572] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:35:31 2022] GET /identity/v3/role_assignments?user.id=40d2202203204b06a41e57b9d1a300fc&scope.project.id=4416325d266642f3a786ff9f16c827aa&role.id=5e5c4aa158a845b981b0e847f8bd47a6 => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:32.070556 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f66559-416f-4bbc-891d-e026ca92e79d None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:32.071049 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f66559-416f-4bbc-891d-e026ca92e79d None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:32.071533 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f66559-416f-4bbc-891d-e026ca92e79d None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:32.074173 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 286/573] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:32.076194 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f66559-416f-4bbc-891d-e026ca92e79d None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:32.083012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f0521-e9ac-4cc2-a8b6-e839454f0616 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:32.141853 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3e927-a41a-4d52-adf7-7cb499c6cde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:32.142625 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3e927-a41a-4d52-adf7-7cb499c6cde6 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:32.143063 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3e927-a41a-4d52-adf7-7cb499c6cde6 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:32.143349 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3e927-a41a-4d52-adf7-7cb499c6cde6 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:32.144105 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3e927-a41a-4d52-adf7-7cb499c6cde6 None admin] RBAC: Adding query filter params (name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:32.144414 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3e927-a41a-4d52-adf7-7cb499c6cde6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:32.145938 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3e927-a41a-4d52-adf7-7cb499c6cde6 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:32.159526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 288/574] 10.222.0.94 () {56 vars in 1103 bytes} [Wed Aug 24 04:35:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:32.160544 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3e927-a41a-4d52-adf7-7cb499c6cde6 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:32.204371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:32.266549 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:32.303904 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f66559-416f-4bbc-891d-e026ca92e79d None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:32.363959 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9c66a-cb58-4389-8864-0c4e96bf2cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:32.364755 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9c66a-cb58-4389-8864-0c4e96bf2cb3 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:32.365005 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9c66a-cb58-4389-8864-0c4e96bf2cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:32.365447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9c66a-cb58-4389-8864-0c4e96bf2cb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:32.366922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3e927-a41a-4d52-adf7-7cb499c6cde6 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:32.380135 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9c66a-cb58-4389-8864-0c4e96bf2cb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:32.381705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9c66a-cb58-4389-8864-0c4e96bf2cb3 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:32.408527 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-83b9c66a-cb58-4389-8864-0c4e96bf2cb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:32.408527 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:32.408527 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:32.408527 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:32.408527 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:32.408527 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:32.408527 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:32.408527 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:32.408527 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:32.408527 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:32.408527 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:32.408527 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:32.408527 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:32.408527 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:32.408527 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:32.408527 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:32.410282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:32.410282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:32.410282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:32.410282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:32.410282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:32.410282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:32.410282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:32.410282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:32.410282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:32.410282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:32.410282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:32.410282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:32.410282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:32.410282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:32.410282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:32.410282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:32.410282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:32.411272 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:32.411272 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:32.411272 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:32.411272 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 287/575] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:32.414628 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f9c5a-fc92-4b61-ab96-6dce76e9e420 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:32.414628 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f9c5a-fc92-4b61-ab96-6dce76e9e420 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:32.414628 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f9c5a-fc92-4b61-ab96-6dce76e9e420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:32.447235 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-823f9c5a-fc92-4b61-ab96-6dce76e9e420 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:32.449221 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-823f9c5a-fc92-4b61-ab96-6dce76e9e420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:32.449505 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25851fa6-4b2a-4c4e-be34-b16096b24f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:32.451557 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25851fa6-4b2a-4c4e-be34-b16096b24f40 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:32.452045 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25851fa6-4b2a-4c4e-be34-b16096b24f40 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:32.452488 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25851fa6-4b2a-4c4e-be34-b16096b24f40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:32.470201 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25851fa6-4b2a-4c4e-be34-b16096b24f40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:32.473002 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25851fa6-4b2a-4c4e-be34-b16096b24f40 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:32.496151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-25851fa6-4b2a-4c4e-be34-b16096b24f40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:32.496151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:32.496151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:32.496151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:32.496151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:32.496151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:32.496151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:32.496151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:32.496151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:32.496151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:32.496151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:32.496151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:32.496151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:35:32.496151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:35:32.496151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:35:32.499633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:35:32.499633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:32.499633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:32.499633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:32.499633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:32.499633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:32.499633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:32.499633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:32.499633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:32.499633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:32.499633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:32.499633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:32.499633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:32.499633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:32.499633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:32.499633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:32.499633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:32.500551 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:35:32.500551 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:35:32.500551 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:35:32.500551 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:35:32.500551 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:35:32.500551 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:35:32.500551 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:32.500551 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:32.500551 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 289/576] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:35:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:32.501888 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25851fa6-4b2a-4c4e-be34-b16096b24f40 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:32.590426 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 288/577] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:32.591505 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f9c5a-fc92-4b61-ab96-6dce76e9e420 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:32.660082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:32.689870 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25851fa6-4b2a-4c4e-be34-b16096b24f40 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:32.724228 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:32.750272 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f79b55-c0fa-47e9-bd80-39e9de7b3146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:32.751922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f79b55-c0fa-47e9-bd80-39e9de7b3146 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:32.752944 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f79b55-c0fa-47e9-bd80-39e9de7b3146 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:32.754016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f79b55-c0fa-47e9-bd80-39e9de7b3146 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:32.773841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f9c5a-fc92-4b61-ab96-6dce76e9e420 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:32.777902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f79b55-c0fa-47e9-bd80-39e9de7b3146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:32.781691 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f79b55-c0fa-47e9-bd80-39e9de7b3146 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:32.810932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-25f79b55-c0fa-47e9-bd80-39e9de7b3146 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:32.810932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:32.810932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:32.810932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:32.810932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:32.810932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:32.810932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:32.810932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:32.810932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:32.810932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:32.810932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:32.810932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:32.810932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:32.810932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:32.810932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:32.810932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:32.812826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:32.812826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:32.812826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:32.812826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:32.812826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:32.812826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:32.812826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:32.812826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:32.812826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:32.812826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:32.812826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:32.812826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:32.812826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:32.812826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:32.812826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:32.812826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:32.812826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:32.814683 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:32.814683 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:32.814683 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:32.816479 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb111c-6b43-4c6e-86bd-30bf6df3d399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:32.817153 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb111c-6b43-4c6e-86bd-30bf6df3d399 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:32.817523 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb111c-6b43-4c6e-86bd-30bf6df3d399 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:32.817902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb111c-6b43-4c6e-86bd-30bf6df3d399 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:32.818709 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb111c-6b43-4c6e-86bd-30bf6df3d399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:32.819091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb111c-6b43-4c6e-86bd-30bf6df3d399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:32.820403 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 290/578] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:32.820577 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb111c-6b43-4c6e-86bd-30bf6df3d399 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:32.822690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f79b55-c0fa-47e9-bd80-39e9de7b3146 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:32.836005 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 289/579] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:32.837023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb111c-6b43-4c6e-86bd-30bf6df3d399 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:32.990882 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb111c-6b43-4c6e-86bd-30bf6df3d399 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:33.030658 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f79b55-c0fa-47e9-bd80-39e9de7b3146 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:33.030939 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:33.053910 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad38abf-1414-47bd-a46c-30538d713f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:33.055138 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad38abf-1414-47bd-a46c-30538d713f41 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:33.055716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad38abf-1414-47bd-a46c-30538d713f41 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:33.056101 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad38abf-1414-47bd-a46c-30538d713f41 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:33.057375 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad38abf-1414-47bd-a46c-30538d713f41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:33.058040 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad38abf-1414-47bd-a46c-30538d713f41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:33.061304 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad38abf-1414-47bd-a46c-30538d713f41 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:33.089813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 290/580] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:33.095252 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad38abf-1414-47bd-a46c-30538d713f41 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:33.101151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2cb67-3b12-46fe-a8e5-3c13f9c91347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:33.102256 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2cb67-3b12-46fe-a8e5-3c13f9c91347 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:33.102766 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2cb67-3b12-46fe-a8e5-3c13f9c91347 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:33.103235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2cb67-3b12-46fe-a8e5-3c13f9c91347 None admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:33.104577 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2cb67-3b12-46fe-a8e5-3c13f9c91347 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:33.105125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2cb67-3b12-46fe-a8e5-3c13f9c91347 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:33.107974 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2cb67-3b12-46fe-a8e5-3c13f9c91347 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:33.111211 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:33.138123 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 291/581] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:35:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:33.139514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2cb67-3b12-46fe-a8e5-3c13f9c91347 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:33.319263 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad38abf-1414-47bd-a46c-30538d713f41 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:33.348120 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2cb67-3b12-46fe-a8e5-3c13f9c91347 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:33.396239 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e806796-45d9-432d-8fc0-beed3b2c986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:33.397777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e806796-45d9-432d-8fc0-beed3b2c986f None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:33.398145 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e806796-45d9-432d-8fc0-beed3b2c986f None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:33.398610 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e806796-45d9-432d-8fc0-beed3b2c986f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:33.410209 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d69b04-0d93-4cbe-aa30-41feb7dbe23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:33.410854 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d69b04-0d93-4cbe-aa30-41feb7dbe23d None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:33.411119 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d69b04-0d93-4cbe-aa30-41feb7dbe23d None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:33.411388 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d69b04-0d93-4cbe-aa30-41feb7dbe23d None admin] PATH_INFO: `/v3/roles/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:33.416359 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e806796-45d9-432d-8fc0-beed3b2c986f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:33.420809 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e806796-45d9-432d-8fc0-beed3b2c986f None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:33.425105 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d69b04-0d93-4cbe-aa30-41feb7dbe23d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:33.430051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-98d69b04-0d93-4cbe-aa30-41feb7dbe23d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:33.430051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:33.430051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:33.430051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:33.430051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:33.430051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:33.430051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:33.430051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:33.430051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:33.430051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:33.430051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:33.430051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:33.430051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:33.430051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:33.430051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:33.430051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:33.438221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:33.438221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:33.438221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:33.438221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:33.438221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:33.438221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:33.438221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:33.438221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:33.438221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:33.438221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:33.438221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:33.438221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:33.438221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:33.438221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:33.438221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:33.438221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:33.439233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:33.439233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:33.439233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:33.439233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:33.439233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:33.439233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:33.439233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:33.439233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:33.439233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:33.439233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:33.439233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:33.439233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:33.439233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 292/582] 10.222.0.94 () {56 vars in 1102 bytes} [Wed Aug 24 04:35:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:33.439233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d69b04-0d93-4cbe-aa30-41feb7dbe23d None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:33.453957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-6e806796-45d9-432d-8fc0-beed3b2c986f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:35:33.453957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:33.453957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:33.453957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:33.453957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:33.453957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:33.453957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:33.453957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:33.453957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:33.453957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:33.453957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:33.453957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:33.453957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:35:33.453957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:35:33.453957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:35:33.453957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:35:33.455765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:33.455765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:33.455765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:35:33.455765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:33.455765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:35:33.455765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:33.455765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:33.455765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:33.455765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:33.455765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:33.455765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:33.455765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:33.455765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:33.455765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:33.455765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:33.455765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:33.455765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:33.455765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:33.457610 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:33.457610 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:33.457610 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:35:33.457610 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:35:33.457610 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:35:33.457610 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:35:33.457610 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:35:33.457610 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:35:33.457610 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:35:33.457610 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:33.460686 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 291/583] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:33.462150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e806796-45d9-432d-8fc0-beed3b2c986f None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:33.551895 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:33.555642 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:33.651166 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e806796-45d9-432d-8fc0-beed3b2c986f None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:33.657430 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d69b04-0d93-4cbe-aa30-41feb7dbe23d None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:33.720760 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689e4cd-e492-4c73-9e06-37456fd7360d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:33.721596 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689e4cd-e492-4c73-9e06-37456fd7360d None admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:33.722208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689e4cd-e492-4c73-9e06-37456fd7360d None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:33.722690 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689e4cd-e492-4c73-9e06-37456fd7360d None admin] PATH_INFO: `/v3/projects/4416325d266642f3a786ff9f16c827aa/users/5bdbda2b9c8f48338c5117585a229cb6/roles/5e5c4aa158a845b981b0e847f8bd47a6` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:33.723164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb1143-c3bc-4f5f-9d1b-75da1c5f3af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:33.724195 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb1143-c3bc-4f5f-9d1b-75da1c5f3af1 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:33.724651 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb1143-c3bc-4f5f-9d1b-75da1c5f3af1 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:33.725110 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb1143-c3bc-4f5f-9d1b-75da1c5f3af1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:33.737540 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb1143-c3bc-4f5f-9d1b-75da1c5f3af1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:33.739996 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb1143-c3bc-4f5f-9d1b-75da1c5f3af1 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:33.756016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689e4cd-e492-4c73-9e06-37456fd7360d None admin] RBAC: Authorizing `identity:create_grant(project_id=4416325d266642f3a786ff9f16c827aa, user_id=5bdbda2b9c8f48338c5117585a229cb6, role_id=5e5c4aa158a845b981b0e847f8bd47a6)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:33.758572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689e4cd-e492-4c73-9e06-37456fd7360d None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:33.765138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-62bb1143-c3bc-4f5f-9d1b-75da1c5f3af1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:35:33.765138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:33.765138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:33.765138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:33.765138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:33.765138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:33.765138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:33.765138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:33.765138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:33.765138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:33.765138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:33.765138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:33.765138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:35:33.765138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:35:33.765138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:35:33.765138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:35:33.772930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:33.772930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:33.772930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:35:33.772930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:33.772930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:35:33.772930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:33.772930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:33.772930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:33.772930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:33.772930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:33.772930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:33.772930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:33.772930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:33.772930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:33.772930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:33.772930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:33.772930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:33.772930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:33.774663 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:33.774663 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:33.774663 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:35:33.774663 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:35:33.774663 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:35:33.774663 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:35:33.774663 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:35:33.774663 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:35:33.774663 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:35:33.774663 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:33.774663 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 293/584] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:33.774663 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb1143-c3bc-4f5f-9d1b-75da1c5f3af1 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:33.795368 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 292/585] 10.222.0.94 () {58 vars in 1439 bytes} [Wed Aug 24 04:35:33 2022] PUT /identity/v3/projects/4416325d266642f3a786ff9f16c827aa/users/5bdbda2b9c8f48338c5117585a229cb6/roles/5e5c4aa158a845b981b0e847f8bd47a6 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:35:33.795368 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689e4cd-e492-4c73-9e06-37456fd7360d None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:33.993774 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:34.005804 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb1143-c3bc-4f5f-9d1b-75da1c5f3af1 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:34.008811 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689e4cd-e492-4c73-9e06-37456fd7360d None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:34.044706 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:34.087672 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89d19d-358a-40ef-936c-fe0354870517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:34.089127 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89d19d-358a-40ef-936c-fe0354870517 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:34.089666 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89d19d-358a-40ef-936c-fe0354870517 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:34.090850 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89d19d-358a-40ef-936c-fe0354870517 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:34.092180 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89d19d-358a-40ef-936c-fe0354870517 None admin] RBAC: Adding query filter params (name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:34.092707 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89d19d-358a-40ef-936c-fe0354870517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:34.095483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89d19d-358a-40ef-936c-fe0354870517 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:34.100356 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033e220-a188-4e68-8cd4-b380a6620862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:34.101344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033e220-a188-4e68-8cd4-b380a6620862 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:34.101779 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033e220-a188-4e68-8cd4-b380a6620862 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:34.102201 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033e220-a188-4e68-8cd4-b380a6620862 None admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:34.103136 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033e220-a188-4e68-8cd4-b380a6620862 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:34.103570 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033e220-a188-4e68-8cd4-b380a6620862 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:34.105217 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033e220-a188-4e68-8cd4-b380a6620862 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:34.116010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 294/586] 10.222.0.94 () {56 vars in 1103 bytes} [Wed Aug 24 04:35:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:34.117236 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89d19d-358a-40ef-936c-fe0354870517 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:34.146771 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 293/587] 10.222.0.94 () {56 vars in 1137 bytes} [Wed Aug 24 04:35:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:34.146771 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033e220-a188-4e68-8cd4-b380a6620862 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:34.357657 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89d19d-358a-40ef-936c-fe0354870517 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:34.371263 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033e220-a188-4e68-8cd4-b380a6620862 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:34.430499 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a077ae-640a-42b1-beaf-8acb5ace9b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:34.431999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a077ae-640a-42b1-beaf-8acb5ace9b2f None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:34.432561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a077ae-640a-42b1-beaf-8acb5ace9b2f None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:34.433326 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a077ae-640a-42b1-beaf-8acb5ace9b2f None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:34.435579 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a077ae-640a-42b1-beaf-8acb5ace9b2f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:34.436478 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a077ae-640a-42b1-beaf-8acb5ace9b2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:34.438836 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a077ae-640a-42b1-beaf-8acb5ace9b2f None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:34.448415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290ab7b-9d30-4ce1-b490-f63f9a0583f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:34.449532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290ab7b-9d30-4ce1-b490-f63f9a0583f8 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:34.450537 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290ab7b-9d30-4ce1-b490-f63f9a0583f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:34.451036 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290ab7b-9d30-4ce1-b490-f63f9a0583f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:34.470356 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 295/588] 10.222.0.94 () {56 vars in 1137 bytes} [Wed Aug 24 04:35:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:34.473661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a077ae-640a-42b1-beaf-8acb5ace9b2f None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:34.480022 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290ab7b-9d30-4ce1-b490-f63f9a0583f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:34.483805 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290ab7b-9d30-4ce1-b490-f63f9a0583f8 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:34.526740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-b290ab7b-9d30-4ce1-b490-f63f9a0583f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:34.526740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:34.526740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:34.526740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:34.526740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:34.526740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:34.526740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:34.526740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:34.526740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:34.526740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:34.526740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:34.526740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:34.526740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:34.526740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:34.526740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:34.526740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:34.529398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:34.529398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:34.529398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:34.529398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:34.529398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:34.529398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:34.529398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:34.529398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:34.529398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:34.529398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:34.529398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:34.529398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:34.529398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:34.529398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:34.529398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:34.529398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:34.529398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:34.531449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:34.531449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:34.531449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:34.535615 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 294/589] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:34.537561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290ab7b-9d30-4ce1-b490-f63f9a0583f8 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:34.551873 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:34.570156 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:34.716494 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a077ae-640a-42b1-beaf-8acb5ace9b2f None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:34.771230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290ab7b-9d30-4ce1-b490-f63f9a0583f8 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:34.794667 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469ecc3-fd73-4773-b4a2-d80a063730f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:34.795770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469ecc3-fd73-4773-b4a2-d80a063730f4 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:34.796291 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469ecc3-fd73-4773-b4a2-d80a063730f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:34.796747 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469ecc3-fd73-4773-b4a2-d80a063730f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:34.817166 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469ecc3-fd73-4773-b4a2-d80a063730f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:34.819886 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469ecc3-fd73-4773-b4a2-d80a063730f4 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:34.843230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfc984-c134-4eab-aa5f-a33803e947e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:34.844657 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfc984-c134-4eab-aa5f-a33803e947e8 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:34.845293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfc984-c134-4eab-aa5f-a33803e947e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:34.845928 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfc984-c134-4eab-aa5f-a33803e947e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:34.849300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-2469ecc3-fd73-4773-b4a2-d80a063730f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:34.849300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:34.849300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:34.849300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:34.849300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:34.849300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:34.849300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:34.849300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:34.849300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:34.849300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:34.849300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:34.849300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:34.849300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:34.849300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:34.849300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:34.849300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:34.851670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:34.851670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:34.851670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:34.851670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:34.851670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:34.851670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:34.851670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:34.851670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:34.851670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:34.851670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:34.851670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:34.851670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:34.851670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:34.851670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:34.851670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:34.851670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:34.851670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:34.853510 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:34.853510 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:34.853510 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:34.853510 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 296/590] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:34.853839 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469ecc3-fd73-4773-b4a2-d80a063730f4 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:34.876060 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfc984-c134-4eab-aa5f-a33803e947e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:34.878990 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfc984-c134-4eab-aa5f-a33803e947e8 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:34.904565 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-59dfc984-c134-4eab-aa5f-a33803e947e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:34.904565 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:34.904565 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:34.904565 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:34.904565 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:34.904565 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:34.904565 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:34.904565 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:34.904565 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:34.904565 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:34.904565 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:34.904565 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:34.904565 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:34.904565 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:34.904565 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:34.904565 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:34.906584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:34.906584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:34.906584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:34.906584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:34.906584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:34.906584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:34.906584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:34.906584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:34.906584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:34.906584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:34.906584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:34.906584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:34.906584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:34.906584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:34.906584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:34.906584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:34.906584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:34.908582 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:34.908582 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:34.908582 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:34.908582 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 295/591] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:34.909331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16d93c-96c6-4383-a900-8e9f6c7364ca None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:34.909645 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16d93c-96c6-4383-a900-8e9f6c7364ca None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:34.910091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16d93c-96c6-4383-a900-8e9f6c7364ca None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:34.917667 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 296/592] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:34.917667 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16d93c-96c6-4383-a900-8e9f6c7364ca None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:35.021967 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:35.027904 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:35.048805 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469ecc3-fd73-4773-b4a2-d80a063730f4 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:35.100149 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e55ca9-5309-4b76-a9a1-70b65090665f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:35.101163 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e55ca9-5309-4b76-a9a1-70b65090665f None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:35.101702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e55ca9-5309-4b76-a9a1-70b65090665f None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:35.102196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e55ca9-5309-4b76-a9a1-70b65090665f None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:35.103474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e55ca9-5309-4b76-a9a1-70b65090665f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:35.104037 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e55ca9-5309-4b76-a9a1-70b65090665f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:35.107332 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e55ca9-5309-4b76-a9a1-70b65090665f None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:35.122345 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16d93c-96c6-4383-a900-8e9f6c7364ca None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:35.132881 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 297/593] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:35.134484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e55ca9-5309-4b76-a9a1-70b65090665f None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:35.189486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae88e8-3271-4028-a93c-24a59deb83d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:35.190619 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae88e8-3271-4028-a93c-24a59deb83d2 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:35.191285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae88e8-3271-4028-a93c-24a59deb83d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:35.191719 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae88e8-3271-4028-a93c-24a59deb83d2 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:35.192679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae88e8-3271-4028-a93c-24a59deb83d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:35.193117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae88e8-3271-4028-a93c-24a59deb83d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:35.195333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae88e8-3271-4028-a93c-24a59deb83d2 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:35.221496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 297/594] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:35.221496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62756ada-ae18-4052-a107-cbc0127bbfd5 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:35.221496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62756ada-ae18-4052-a107-cbc0127bbfd5 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:35.221496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62756ada-ae18-4052-a107-cbc0127bbfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:35.243008 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-62756ada-ae18-4052-a107-cbc0127bbfd5 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:35.245181 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-62756ada-ae18-4052-a107-cbc0127bbfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:35.352179 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e55ca9-5309-4b76-a9a1-70b65090665f None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:35.393342 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 298/595] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:35.395138 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62756ada-ae18-4052-a107-cbc0127bbfd5 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:35.447829 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955cee1-c350-44dd-8e4e-f2b2439cf747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:35.449061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955cee1-c350-44dd-8e4e-f2b2439cf747 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:35.450316 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955cee1-c350-44dd-8e4e-f2b2439cf747 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:35.451350 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955cee1-c350-44dd-8e4e-f2b2439cf747 None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:35.453004 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955cee1-c350-44dd-8e4e-f2b2439cf747 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:35.453663 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955cee1-c350-44dd-8e4e-f2b2439cf747 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:35.456736 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955cee1-c350-44dd-8e4e-f2b2439cf747 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:35.484643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 298/596] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:35.486508 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955cee1-c350-44dd-8e4e-f2b2439cf747 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:35.504940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:35.510837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:35.633954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62756ada-ae18-4052-a107-cbc0127bbfd5 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:35.714298 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441e1dd-1e7a-4e65-83a0-2cc458693f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:35.716133 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441e1dd-1e7a-4e65-83a0-2cc458693f15 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:35.716133 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441e1dd-1e7a-4e65-83a0-2cc458693f15 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:35.717011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441e1dd-1e7a-4e65-83a0-2cc458693f15 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:35.719119 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955cee1-c350-44dd-8e4e-f2b2439cf747 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:35.735967 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441e1dd-1e7a-4e65-83a0-2cc458693f15 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:35.739033 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441e1dd-1e7a-4e65-83a0-2cc458693f15 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:35.773177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-c441e1dd-1e7a-4e65-83a0-2cc458693f15 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:35:35.773177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:35.773177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:35.773177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:35.773177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:35.773177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:35.773177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:35.773177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:35.773177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:35.773177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:35.773177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:35.773177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:35.773177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:35:35.773177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:35:35.773177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:35:35.773177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:35:35.775716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:35.775716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:35.775716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:35:35.775716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:35.775716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:35:35.775716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:35.775716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:35.775716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:35.775716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:35.775716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:35.775716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:35.775716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:35.775716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:35.775716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:35.775716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:35.775716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:35.775716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:35.775716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:35.777524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:35.777524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:35.777524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:35:35.777524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:35:35.777524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:35:35.777524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:35:35.777524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:35:35.777524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:35:35.777524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:35:35.777524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:35.777524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 299/597] 10.222.0.94 () {56 vars in 1102 bytes} [Wed Aug 24 04:35:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:35.777524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441e1dd-1e7a-4e65-83a0-2cc458693f15 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:35.817207 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7ef5f-5e9c-4f62-8285-9a77cad225ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:35.819335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7ef5f-5e9c-4f62-8285-9a77cad225ce None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:35.820951 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7ef5f-5e9c-4f62-8285-9a77cad225ce None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:35.821874 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7ef5f-5e9c-4f62-8285-9a77cad225ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:35.839001 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7ef5f-5e9c-4f62-8285-9a77cad225ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:35.843259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7ef5f-5e9c-4f62-8285-9a77cad225ce None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:35.876489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-80b7ef5f-5e9c-4f62-8285-9a77cad225ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:35.876489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:35.876489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:35.876489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:35.876489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:35.876489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:35.876489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:35.876489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:35.876489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:35.876489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:35.876489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:35.876489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:35.876489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:35:35.876489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:35:35.876489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:35:35.878277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:35:35.878277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:35.878277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:35.878277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:35.878277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:35.878277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:35.878277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:35.878277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:35.878277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:35.878277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:35.878277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:35.878277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:35.878277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:35.878277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:35.878277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:35.878277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:35.878277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:35.880041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:35:35.880041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:35:35.880041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:35:35.880041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:35:35.880041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:35:35.880041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:35:35.880041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:35.880041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:35.880041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 299/598] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:35:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:35.882778 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7ef5f-5e9c-4f62-8285-9a77cad225ce None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:36.010799 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441e1dd-1e7a-4e65-83a0-2cc458693f15 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:36.031604 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:36.035235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:36.092011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c0a14-4115-423c-927e-69e330c31787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:36.093111 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c0a14-4115-423c-927e-69e330c31787 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:36.093645 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c0a14-4115-423c-927e-69e330c31787 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:36.094202 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c0a14-4115-423c-927e-69e330c31787 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:36.103043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7ef5f-5e9c-4f62-8285-9a77cad225ce None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:36.108391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c0a14-4115-423c-927e-69e330c31787 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:36.111324 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c0a14-4115-423c-927e-69e330c31787 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:36.134232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-ab5c0a14-4115-423c-927e-69e330c31787 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:36.134232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:36.134232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:36.134232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:36.134232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:36.134232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:36.134232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:36.134232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:36.134232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:36.134232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:36.134232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:36.134232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:36.134232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:35:36.134232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:35:36.134232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:35:36.136129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:35:36.136129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:36.136129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:36.136129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:36.136129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:36.136129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:36.136129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:36.136129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:36.136129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:36.136129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:36.136129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:36.136129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:36.136129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:36.136129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:36.136129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:36.136129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:36.136129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:36.139634 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:35:36.139634 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:35:36.139634 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:35:36.139634 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:35:36.139634 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:35:36.139634 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:35:36.139634 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:36.139634 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:36.139634 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 300/599] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:35:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:36.139634 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c0a14-4115-423c-927e-69e330c31787 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:36.171401 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05555c6-f528-487e-b582-4e31bf6e9cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:36.172142 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05555c6-f528-487e-b582-4e31bf6e9cab None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:36.172424 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05555c6-f528-487e-b582-4e31bf6e9cab None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:36.173065 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05555c6-f528-487e-b582-4e31bf6e9cab None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:36.174186 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05555c6-f528-487e-b582-4e31bf6e9cab None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:36.174531 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05555c6-f528-487e-b582-4e31bf6e9cab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:36.176492 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05555c6-f528-487e-b582-4e31bf6e9cab None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:36.217246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 300/600] 10.222.0.94 () {56 vars in 1139 bytes} [Wed Aug 24 04:35:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:36.219668 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05555c6-f528-487e-b582-4e31bf6e9cab None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:36.330126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c0a14-4115-423c-927e-69e330c31787 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:36.408495 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c1a9c-8e62-45fc-9947-9e956d681df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:36.409898 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c1a9c-8e62-45fc-9947-9e956d681df6 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:36.410403 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c1a9c-8e62-45fc-9947-9e956d681df6 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:36.410900 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c1a9c-8e62-45fc-9947-9e956d681df6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:36.430893 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05555c6-f528-487e-b582-4e31bf6e9cab None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:36.437606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c1a9c-8e62-45fc-9947-9e956d681df6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:36.447558 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-924c1a9c-8e62-45fc-9947-9e956d681df6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:36.447558 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:36.447558 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:36.447558 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:36.447558 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:36.447558 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:36.447558 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:36.447558 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:36.447558 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:36.447558 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:36.447558 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:36.447558 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:36.447558 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:36.447558 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:36.447558 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:36.447558 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:36.449431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:36.449431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:36.449431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:36.449431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:36.449431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:36.449431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:36.449431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:36.449431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:36.449431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:36.449431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:36.449431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:36.449431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:36.449431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:36.449431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:36.449431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:36.449431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:36.453526 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:36.453526 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:36.453526 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:36.453526 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:36.453526 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:36.453526 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:36.453526 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:36.453526 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:36.453526 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:36.453526 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:36.453526 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:36.453526 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:36.453526 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 301/601] 10.222.0.94 () {56 vars in 1102 bytes} [Wed Aug 24 04:35:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:36.453526 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c1a9c-8e62-45fc-9947-9e956d681df6 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:36.486636 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:36.506524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:36.510958 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739decb-644e-4670-90ac-e94cee00cb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:36.512390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739decb-644e-4670-90ac-e94cee00cb1d None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:36.512765 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739decb-644e-4670-90ac-e94cee00cb1d None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:36.513200 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739decb-644e-4670-90ac-e94cee00cb1d None admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:36.514465 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739decb-644e-4670-90ac-e94cee00cb1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:36.515009 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739decb-644e-4670-90ac-e94cee00cb1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:36.517751 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739decb-644e-4670-90ac-e94cee00cb1d None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:36.546173 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 301/602] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:35:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:36.547382 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739decb-644e-4670-90ac-e94cee00cb1d None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:36.643532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c1a9c-8e62-45fc-9947-9e956d681df6 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:36.720056 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8d368-92b8-48b5-8484-152746a218c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:36.721978 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8d368-92b8-48b5-8484-152746a218c6 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:36.722781 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8d368-92b8-48b5-8484-152746a218c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:36.723699 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8d368-92b8-48b5-8484-152746a218c6 None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:36.725900 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8d368-92b8-48b5-8484-152746a218c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:36.726947 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8d368-92b8-48b5-8484-152746a218c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:36.729645 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8d368-92b8-48b5-8484-152746a218c6 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:36.738223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739decb-644e-4670-90ac-e94cee00cb1d None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:36.752387 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 302/603] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:35:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:36.752387 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8d368-92b8-48b5-8484-152746a218c6 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:36.803796 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93abefe-7107-4348-8ee1-e8f4a6b51ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:36.804479 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93abefe-7107-4348-8ee1-e8f4a6b51ef3 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:36.804799 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93abefe-7107-4348-8ee1-e8f4a6b51ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:36.805164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93abefe-7107-4348-8ee1-e8f4a6b51ef3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:36.825310 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93abefe-7107-4348-8ee1-e8f4a6b51ef3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:36.828421 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93abefe-7107-4348-8ee1-e8f4a6b51ef3 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:36.856823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-c93abefe-7107-4348-8ee1-e8f4a6b51ef3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:36.856823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:36.856823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:36.856823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:36.856823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:36.856823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:36.856823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:36.856823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:36.856823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:36.856823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:36.856823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:36.856823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:36.856823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:36.856823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:36.856823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:36.856823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:36.858719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:36.858719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:36.858719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:36.858719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:36.858719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:36.858719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:36.858719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:36.858719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:36.858719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:36.858719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:36.858719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:36.858719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:36.858719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:36.858719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:36.858719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:36.858719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:36.858719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:36.860429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:36.860429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:36.860429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:36.860429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 302/604] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:36.860779 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93abefe-7107-4348-8ee1-e8f4a6b51ef3 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:36.932512 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:36.936387 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:36.958395 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8d368-92b8-48b5-8484-152746a218c6 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:37.019282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77def5-5904-4acb-a5f2-e74ef477f268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:37.020009 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77def5-5904-4acb-a5f2-e74ef477f268 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:37.020420 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77def5-5904-4acb-a5f2-e74ef477f268 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:37.020864 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77def5-5904-4acb-a5f2-e74ef477f268 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:37.022032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77def5-5904-4acb-a5f2-e74ef477f268 None admin] RBAC: Adding query filter params (name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:37.022397 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77def5-5904-4acb-a5f2-e74ef477f268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:37.024746 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77def5-5904-4acb-a5f2-e74ef477f268 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:37.040120 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 303/605] 10.222.0.94 () {56 vars in 1103 bytes} [Wed Aug 24 04:35:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:37.041313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77def5-5904-4acb-a5f2-e74ef477f268 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:37.059034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93abefe-7107-4348-8ee1-e8f4a6b51ef3 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:37.116945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7bedde-01b2-40d1-8a92-b232dfa2c40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:37.117682 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bedde-01b2-40d1-8a92-b232dfa2c40f None admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:37.118128 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bedde-01b2-40d1-8a92-b232dfa2c40f None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:37.118540 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bedde-01b2-40d1-8a92-b232dfa2c40f None admin] PATH_INFO: `/v3/projects/4416325d266642f3a786ff9f16c827aa/users/6d36675e4e6045158add36ac528d6c7b/roles/5e5c4aa158a845b981b0e847f8bd47a6` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:37.136861 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7bedde-01b2-40d1-8a92-b232dfa2c40f None admin] RBAC: Authorizing `identity:create_grant(project_id=4416325d266642f3a786ff9f16c827aa, user_id=6d36675e4e6045158add36ac528d6c7b, role_id=5e5c4aa158a845b981b0e847f8bd47a6)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:37.140015 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7bedde-01b2-40d1-8a92-b232dfa2c40f None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:37.156432 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 303/606] 10.222.0.94 () {58 vars in 1439 bytes} [Wed Aug 24 04:35:36 2022] PUT /identity/v3/projects/4416325d266642f3a786ff9f16c827aa/users/6d36675e4e6045158add36ac528d6c7b/roles/5e5c4aa158a845b981b0e847f8bd47a6 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:35:37.158523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf14141-5f79-40ba-a039-db33c7738d34 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:37.159285 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf14141-5f79-40ba-a039-db33c7738d34 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:37.159803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf14141-5f79-40ba-a039-db33c7738d34 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:37.162802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 304/607] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:37.163682 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf14141-5f79-40ba-a039-db33c7738d34 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:37.259753 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77def5-5904-4acb-a5f2-e74ef477f268 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:37.336772 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ed432-a013-4723-87a8-a831305841cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:37.338027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ed432-a013-4723-87a8-a831305841cb None admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:37.338532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ed432-a013-4723-87a8-a831305841cb None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:37.339040 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ed432-a013-4723-87a8-a831305841cb None admin] PATH_INFO: `/v3/projects/4416325d266642f3a786ff9f16c827aa/users/bbec984d81c84035887220056b3790ec/roles/5e5c4aa158a845b981b0e847f8bd47a6` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:37.352876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:37.379140 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf14141-5f79-40ba-a039-db33c7738d34 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:37.379382 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ed432-a013-4723-87a8-a831305841cb None admin] RBAC: Authorizing `identity:create_grant(project_id=4416325d266642f3a786ff9f16c827aa, user_id=bbec984d81c84035887220056b3790ec, role_id=5e5c4aa158a845b981b0e847f8bd47a6)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:37.382023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ed432-a013-4723-87a8-a831305841cb None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:37.403937 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:37.417577 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 304/608] 10.222.0.94 () {58 vars in 1439 bytes} [Wed Aug 24 04:35:37 2022] PUT /identity/v3/projects/4416325d266642f3a786ff9f16c827aa/users/bbec984d81c84035887220056b3790ec/roles/5e5c4aa158a845b981b0e847f8bd47a6 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:35:37.422518 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ed432-a013-4723-87a8-a831305841cb None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:37.468955 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19757f6e-4300-4a18-8246-7a3518f655ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:37.470163 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19757f6e-4300-4a18-8246-7a3518f655ce None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:37.470695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19757f6e-4300-4a18-8246-7a3518f655ce None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:37.471242 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19757f6e-4300-4a18-8246-7a3518f655ce None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:37.472541 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19757f6e-4300-4a18-8246-7a3518f655ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:37.473089 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19757f6e-4300-4a18-8246-7a3518f655ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:37.475823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19757f6e-4300-4a18-8246-7a3518f655ce None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:37.502006 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 305/609] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:37.504332 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19959c2-21da-495c-a70b-d707678feb6f None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:37.504798 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19959c2-21da-495c-a70b-d707678feb6f None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:37.505356 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19959c2-21da-495c-a70b-d707678feb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:37.545170 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-b19959c2-21da-495c-a70b-d707678feb6f None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:37.547868 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-b19959c2-21da-495c-a70b-d707678feb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:37.616395 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ed432-a013-4723-87a8-a831305841cb None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:37.669375 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c71ca-3a5e-4909-8d93-2fa7d78a1acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:37.670204 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c71ca-3a5e-4909-8d93-2fa7d78a1acb None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:37.670625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c71ca-3a5e-4909-8d93-2fa7d78a1acb None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:37.670955 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c71ca-3a5e-4909-8d93-2fa7d78a1acb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:37.686332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c71ca-3a5e-4909-8d93-2fa7d78a1acb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:37.688450 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c71ca-3a5e-4909-8d93-2fa7d78a1acb None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:37.720001 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 306/610] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:37.722163 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19959c2-21da-495c-a70b-d707678feb6f None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:37.725829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-db1c71ca-3a5e-4909-8d93-2fa7d78a1acb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:37.725829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:37.725829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:37.725829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:37.725829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:37.725829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:37.725829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:37.725829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:37.725829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:37.725829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:37.725829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:37.725829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:37.725829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:37.725829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:37.725829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:37.725829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:37.727678 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:37.727678 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:37.727678 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:37.727678 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:37.727678 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:37.727678 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:37.727678 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:37.727678 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:37.727678 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:37.727678 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:37.727678 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:37.727678 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:37.727678 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:37.727678 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:37.727678 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:37.727678 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:37.727678 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:37.729359 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:37.729359 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:37.729359 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:37.729359 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 305/611] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:37.739191 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c71ca-3a5e-4909-8d93-2fa7d78a1acb None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:37.838984 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:37.897392 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:37.917474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c71ca-3a5e-4909-8d93-2fa7d78a1acb None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:37.967413 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19959c2-21da-495c-a70b-d707678feb6f None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:37.977504 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b47d53-ff47-43fc-a12a-634baefa1e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:37.977504 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b47d53-ff47-43fc-a12a-634baefa1e78 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:37.977504 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b47d53-ff47-43fc-a12a-634baefa1e78 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:37.977504 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b47d53-ff47-43fc-a12a-634baefa1e78 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:37.978627 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b47d53-ff47-43fc-a12a-634baefa1e78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:37.978627 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b47d53-ff47-43fc-a12a-634baefa1e78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:37.979400 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b47d53-ff47-43fc-a12a-634baefa1e78 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:38.001390 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 306/612] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:38.020146 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b47d53-ff47-43fc-a12a-634baefa1e78 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:38.046196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2c973-0ebf-4a93-a5cb-110109300762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:38.047051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2c973-0ebf-4a93-a5cb-110109300762 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:38.047461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2c973-0ebf-4a93-a5cb-110109300762 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:38.047745 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2c973-0ebf-4a93-a5cb-110109300762 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:38.062891 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2c973-0ebf-4a93-a5cb-110109300762 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:38.064424 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2c973-0ebf-4a93-a5cb-110109300762 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:38.087605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-eba2c973-0ebf-4a93-a5cb-110109300762 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:38.087605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:38.087605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:38.087605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:38.087605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:38.087605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:38.087605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:38.087605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:38.087605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:38.087605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:38.087605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:38.087605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:38.087605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:35:38.087605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:35:38.087605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:35:38.089298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:35:38.089298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:38.089298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:38.089298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:38.089298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:38.089298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:38.089298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:38.089298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:38.089298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:38.089298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:38.089298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:38.089298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:38.089298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:38.089298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:38.089298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:38.089298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:38.089298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:38.092429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:35:38.092429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:35:38.092429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:35:38.092429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:35:38.092429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:35:38.092429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:35:38.092429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:38.092429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:38.093638 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 307/613] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:35:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:38.095911 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2c973-0ebf-4a93-a5cb-110109300762 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:38.237812 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b47d53-ff47-43fc-a12a-634baefa1e78 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:38.269270 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:38.322674 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852571c-4271-4b52-a513-4c414aea552a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:38.324075 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852571c-4271-4b52-a513-4c414aea552a None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:38.324714 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852571c-4271-4b52-a513-4c414aea552a None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:38.325202 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852571c-4271-4b52-a513-4c414aea552a None admin] PATH_INFO: `/v3/users/swift` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:38.338356 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2c973-0ebf-4a93-a5cb-110109300762 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:38.342374 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852571c-4271-4b52-a513-4c414aea552a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:38.346504 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852571c-4271-4b52-a513-4c414aea552a None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:38.372676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-b852571c-4271-4b52-a513-4c414aea552a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:35:38.372676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:38.372676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:38.372676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:38.372676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:38.372676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:38.372676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:38.372676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:38.372676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:38.372676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:38.372676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:38.372676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:38.372676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:35:38.372676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:35:38.372676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:35:38.372676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:35:38.374545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:38.374545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:38.374545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:35:38.374545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:38.374545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:35:38.374545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:38.374545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:38.374545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:38.374545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:38.374545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:38.374545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:38.374545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:38.374545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:38.374545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:38.374545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:38.374545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:38.374545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:38.374545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:38.376383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:38.376383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:38.376383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:35:38.376383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:35:38.376383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:35:38.376383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:35:38.376383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:35:38.376383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:35:38.376383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:35:38.376383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:38.376383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 307/614] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:35:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:38.377340 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852571c-4271-4b52-a513-4c414aea552a None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:38.419381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d9f4b-83c3-4ea2-ad72-db4b9cf4c421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:38.420559 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d9f4b-83c3-4ea2-ad72-db4b9cf4c421 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:38.421052 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d9f4b-83c3-4ea2-ad72-db4b9cf4c421 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:38.421566 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d9f4b-83c3-4ea2-ad72-db4b9cf4c421 None admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:38.423016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d9f4b-83c3-4ea2-ad72-db4b9cf4c421 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:38.423556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d9f4b-83c3-4ea2-ad72-db4b9cf4c421 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:38.426377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d9f4b-83c3-4ea2-ad72-db4b9cf4c421 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:38.431719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:38.455815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 308/615] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:35:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:35:38.457287 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d9f4b-83c3-4ea2-ad72-db4b9cf4c421 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:38.583711 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852571c-4271-4b52-a513-4c414aea552a None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:38.646247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111fb3f-ab0b-4347-9946-4cfbf730e1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:38.647084 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111fb3f-ab0b-4347-9946-4cfbf730e1eb None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:38.647572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111fb3f-ab0b-4347-9946-4cfbf730e1eb None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:38.648049 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111fb3f-ab0b-4347-9946-4cfbf730e1eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:38.661697 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d9f4b-83c3-4ea2-ad72-db4b9cf4c421 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:38.667712 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111fb3f-ab0b-4347-9946-4cfbf730e1eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:38.678048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-f111fb3f-ab0b-4347-9946-4cfbf730e1eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:38.678048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:38.678048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:38.678048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:38.678048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:38.678048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:38.678048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:38.678048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:38.678048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:38.678048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:38.678048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:38.678048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:38.678048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:38.678048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:38.678048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:38.678048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:38.681751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:38.681751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:38.681751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:38.681751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:38.681751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:38.681751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:38.681751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:38.681751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:38.681751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:38.681751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:38.681751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:38.681751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:38.681751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:38.681751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:38.681751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:38.681751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:38.685517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:38.685517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:38.685517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:38.685517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:38.685517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:38.685517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:38.685517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:38.685517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:38.685517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:38.685517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:38.685517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:38.685517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:38.695797 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 308/616] 10.222.0.94 () {56 vars in 1102 bytes} [Wed Aug 24 04:35:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:38.695797 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111fb3f-ab0b-4347-9946-4cfbf730e1eb None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:38.733437 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13970bc-eca6-4ca4-901d-406626cee064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:38.733437 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13970bc-eca6-4ca4-901d-406626cee064 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:38.733437 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13970bc-eca6-4ca4-901d-406626cee064 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:38.733437 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13970bc-eca6-4ca4-901d-406626cee064 None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:38.734562 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13970bc-eca6-4ca4-901d-406626cee064 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:38.734562 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13970bc-eca6-4ca4-901d-406626cee064 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:38.734562 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13970bc-eca6-4ca4-901d-406626cee064 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:38.750040 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:38.774898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 309/617] 10.222.0.94 () {56 vars in 1135 bytes} [Wed Aug 24 04:35:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:38.776695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13970bc-eca6-4ca4-901d-406626cee064 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:38.896735 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111fb3f-ab0b-4347-9946-4cfbf730e1eb None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:38.897121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:38.948084 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e64922-108a-4941-bc51-8b558681b1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:38.950747 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e64922-108a-4941-bc51-8b558681b1c2 None admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:38.952405 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e64922-108a-4941-bc51-8b558681b1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:38.953176 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e64922-108a-4941-bc51-8b558681b1c2 None admin] PATH_INFO: `/v3/projects/4416325d266642f3a786ff9f16c827aa/users/0742c7ecf68d40a38c8947a05eee2797/roles/5e5c4aa158a845b981b0e847f8bd47a6` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:38.982972 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13970bc-eca6-4ca4-901d-406626cee064 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:38.995058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e64922-108a-4941-bc51-8b558681b1c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=4416325d266642f3a786ff9f16c827aa, user_id=0742c7ecf68d40a38c8947a05eee2797, role_id=5e5c4aa158a845b981b0e847f8bd47a6)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:38.998943 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e64922-108a-4941-bc51-8b558681b1c2 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:39.037441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 309/618] 10.222.0.94 () {58 vars in 1439 bytes} [Wed Aug 24 04:35:38 2022] PUT /identity/v3/projects/4416325d266642f3a786ff9f16c827aa/users/0742c7ecf68d40a38c8947a05eee2797/roles/5e5c4aa158a845b981b0e847f8bd47a6 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:35:39.037441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e64922-108a-4941-bc51-8b558681b1c2 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:39.095813 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5932916-1650-4359-8363-feaddbb708d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:39.097114 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5932916-1650-4359-8363-feaddbb708d3 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:39.097753 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5932916-1650-4359-8363-feaddbb708d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:39.098264 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5932916-1650-4359-8363-feaddbb708d3 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:39.099535 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5932916-1650-4359-8363-feaddbb708d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:39.100094 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5932916-1650-4359-8363-feaddbb708d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:39.110958 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5932916-1650-4359-8363-feaddbb708d3 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:39.153788 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 310/619] 10.222.0.94 () {56 vars in 1103 bytes} [Wed Aug 24 04:35:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:39.166310 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5932916-1650-4359-8363-feaddbb708d3 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:39.175102 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:39.203911 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e64922-108a-4941-bc51-8b558681b1c2 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:39.275050 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329c9fa-7db1-4041-858e-5eae83fbef3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:39.276786 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329c9fa-7db1-4041-858e-5eae83fbef3e None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:39.276961 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329c9fa-7db1-4041-858e-5eae83fbef3e None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:39.277256 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329c9fa-7db1-4041-858e-5eae83fbef3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:39.302847 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329c9fa-7db1-4041-858e-5eae83fbef3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:39.304477 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329c9fa-7db1-4041-858e-5eae83fbef3e None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:39.329869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-1329c9fa-7db1-4041-858e-5eae83fbef3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:39.329869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:39.329869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:39.329869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:39.329869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:39.329869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:39.329869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:39.329869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:39.329869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:39.329869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:39.329869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:39.329869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:39.329869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:39.329869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:39.329869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:39.329869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:39.331820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:39.331820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:39.331820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:39.331820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:39.331820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:39.331820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:39.331820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:39.331820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:39.331820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:39.331820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:39.331820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:39.331820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:39.331820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:39.331820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:39.331820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:39.331820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:39.331820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:39.333617 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:39.333617 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:39.333617 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:39.336702 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 310/620] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:39.338277 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329c9fa-7db1-4041-858e-5eae83fbef3e None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:39.435544 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5932916-1650-4359-8363-feaddbb708d3 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:39.463447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:39.484307 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ef66e-cf00-45bf-91d4-aaaf298967ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:39.485103 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ef66e-cf00-45bf-91d4-aaaf298967ce None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:39.485471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ef66e-cf00-45bf-91d4-aaaf298967ce None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:39.485818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ef66e-cf00-45bf-91d4-aaaf298967ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:39.500330 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ef66e-cf00-45bf-91d4-aaaf298967ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:39.501998 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ef66e-cf00-45bf-91d4-aaaf298967ce None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:39.511662 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329c9fa-7db1-4041-858e-5eae83fbef3e None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:39.519520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-078ef66e-cf00-45bf-91d4-aaaf298967ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:39.519520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:39.519520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:39.519520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:39.519520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:39.519520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:39.519520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:39.519520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:39.519520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:39.519520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:39.519520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:39.519520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:39.519520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:39.519520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:39.519520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:39.519520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:39.520662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:39.520662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:39.520662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:39.520662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:39.520662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:39.520662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:39.520662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:39.520662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:39.520662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:39.520662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:39.520662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:39.520662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:39.520662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:39.520662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:39.520662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:39.520662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:39.520662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:39.521605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:39.521605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:39.521605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:39.521605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 311/621] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:39.534871 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ef66e-cf00-45bf-91d4-aaaf298967ce None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:39.570818 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:39.586860 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed9bf0-7af3-416e-9369-ccd4b04ab92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:39.587870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed9bf0-7af3-416e-9369-ccd4b04ab92d None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:39.588341 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed9bf0-7af3-416e-9369-ccd4b04ab92d None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:39.588812 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed9bf0-7af3-416e-9369-ccd4b04ab92d None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:39.590639 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed9bf0-7af3-416e-9369-ccd4b04ab92d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:39.591418 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed9bf0-7af3-416e-9369-ccd4b04ab92d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:39.594027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed9bf0-7af3-416e-9369-ccd4b04ab92d None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:39.641086 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 311/622] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:35:39.648023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed9bf0-7af3-416e-9369-ccd4b04ab92d None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:39.829735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ef66e-cf00-45bf-91d4-aaaf298967ce None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:39.896264 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728618f-a600-4beb-af0a-9c9391f2f21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:39.896894 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728618f-a600-4beb-af0a-9c9391f2f21f None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:39.897182 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728618f-a600-4beb-af0a-9c9391f2f21f None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:39.897488 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728618f-a600-4beb-af0a-9c9391f2f21f None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:39.898226 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728618f-a600-4beb-af0a-9c9391f2f21f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:39.898533 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728618f-a600-4beb-af0a-9c9391f2f21f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:39.900006 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728618f-a600-4beb-af0a-9c9391f2f21f None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:39.924046 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 312/623] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:39.935226 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728618f-a600-4beb-af0a-9c9391f2f21f None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:39.938191 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed9bf0-7af3-416e-9369-ccd4b04ab92d None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:40.014437 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c8d2d-2fb4-4ef5-8e40-4ff3d7729f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:40.015445 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c8d2d-2fb4-4ef5-8e40-4ff3d7729f71 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:40.015821 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c8d2d-2fb4-4ef5-8e40-4ff3d7729f71 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:40.016302 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c8d2d-2fb4-4ef5-8e40-4ff3d7729f71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:40.037386 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:40.040750 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c8d2d-2fb4-4ef5-8e40-4ff3d7729f71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:40.044296 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c8d2d-2fb4-4ef5-8e40-4ff3d7729f71 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:40.088415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-8c4c8d2d-2fb4-4ef5-8e40-4ff3d7729f71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:40.088415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:40.088415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:40.088415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:40.088415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:40.088415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:40.088415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:40.088415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:40.088415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:40.088415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:40.088415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:40.088415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:40.088415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:35:40.088415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:35:40.088415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:35:40.090457 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:35:40.090457 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:40.090457 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:40.090457 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:40.090457 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:40.090457 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:40.090457 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:40.090457 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:40.090457 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:40.090457 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:40.090457 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:40.090457 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:40.090457 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:40.090457 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:40.090457 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:40.090457 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:40.090457 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:40.092358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:35:40.092358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:35:40.092358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:35:40.092358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:35:40.092358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:35:40.092358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:35:40.092358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:40.092358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:40.095822 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 312/624] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:35:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 448 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:40.105338 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c8d2d-2fb4-4ef5-8e40-4ff3d7729f71 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:40.284103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:40.288875 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728618f-a600-4beb-af0a-9c9391f2f21f None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:40.342180 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c09bb9-e0b6-4560-8259-94695fe5f631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:40.342925 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c09bb9-e0b6-4560-8259-94695fe5f631 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:40.343201 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c09bb9-e0b6-4560-8259-94695fe5f631 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:40.343470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c09bb9-e0b6-4560-8259-94695fe5f631 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:40.367638 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c09bb9-e0b6-4560-8259-94695fe5f631 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:40.373938 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c09bb9-e0b6-4560-8259-94695fe5f631 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:40.407003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-78c09bb9-e0b6-4560-8259-94695fe5f631 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:35:40.407003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:40.407003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:40.407003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:40.407003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:40.407003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:40.407003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:40.407003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:40.407003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:40.407003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:40.407003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:40.407003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:40.407003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:35:40.407003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:35:40.407003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:35:40.407003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:35:40.408931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:40.408931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:40.408931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:35:40.408931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:40.408931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:35:40.408931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:40.408931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:40.408931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:40.408931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:40.408931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:40.408931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:40.408931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:40.408931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:40.408931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:40.408931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:40.408931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:40.408931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:40.408931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:40.410644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:40.410644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:40.410644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:35:40.410644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:35:40.410644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:35:40.410644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:35:40.410644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:35:40.410644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:35:40.410644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:35:40.410644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:40.410644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 313/625] 10.222.0.94 () {56 vars in 1093 bytes} [Wed Aug 24 04:35:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 474 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:40.416760 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c09bb9-e0b6-4560-8259-94695fe5f631 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:40.449921 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c8d2d-2fb4-4ef5-8e40-4ff3d7729f71 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:40.521917 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5202ffb-d2e4-4930-a8d8-2977bd3f0a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:40.523853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5202ffb-d2e4-4930-a8d8-2977bd3f0a09 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:40.524502 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5202ffb-d2e4-4930-a8d8-2977bd3f0a09 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:40.524856 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5202ffb-d2e4-4930-a8d8-2977bd3f0a09 None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:40.526681 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5202ffb-d2e4-4930-a8d8-2977bd3f0a09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:40.527072 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5202ffb-d2e4-4930-a8d8-2977bd3f0a09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:40.530969 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5202ffb-d2e4-4930-a8d8-2977bd3f0a09 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:40.552795 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 313/626] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:35:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:35:40.555474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c667e-f880-4e32-bc6c-ac9358319250 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:40.556196 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c667e-f880-4e32-bc6c-ac9358319250 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:40.556681 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c667e-f880-4e32-bc6c-ac9358319250 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:40.559501 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 314/627] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:40.565674 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c667e-f880-4e32-bc6c-ac9358319250 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:40.577860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:40.602215 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c09bb9-e0b6-4560-8259-94695fe5f631 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:40.674196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9286c7-ffec-4fca-8a9b-399f842a6f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:40.675918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9286c7-ffec-4fca-8a9b-399f842a6f2c None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:40.676698 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9286c7-ffec-4fca-8a9b-399f842a6f2c None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:40.677521 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9286c7-ffec-4fca-8a9b-399f842a6f2c None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:40.679334 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9286c7-ffec-4fca-8a9b-399f842a6f2c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:40.680206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9286c7-ffec-4fca-8a9b-399f842a6f2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:40.683265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9286c7-ffec-4fca-8a9b-399f842a6f2c None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:40.720890 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 314/628] 10.222.0.94 () {56 vars in 1133 bytes} [Wed Aug 24 04:35:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:40.720890 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d14d83-1219-4a10-a6bc-7ed1cfa75156 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:40.722407 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d14d83-1219-4a10-a6bc-7ed1cfa75156 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:40.722920 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d14d83-1219-4a10-a6bc-7ed1cfa75156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:40.751491 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-13d14d83-1219-4a10-a6bc-7ed1cfa75156 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:40.752877 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-13d14d83-1219-4a10-a6bc-7ed1cfa75156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:40.770507 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c667e-f880-4e32-bc6c-ac9358319250 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:40.798862 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:40.844953 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490aa66-4233-48ca-a7b1-bade15386867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:40.846054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490aa66-4233-48ca-a7b1-bade15386867 None admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:40.846559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490aa66-4233-48ca-a7b1-bade15386867 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:40.847073 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490aa66-4233-48ca-a7b1-bade15386867 None admin] PATH_INFO: `/v3/projects/4416325d266642f3a786ff9f16c827aa/users/40d2202203204b06a41e57b9d1a300fc/roles/5e5c4aa158a845b981b0e847f8bd47a6` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:40.848319 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 315/629] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:40.849722 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763844ef-15e1-4edd-9f4c-3bf842eff4d4 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:40.850145 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763844ef-15e1-4edd-9f4c-3bf842eff4d4 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:40.850573 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763844ef-15e1-4edd-9f4c-3bf842eff4d4 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:40.852338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 316/630] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:40.858476 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763844ef-15e1-4edd-9f4c-3bf842eff4d4 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:40.895301 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490aa66-4233-48ca-a7b1-bade15386867 None admin] RBAC: Authorizing `identity:create_grant(project_id=4416325d266642f3a786ff9f16c827aa, user_id=40d2202203204b06a41e57b9d1a300fc, role_id=5e5c4aa158a845b981b0e847f8bd47a6)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:40.898402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490aa66-4233-48ca-a7b1-bade15386867 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:40.938593 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 315/631] 10.222.0.94 () {58 vars in 1439 bytes} [Wed Aug 24 04:35:40 2022] PUT /identity/v3/projects/4416325d266642f3a786ff9f16c827aa/users/40d2202203204b06a41e57b9d1a300fc/roles/5e5c4aa158a845b981b0e847f8bd47a6 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:35:40.938593 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72340edb-4288-45a9-8531-6a3677e30dca None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:40.938593 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72340edb-4288-45a9-8531-6a3677e30dca None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:40.938593 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72340edb-4288-45a9-8531-6a3677e30dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:40.986195 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-72340edb-4288-45a9-8531-6a3677e30dca None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:40.988595 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-72340edb-4288-45a9-8531-6a3677e30dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:41.094800 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:41.193462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763844ef-15e1-4edd-9f4c-3bf842eff4d4 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:41.202440 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 316/632] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:41.276294 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9eb8c1-5e47-4e33-abb5-46dbce334afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:41.277834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9eb8c1-5e47-4e33-abb5-46dbce334afe None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:41.278308 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9eb8c1-5e47-4e33-abb5-46dbce334afe None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:41.278792 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9eb8c1-5e47-4e33-abb5-46dbce334afe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:41.361271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9eb8c1-5e47-4e33-abb5-46dbce334afe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:41.362803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9eb8c1-5e47-4e33-abb5-46dbce334afe None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:41.422399 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72340edb-4288-45a9-8531-6a3677e30dca None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:41.456860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:41.487908 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 317/633] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:41.496914 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9eb8c1-5e47-4e33-abb5-46dbce334afe None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:41.693235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9eb8c1-5e47-4e33-abb5-46dbce334afe None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:41.701938 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:41.723101 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72340edb-4288-45a9-8531-6a3677e30dca None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:41.798083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec93af-0ad4-4002-a8a6-90f311cbb677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:41.799833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec93af-0ad4-4002-a8a6-90f311cbb677 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:41.800241 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec93af-0ad4-4002-a8a6-90f311cbb677 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:41.800595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec93af-0ad4-4002-a8a6-90f311cbb677 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:41.818594 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec93af-0ad4-4002-a8a6-90f311cbb677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:41.820649 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec93af-0ad4-4002-a8a6-90f311cbb677 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:41.825504 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf6f6c-f3db-437c-a2c4-4674ff1f1028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:41.827179 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf6f6c-f3db-437c-a2c4-4674ff1f1028 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:41.827954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf6f6c-f3db-437c-a2c4-4674ff1f1028 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:41.828667 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf6f6c-f3db-437c-a2c4-4674ff1f1028 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:41.841108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-29ec93af-0ad4-4002-a8a6-90f311cbb677 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:41.841108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:41.841108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:41.841108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:41.841108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:41.841108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:41.841108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:41.841108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:41.841108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:41.841108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:41.841108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:41.841108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:41.841108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:41.841108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:41.841108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:41.841108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:41.842965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:41.842965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:41.842965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:41.842965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:41.842965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:41.842965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:41.842965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:41.842965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:41.842965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:41.842965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:41.842965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:41.842965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:41.842965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:41.842965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:41.842965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:41.842965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:41.842965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:41.845597 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:41.845597 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:41.845597 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:41.845597 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 318/634] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:41.845597 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec93af-0ad4-4002-a8a6-90f311cbb677 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:41.857287 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf6f6c-f3db-437c-a2c4-4674ff1f1028 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:41.867932 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-bedf6f6c-f3db-437c-a2c4-4674ff1f1028 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:41.867932 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:41.867932 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:41.867932 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:41.867932 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:41.867932 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:41.867932 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:41.867932 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:41.867932 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:41.867932 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:41.867932 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:41.867932 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:41.867932 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:41.867932 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:41.867932 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:41.867932 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:41.869782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:41.869782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:41.869782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:41.869782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:41.869782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:41.869782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:41.869782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:41.869782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:41.869782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:41.869782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:41.869782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:41.869782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:41.869782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:41.869782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:41.869782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:41.869782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:41.871462 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:41.871462 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:41.871462 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:41.871462 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:41.871462 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:41.871462 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:41.871462 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:41.871462 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:41.871462 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:41.871462 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:41.871462 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:41.871462 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:41.876112 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 317/635] 10.222.0.94 () {56 vars in 1102 bytes} [Wed Aug 24 04:35:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 455 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:35:41.878220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf6f6c-f3db-437c-a2c4-4674ff1f1028 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:41.886386 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:42.028385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec93af-0ad4-4002-a8a6-90f311cbb677 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:42.060403 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf6f6c-f3db-437c-a2c4-4674ff1f1028 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:42.095976 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334f237-5e29-4f33-b720-1d6c1eeffb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:42.098352 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334f237-5e29-4f33-b720-1d6c1eeffb76 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:42.099201 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334f237-5e29-4f33-b720-1d6c1eeffb76 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:42.099950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334f237-5e29-4f33-b720-1d6c1eeffb76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:42.120426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334f237-5e29-4f33-b720-1d6c1eeffb76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:42.123514 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f73048-a88b-4449-8a9a-4be0ba2fccf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:42.124583 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f73048-a88b-4449-8a9a-4be0ba2fccf0 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:42.125095 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f73048-a88b-4449-8a9a-4be0ba2fccf0 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:42.125638 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f73048-a88b-4449-8a9a-4be0ba2fccf0 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:42.126963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f73048-a88b-4449-8a9a-4be0ba2fccf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:42.127535 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f73048-a88b-4449-8a9a-4be0ba2fccf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:42.130231 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f73048-a88b-4449-8a9a-4be0ba2fccf0 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:42.132588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-2334f237-5e29-4f33-b720-1d6c1eeffb76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:42.132588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:42.132588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:42.132588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:42.132588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:42.132588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:42.132588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:42.132588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:42.132588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:42.132588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:42.132588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:42.132588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:42.132588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:42.132588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:42.132588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:42.132588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:42.133695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:42.133695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:42.133695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:42.133695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:42.133695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:42.133695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:42.133695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:42.133695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:42.133695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:42.133695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:42.133695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:42.133695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:42.133695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:42.133695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:42.133695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:42.133695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:42.134558 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:42.134558 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:42.134558 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:42.134558 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:42.134558 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:42.134558 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:42.134558 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:42.134558 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:42.134558 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:42.134558 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:42.134558 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:42.134558 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:42.137745 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 319/636] 10.222.0.94 () {56 vars in 1102 bytes} [Wed Aug 24 04:35:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:42.138981 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334f237-5e29-4f33-b720-1d6c1eeffb76 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:42.146229 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 318/637] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:42.147748 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f9a17-8b80-44c0-af12-3620557d0a3a None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:42.148045 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f9a17-8b80-44c0-af12-3620557d0a3a None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:42.148323 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f9a17-8b80-44c0-af12-3620557d0a3a None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:42.153573 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 319/638] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:42.153573 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f9a17-8b80-44c0-af12-3620557d0a3a None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:42.172292 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:42.268322 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:42.291513 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334f237-5e29-4f33-b720-1d6c1eeffb76 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:42.315880 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f9a17-8b80-44c0-af12-3620557d0a3a None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:42.339145 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376121fe-95b5-418e-9478-bb4affb19217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:42.340545 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376121fe-95b5-418e-9478-bb4affb19217 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:42.340949 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376121fe-95b5-418e-9478-bb4affb19217 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:42.341358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376121fe-95b5-418e-9478-bb4affb19217 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:42.342424 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376121fe-95b5-418e-9478-bb4affb19217 None admin] RBAC: Adding query filter params (name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:42.342903 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376121fe-95b5-418e-9478-bb4affb19217 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:42.344584 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376121fe-95b5-418e-9478-bb4affb19217 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:42.355362 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 320/639] 10.222.0.94 () {56 vars in 1103 bytes} [Wed Aug 24 04:35:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:42.357222 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376121fe-95b5-418e-9478-bb4affb19217 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:42.369808 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04546b00-f380-44d2-a39e-30f2906ce921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:42.370438 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04546b00-f380-44d2-a39e-30f2906ce921 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:42.370874 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04546b00-f380-44d2-a39e-30f2906ce921 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:42.371877 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04546b00-f380-44d2-a39e-30f2906ce921 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:42.372999 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04546b00-f380-44d2-a39e-30f2906ce921 None admin] RBAC: Adding query filter params (name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:42.373313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04546b00-f380-44d2-a39e-30f2906ce921 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:42.375071 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04546b00-f380-44d2-a39e-30f2906ce921 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:42.386378 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 320/640] 10.222.0.94 () {56 vars in 1103 bytes} [Wed Aug 24 04:35:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:42.388682 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fb600-eb8e-401f-b285-2939b8c88fd4 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:42.388974 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fb600-eb8e-401f-b285-2939b8c88fd4 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:42.389250 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fb600-eb8e-401f-b285-2939b8c88fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:42.414044 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-547fb600-eb8e-401f-b285-2939b8c88fd4 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:42.415944 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-547fb600-eb8e-401f-b285-2939b8c88fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:42.516957 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376121fe-95b5-418e-9478-bb4affb19217 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:42.523868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 321/641] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:42.528476 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fb600-eb8e-401f-b285-2939b8c88fd4 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:42.537070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:42.571361 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2105c9-69c4-4a3a-93b8-1aaa6b7c5e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:42.571965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2105c9-69c4-4a3a-93b8-1aaa6b7c5e5d None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:42.572289 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2105c9-69c4-4a3a-93b8-1aaa6b7c5e5d None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:42.572781 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2105c9-69c4-4a3a-93b8-1aaa6b7c5e5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:42.583292 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2105c9-69c4-4a3a-93b8-1aaa6b7c5e5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:42.585010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2105c9-69c4-4a3a-93b8-1aaa6b7c5e5d None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:42.600980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-db2105c9-69c4-4a3a-93b8-1aaa6b7c5e5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:42.600980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:42.600980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:42.600980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:42.600980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:42.600980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:42.600980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:42.600980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:42.600980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:42.600980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:42.600980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:42.600980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:42.600980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:35:42.600980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:35:42.600980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:35:42.602022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:35:42.602022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:42.602022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:42.602022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:42.602022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:42.602022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:42.602022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:42.602022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:42.602022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:42.602022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:42.602022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:42.602022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:42.602022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:42.602022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:42.602022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:42.602022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:42.602022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:42.602979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:35:42.602979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:35:42.602979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:35:42.602979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:35:42.602979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:35:42.602979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:35:42.602979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:42.602979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:42.607448 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 321/642] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:35:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:42.609118 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2105c9-69c4-4a3a-93b8-1aaa6b7c5e5d None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:42.631091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:42.700194 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fb600-eb8e-401f-b285-2939b8c88fd4 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:42.743115 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218edd1-0670-4d52-9ec8-74921a7b9ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:42.744387 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218edd1-0670-4d52-9ec8-74921a7b9ef3 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:42.744915 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218edd1-0670-4d52-9ec8-74921a7b9ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:42.745586 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218edd1-0670-4d52-9ec8-74921a7b9ef3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:42.759466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b218edd1-0670-4d52-9ec8-74921a7b9ef3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:42.761309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b218edd1-0670-4d52-9ec8-74921a7b9ef3 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:42.786611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-b218edd1-0670-4d52-9ec8-74921a7b9ef3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:42.786611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:42.786611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:42.786611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:42.786611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:42.786611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:42.786611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:42.786611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:42.786611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:42.786611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:42.786611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:42.786611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:42.786611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:42.786611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:42.786611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:42.786611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:42.788600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:42.788600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:42.788600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:42.788600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:42.788600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:42.788600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:42.788600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:42.788600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:42.788600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:42.788600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:42.788600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:42.788600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:42.788600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:42.788600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:42.788600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:42.788600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:42.788600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:42.790478 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:42.790478 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:42.790478 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:42.795198 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 322/643] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:42.797632 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218edd1-0670-4d52-9ec8-74921a7b9ef3 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:42.810096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2105c9-69c4-4a3a-93b8-1aaa6b7c5e5d None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:42.851717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654e28c-b7b4-4917-a0ef-613de210c4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:42.852181 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654e28c-b7b4-4917-a0ef-613de210c4c3 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:42.852462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654e28c-b7b4-4917-a0ef-613de210c4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:42.852740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654e28c-b7b4-4917-a0ef-613de210c4c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:42.867113 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654e28c-b7b4-4917-a0ef-613de210c4c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:42.868610 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654e28c-b7b4-4917-a0ef-613de210c4c3 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:42.875673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:42.888048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-f654e28c-b7b4-4917-a0ef-613de210c4c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:42.888048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:42.888048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:42.888048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:42.888048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:42.888048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:42.888048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:42.888048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:42.888048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:42.888048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:42.888048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:42.888048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:42.888048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:42.888048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:42.888048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:42.888048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:42.890960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:42.890960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:42.890960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:42.890960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:42.890960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:42.890960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:42.890960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:42.890960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:42.890960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:42.890960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:42.890960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:42.890960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:42.890960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:42.890960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:42.890960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:42.890960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:42.890960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:42.892695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:42.892695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:42.892695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:42.892695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 322/644] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:42.892695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654e28c-b7b4-4917-a0ef-613de210c4c3 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:42.982067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218edd1-0670-4d52-9ec8-74921a7b9ef3 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:42.997287 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:43.046938 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84685212-e0e7-4f82-a6dd-ce80499249f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:43.047548 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84685212-e0e7-4f82-a6dd-ce80499249f5 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:43.047834 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84685212-e0e7-4f82-a6dd-ce80499249f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:43.048106 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84685212-e0e7-4f82-a6dd-ce80499249f5 None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:43.048831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84685212-e0e7-4f82-a6dd-ce80499249f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:43.049139 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84685212-e0e7-4f82-a6dd-ce80499249f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:43.050653 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84685212-e0e7-4f82-a6dd-ce80499249f5 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:43.060965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654e28c-b7b4-4917-a0ef-613de210c4c3 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:43.066993 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 323/645] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:35:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:43.069590 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84685212-e0e7-4f82-a6dd-ce80499249f5 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:43.119423 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9f9ed-a7be-4a6e-8df6-c2a56589739a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:43.120222 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9f9ed-a7be-4a6e-8df6-c2a56589739a None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:43.120360 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9f9ed-a7be-4a6e-8df6-c2a56589739a None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:43.120705 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9f9ed-a7be-4a6e-8df6-c2a56589739a None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:43.121986 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9f9ed-a7be-4a6e-8df6-c2a56589739a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:43.122449 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9f9ed-a7be-4a6e-8df6-c2a56589739a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:43.124127 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9f9ed-a7be-4a6e-8df6-c2a56589739a None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:43.151063 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 323/646] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:43.152025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9f9ed-a7be-4a6e-8df6-c2a56589739a None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:43.282598 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84685212-e0e7-4f82-a6dd-ce80499249f5 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:43.315089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:43.359399 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cc7ee-db74-4206-b2a3-833b77ba0732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:43.360369 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9f9ed-a7be-4a6e-8df6-c2a56589739a None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:43.360512 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cc7ee-db74-4206-b2a3-833b77ba0732 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:43.360646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cc7ee-db74-4206-b2a3-833b77ba0732 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:43.360819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cc7ee-db74-4206-b2a3-833b77ba0732 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:43.381281 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cc7ee-db74-4206-b2a3-833b77ba0732 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:43.387859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-374cc7ee-db74-4206-b2a3-833b77ba0732 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:43.387859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:43.387859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:43.387859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:43.387859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:43.387859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:43.387859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:43.387859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:43.387859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:43.387859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:43.387859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:43.387859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:43.387859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:43.387859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:43.387859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:43.387859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:43.394155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:43.394155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:43.394155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:43.394155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:43.394155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:43.394155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:43.394155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:43.394155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:43.394155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:43.394155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:43.394155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:43.394155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:43.394155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:43.394155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:43.394155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:43.394155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:43.395749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:43.395749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:43.395749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:43.395749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:43.395749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:43.395749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:43.395749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:43.395749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:43.395749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:43.395749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:43.395749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:43.395749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:43.395749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 324/647] 10.222.0.94 () {56 vars in 1102 bytes} [Wed Aug 24 04:35:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:43.395749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cc7ee-db74-4206-b2a3-833b77ba0732 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:43.398808 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:43.415159 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab0a82-f3c6-4fee-88f2-155eefad8430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:43.415802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab0a82-f3c6-4fee-88f2-155eefad8430 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:43.416071 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab0a82-f3c6-4fee-88f2-155eefad8430 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:43.416354 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab0a82-f3c6-4fee-88f2-155eefad8430 None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:43.417035 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab0a82-f3c6-4fee-88f2-155eefad8430 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:43.417343 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab0a82-f3c6-4fee-88f2-155eefad8430 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:43.419961 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab0a82-f3c6-4fee-88f2-155eefad8430 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:43.432989 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 324/648] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:43.434740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab0a82-f3c6-4fee-88f2-155eefad8430 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:43.592221 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cc7ee-db74-4206-b2a3-833b77ba0732 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:43.619952 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab0a82-f3c6-4fee-88f2-155eefad8430 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:43.648835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b1d6b-9e96-4bb9-abe9-839555aea277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:43.649375 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b1d6b-9e96-4bb9-abe9-839555aea277 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:43.649698 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b1d6b-9e96-4bb9-abe9-839555aea277 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:43.649954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b1d6b-9e96-4bb9-abe9-839555aea277 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:43.650691 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b1d6b-9e96-4bb9-abe9-839555aea277 None admin] RBAC: Adding query filter params (role.id=5e5c4aa158a845b981b0e847f8bd47a6, scope.project.id=4416325d266642f3a786ff9f16c827aa, user.id=5bdbda2b9c8f48338c5117585a229cb6) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:43.651004 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b1d6b-9e96-4bb9-abe9-839555aea277 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:43.652949 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b1d6b-9e96-4bb9-abe9-839555aea277 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:43.669463 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 325/649] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:35:43 2022] GET /identity/v3/role_assignments?user.id=5bdbda2b9c8f48338c5117585a229cb6&scope.project.id=4416325d266642f3a786ff9f16c827aa&role.id=5e5c4aa158a845b981b0e847f8bd47a6 => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:43.669463 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b1d6b-9e96-4bb9-abe9-839555aea277 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:43.708353 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7df2bb-d074-4c1b-8de9-4ad1075648cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:43.709913 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7df2bb-d074-4c1b-8de9-4ad1075648cd None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:43.710556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7df2bb-d074-4c1b-8de9-4ad1075648cd None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:43.711153 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7df2bb-d074-4c1b-8de9-4ad1075648cd None admin] PATH_INFO: `/v3/users/glance` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:43.736736 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:43.737285 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7df2bb-d074-4c1b-8de9-4ad1075648cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:43.738894 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7df2bb-d074-4c1b-8de9-4ad1075648cd None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:43.766235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-4d7df2bb-d074-4c1b-8de9-4ad1075648cd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:35:43.766235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:43.766235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:43.766235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:43.766235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:43.766235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:43.766235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:43.766235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:43.766235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:43.766235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:43.766235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:43.766235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:43.766235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:35:43.766235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:35:43.766235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:35:43.766235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:35:43.768083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:43.768083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:43.768083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:35:43.768083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:43.768083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:35:43.768083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:43.768083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:43.768083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:43.768083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:43.768083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:43.768083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:43.768083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:43.768083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:43.768083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:43.768083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:43.768083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:43.768083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:43.768083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:43.770567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:43.770567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:43.770567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:35:43.770567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:35:43.770567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:35:43.770567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:35:43.770567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:35:43.770567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:35:43.770567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:35:43.770567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:43.770567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 325/650] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:43.770567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7df2bb-d074-4c1b-8de9-4ad1075648cd None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:43.830057 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:43.881629 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b1d6b-9e96-4bb9-abe9-839555aea277 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:43.932311 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7df2bb-d074-4c1b-8de9-4ad1075648cd None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:43.958782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879ab21-a386-454e-a322-fc2bb89ea56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:43.959414 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879ab21-a386-454e-a322-fc2bb89ea56c None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:43.959692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879ab21-a386-454e-a322-fc2bb89ea56c None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:43.960050 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879ab21-a386-454e-a322-fc2bb89ea56c None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:43.961249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879ab21-a386-454e-a322-fc2bb89ea56c None admin] RBAC: Adding query filter params (name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:43.961616 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879ab21-a386-454e-a322-fc2bb89ea56c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:43.963246 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879ab21-a386-454e-a322-fc2bb89ea56c None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:43.974020 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 326/651] 10.222.0.94 () {56 vars in 1103 bytes} [Wed Aug 24 04:35:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:43.974966 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879ab21-a386-454e-a322-fc2bb89ea56c None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:43.991940 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad86103-85b0-4131-8e97-c4290351ba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:43.993012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad86103-85b0-4131-8e97-c4290351ba66 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:43.993302 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad86103-85b0-4131-8e97-c4290351ba66 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:43.993617 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad86103-85b0-4131-8e97-c4290351ba66 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:44.005849 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad86103-85b0-4131-8e97-c4290351ba66 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:44.007402 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad86103-85b0-4131-8e97-c4290351ba66 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:44.025820 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-7ad86103-85b0-4131-8e97-c4290351ba66 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:35:44.025820 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:44.025820 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:44.025820 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:44.025820 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:44.025820 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:44.025820 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:44.025820 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:44.025820 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:44.025820 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:44.025820 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:44.025820 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:44.025820 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:35:44.025820 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:35:44.025820 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:35:44.025820 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:35:44.026833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:44.026833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:44.026833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:35:44.026833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:44.026833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:35:44.026833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:44.026833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:44.026833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:44.026833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:44.026833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:44.026833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:44.026833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:44.026833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:44.026833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:44.026833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:44.026833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:44.026833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:44.026833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:44.028364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:44.028364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:44.028364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:35:44.028364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:35:44.028364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:35:44.028364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:35:44.028364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:35:44.028364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:35:44.028364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:35:44.028364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:44.028364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 326/652] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:44.029489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63453f-2272-476b-b06a-3fc7b8e96ca6 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:44.029605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63453f-2272-476b-b06a-3fc7b8e96ca6 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:44.030404 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63453f-2272-476b-b06a-3fc7b8e96ca6 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:44.031511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 327/653] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:44.032301 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63453f-2272-476b-b06a-3fc7b8e96ca6 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:44.151248 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879ab21-a386-454e-a322-fc2bb89ea56c None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:44.153914 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:44.193724 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63453f-2272-476b-b06a-3fc7b8e96ca6 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:44.196330 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:44.204017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062f0f1-29ac-4ac3-88be-44fbdf61e128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:44.205051 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062f0f1-29ac-4ac3-88be-44fbdf61e128 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:44.205597 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062f0f1-29ac-4ac3-88be-44fbdf61e128 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:44.206522 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062f0f1-29ac-4ac3-88be-44fbdf61e128 None admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:44.207472 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062f0f1-29ac-4ac3-88be-44fbdf61e128 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:44.208012 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062f0f1-29ac-4ac3-88be-44fbdf61e128 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:44.210850 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062f0f1-29ac-4ac3-88be-44fbdf61e128 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:44.238689 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 327/654] 10.222.0.94 () {56 vars in 1137 bytes} [Wed Aug 24 04:35:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:44.243885 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062f0f1-29ac-4ac3-88be-44fbdf61e128 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:44.245719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e76dc-5df0-46ce-864d-d06daa590278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:44.247073 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e76dc-5df0-46ce-864d-d06daa590278 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:44.247331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e76dc-5df0-46ce-864d-d06daa590278 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:44.247698 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e76dc-5df0-46ce-864d-d06daa590278 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:44.259639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e76dc-5df0-46ce-864d-d06daa590278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:44.261129 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e76dc-5df0-46ce-864d-d06daa590278 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:44.279177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-521e76dc-5df0-46ce-864d-d06daa590278 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:44.279177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:44.279177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:44.279177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:44.279177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:44.279177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:44.279177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:44.279177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:44.279177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:44.279177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:44.279177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:44.279177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:44.279177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:44.279177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:44.279177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:44.279177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:44.280379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:44.280379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:44.280379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:44.280379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:44.280379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:44.280379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:44.280379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:44.280379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:44.280379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:44.280379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:44.280379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:44.280379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:44.280379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:44.280379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:44.280379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:44.280379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:44.280379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:44.281480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:44.281480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:44.281480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:44.285621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 328/655] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:44.287030 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d3426-f175-4c22-9fb1-9de3e1453d7e None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:44.287720 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d3426-f175-4c22-9fb1-9de3e1453d7e None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:44.287720 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d3426-f175-4c22-9fb1-9de3e1453d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:44.310040 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-108d3426-f175-4c22-9fb1-9de3e1453d7e None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:44.311272 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-108d3426-f175-4c22-9fb1-9de3e1453d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:44.389397 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062f0f1-29ac-4ac3-88be-44fbdf61e128 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:44.429438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 329/656] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:44.429438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d3426-f175-4c22-9fb1-9de3e1453d7e None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:44.446618 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fc65b-aa4f-473a-850f-ea3e09a4d0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:44.447128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fc65b-aa4f-473a-850f-ea3e09a4d0e1 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:44.447476 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fc65b-aa4f-473a-850f-ea3e09a4d0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:44.447770 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fc65b-aa4f-473a-850f-ea3e09a4d0e1 None admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:44.449908 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6fc65b-aa4f-473a-850f-ea3e09a4d0e1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:44.450234 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6fc65b-aa4f-473a-850f-ea3e09a4d0e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:44.451827 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6fc65b-aa4f-473a-850f-ea3e09a4d0e1 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:44.484737 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 328/657] 10.222.0.94 () {56 vars in 1137 bytes} [Wed Aug 24 04:35:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:44.484737 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fc65b-aa4f-473a-850f-ea3e09a4d0e1 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:44.509599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:44.589104 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:44.614949 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d3426-f175-4c22-9fb1-9de3e1453d7e None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:44.670373 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fc65b-aa4f-473a-850f-ea3e09a4d0e1 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:44.692862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ca4ef-a9ee-4c7a-b87c-6668777843ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:44.694420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ca4ef-a9ee-4c7a-b87c-6668777843ef None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:44.695131 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ca4ef-a9ee-4c7a-b87c-6668777843ef None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:44.695881 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ca4ef-a9ee-4c7a-b87c-6668777843ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:44.751199 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bcbf2-6e54-4a3e-81d7-819aacee2aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:44.752544 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bcbf2-6e54-4a3e-81d7-819aacee2aab None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:44.753750 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bcbf2-6e54-4a3e-81d7-819aacee2aab None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:44.754251 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bcbf2-6e54-4a3e-81d7-819aacee2aab None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:44.755881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bcbf2-6e54-4a3e-81d7-819aacee2aab None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:44.756435 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bcbf2-6e54-4a3e-81d7-819aacee2aab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:44.760441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bcbf2-6e54-4a3e-81d7-819aacee2aab None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:44.789879 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 329/658] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:44.791292 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bcbf2-6e54-4a3e-81d7-819aacee2aab None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:44.833565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ca4ef-a9ee-4c7a-b87c-6668777843ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:44.835614 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ca4ef-a9ee-4c7a-b87c-6668777843ef None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:44.959826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:45.002279 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:45.002711 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bcbf2-6e54-4a3e-81d7-819aacee2aab None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:45.039890 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 330/659] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:45.041861 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ca4ef-a9ee-4c7a-b87c-6668777843ef None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:45.071709 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a67ba-df48-4c69-ae3e-6d77f7f60b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:45.072778 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a67ba-df48-4c69-ae3e-6d77f7f60b95 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:45.073293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a67ba-df48-4c69-ae3e-6d77f7f60b95 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:45.074914 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a67ba-df48-4c69-ae3e-6d77f7f60b95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:45.201577 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a67ba-df48-4c69-ae3e-6d77f7f60b95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:45.203139 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a67ba-df48-4c69-ae3e-6d77f7f60b95 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:45.217853 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ca4ef-a9ee-4c7a-b87c-6668777843ef None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:45.291995 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fec09-8a7b-498a-9137-e523e67025fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:45.294373 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fec09-8a7b-498a-9137-e523e67025fa None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:45.294878 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fec09-8a7b-498a-9137-e523e67025fa None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:45.295366 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fec09-8a7b-498a-9137-e523e67025fa None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:45.311634 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fec09-8a7b-498a-9137-e523e67025fa None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:45.314795 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fec09-8a7b-498a-9137-e523e67025fa None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:45.338815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-693fec09-8a7b-498a-9137-e523e67025fa None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:35:45.338815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:45.338815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:45.338815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:45.338815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:45.338815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:45.338815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:45.338815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:45.338815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:45.338815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:45.338815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:45.338815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:45.338815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:35:45.338815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:35:45.338815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:35:45.338815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:35:45.341296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:45.341296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:45.341296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:35:45.341296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:45.341296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:35:45.341296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:45.341296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:45.341296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:45.341296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:45.341296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:45.341296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:45.341296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:45.341296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:45.341296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:45.341296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:45.341296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:45.341296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:45.341296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:45.343673 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:45.343673 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:45.343673 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:35:45.343673 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:35:45.343673 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:35:45.343673 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:35:45.343673 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:35:45.343673 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:35:45.343673 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:35:45.343673 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:45.348265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 331/660] 10.222.0.94 () {56 vars in 1102 bytes} [Wed Aug 24 04:35:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:45.348265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fec09-8a7b-498a-9137-e523e67025fa None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:45.357125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:45.414608 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 330/661] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:45.416400 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a67ba-df48-4c69-ae3e-6d77f7f60b95 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:45.444689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:45.535122 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fec09-8a7b-498a-9137-e523e67025fa None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:45.593341 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aba279-f0b9-40a3-84e8-049f9e3363e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:45.594297 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aba279-f0b9-40a3-84e8-049f9e3363e3 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:45.594749 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aba279-f0b9-40a3-84e8-049f9e3363e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:45.595200 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aba279-f0b9-40a3-84e8-049f9e3363e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:45.614246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aba279-f0b9-40a3-84e8-049f9e3363e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:45.625323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-95aba279-f0b9-40a3-84e8-049f9e3363e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:45.625323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:45.625323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:45.625323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:45.625323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:45.625323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:45.625323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:45.625323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:45.625323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:45.625323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:45.625323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:45.625323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:45.625323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:45.625323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:45.625323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:45.625323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:45.626678 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:45.626678 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:45.626678 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:45.626678 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:45.626678 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:45.626678 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:45.626678 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:45.626678 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:45.626678 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:45.626678 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:45.626678 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:45.626678 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:45.626678 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:45.626678 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:45.626678 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:45.626678 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:45.627714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:45.627714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:45.627714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:45.627714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:45.627714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:45.627714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:45.627714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:45.627714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:45.627714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:45.627714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:45.627714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:35:45.627714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:45.627714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 332/662] 10.222.0.94 () {56 vars in 1102 bytes} [Wed Aug 24 04:35:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:45.628531 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aba279-f0b9-40a3-84e8-049f9e3363e3 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:45.634184 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a67ba-df48-4c69-ae3e-6d77f7f60b95 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:45.680101 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb78bd-7a57-4fac-bf58-aac281653930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:45.681778 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb78bd-7a57-4fac-bf58-aac281653930 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:45.682437 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb78bd-7a57-4fac-bf58-aac281653930 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:45.682804 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb78bd-7a57-4fac-bf58-aac281653930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:45.698452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb78bd-7a57-4fac-bf58-aac281653930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:45.700588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb78bd-7a57-4fac-bf58-aac281653930 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:45.728868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-2eeb78bd-7a57-4fac-bf58-aac281653930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:45.728868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:45.728868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:45.728868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:45.728868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:45.728868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:45.728868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:45.728868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:45.728868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:45.728868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:45.728868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:45.728868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:45.728868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:45.728868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:45.728868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:45.728868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:45.731418 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:45.731418 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:45.731418 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:45.731418 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:45.731418 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:45.731418 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:45.731418 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:45.731418 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:45.731418 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:45.731418 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:45.731418 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:45.731418 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:45.731418 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:45.731418 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:45.731418 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:45.731418 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:45.731418 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:45.732393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:45.732393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:45.732393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:45.733197 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 331/663] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:45.734166 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb78bd-7a57-4fac-bf58-aac281653930 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:45.776397 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:45.799196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aba279-f0b9-40a3-84e8-049f9e3363e3 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:45.803589 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:45.868253 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11edd5-84b4-4af2-b0d9-2bb96101fe04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:45.869188 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11edd5-84b4-4af2-b0d9-2bb96101fe04 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:45.869718 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11edd5-84b4-4af2-b0d9-2bb96101fe04 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:45.870208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11edd5-84b4-4af2-b0d9-2bb96101fe04 None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:45.872795 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11edd5-84b4-4af2-b0d9-2bb96101fe04 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:45.873263 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11edd5-84b4-4af2-b0d9-2bb96101fe04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:45.875989 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11edd5-84b4-4af2-b0d9-2bb96101fe04 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:45.905171 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb78bd-7a57-4fac-bf58-aac281653930 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:45.925446 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 333/664] 10.222.0.94 () {56 vars in 1139 bytes} [Wed Aug 24 04:35:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:45.925446 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11edd5-84b4-4af2-b0d9-2bb96101fe04 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:45.984398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bb62b-d684-4dd3-8a81-803e36ab1e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:45.985669 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb62b-d684-4dd3-8a81-803e36ab1e76 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:45.986171 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb62b-d684-4dd3-8a81-803e36ab1e76 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:45.987820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb62b-d684-4dd3-8a81-803e36ab1e76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:46.006036 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bb62b-d684-4dd3-8a81-803e36ab1e76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:46.007524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bb62b-d684-4dd3-8a81-803e36ab1e76 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:46.030249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-b90bb62b-d684-4dd3-8a81-803e36ab1e76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:46.030249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:46.030249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:46.030249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:46.030249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:46.030249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:46.030249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:46.030249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:46.030249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:46.030249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:46.030249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:46.030249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:46.030249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:46.030249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:46.030249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:46.030249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:46.031832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:46.031832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:46.031832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:46.031832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:46.031832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:46.031832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:46.031832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:46.031832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:46.031832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:46.031832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:46.031832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:46.031832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:46.031832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:46.031832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:46.031832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:46.031832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:46.031832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:46.033067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:46.033067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:46.033067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:46.033067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 332/665] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:46.033067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bb62b-d684-4dd3-8a81-803e36ab1e76 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:46.124216 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11edd5-84b4-4af2-b0d9-2bb96101fe04 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:46.190450 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8389172-c68b-4453-994b-c2392e1fce86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:46.191523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8389172-c68b-4453-994b-c2392e1fce86 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:46.192031 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8389172-c68b-4453-994b-c2392e1fce86 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:46.192521 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8389172-c68b-4453-994b-c2392e1fce86 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:46.193884 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8389172-c68b-4453-994b-c2392e1fce86 None admin] RBAC: Adding query filter params (name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:46.194452 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8389172-c68b-4453-994b-c2392e1fce86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:46.195816 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:46.198127 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8389172-c68b-4453-994b-c2392e1fce86 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:46.223667 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 334/666] 10.222.0.94 () {56 vars in 1103 bytes} [Wed Aug 24 04:35:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:46.223667 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8389172-c68b-4453-994b-c2392e1fce86 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:46.224804 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bb62b-d684-4dd3-8a81-803e36ab1e76 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:46.287872 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bb96d-255d-4e42-a652-9dadd03b3532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:46.288818 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bb96d-255d-4e42-a652-9dadd03b3532 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:46.289311 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bb96d-255d-4e42-a652-9dadd03b3532 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:46.289791 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bb96d-255d-4e42-a652-9dadd03b3532 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:46.291001 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502bb96d-255d-4e42-a652-9dadd03b3532 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:46.291562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502bb96d-255d-4e42-a652-9dadd03b3532 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:46.294746 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502bb96d-255d-4e42-a652-9dadd03b3532 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:46.297004 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:46.328548 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 333/667] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:46.329267 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bb96d-255d-4e42-a652-9dadd03b3532 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:46.446006 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8389172-c68b-4453-994b-c2392e1fce86 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:46.508392 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cd147-a9b1-4b9b-a7be-bf1b9e2e891e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:46.509464 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cd147-a9b1-4b9b-a7be-bf1b9e2e891e None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:46.509961 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cd147-a9b1-4b9b-a7be-bf1b9e2e891e None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:46.510459 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cd147-a9b1-4b9b-a7be-bf1b9e2e891e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:46.517766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bb96d-255d-4e42-a652-9dadd03b3532 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:46.572948 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173e9aa-4738-478e-a73e-494a0ba9bf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:46.574473 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173e9aa-4738-478e-a73e-494a0ba9bf02 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:46.575155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173e9aa-4738-478e-a73e-494a0ba9bf02 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:46.575607 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173e9aa-4738-478e-a73e-494a0ba9bf02 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:46.576645 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173e9aa-4738-478e-a73e-494a0ba9bf02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:46.577140 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173e9aa-4738-478e-a73e-494a0ba9bf02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:46.578911 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173e9aa-4738-478e-a73e-494a0ba9bf02 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:46.599400 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 334/668] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:46.600622 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173e9aa-4738-478e-a73e-494a0ba9bf02 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:46.603713 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:46.634960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cd147-a9b1-4b9b-a7be-bf1b9e2e891e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:46.637452 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cd147-a9b1-4b9b-a7be-bf1b9e2e891e None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:46.679343 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:46.743922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173e9aa-4738-478e-a73e-494a0ba9bf02 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:46.780951 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada0ce0-00fb-4133-a17f-1ebc504ab193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:46.781621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada0ce0-00fb-4133-a17f-1ebc504ab193 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:46.781901 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada0ce0-00fb-4133-a17f-1ebc504ab193 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:46.782174 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada0ce0-00fb-4133-a17f-1ebc504ab193 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:46.794957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada0ce0-00fb-4133-a17f-1ebc504ab193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:46.796542 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada0ce0-00fb-4133-a17f-1ebc504ab193 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:46.813621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 335/669] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:46.813841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-eada0ce0-00fb-4133-a17f-1ebc504ab193 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:46.813841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:46.813841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:46.813841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:46.813841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:46.813841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:46.813841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:46.813841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:46.813841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:46.813841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:46.813841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:46.813841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:46.813841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:46.813841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:46.813841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:46.813841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:46.815679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:46.815679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:46.815679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:46.815679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:46.815679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:46.815679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:46.815679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:46.815679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:46.815679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:46.815679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:46.815679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:46.815679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:46.815679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:46.815679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:46.815679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:46.815679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:46.815679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:46.817592 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:46.817592 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:46.817592 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:46.818388 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cd147-a9b1-4b9b-a7be-bf1b9e2e891e None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:46.818548 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 335/670] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:46.818548 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d468f-5385-4429-8116-ede344deedca None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:46.818548 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d468f-5385-4429-8116-ede344deedca None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:46.818548 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d468f-5385-4429-8116-ede344deedca None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:46.821296 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 336/671] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:46.821489 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d468f-5385-4429-8116-ede344deedca None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:46.912602 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:46.963152 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cd147-a9b1-4b9b-a7be-bf1b9e2e891e None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:46.974373 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d468f-5385-4429-8116-ede344deedca None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:46.993578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:47.009554 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bfe53-dc45-4257-be5b-08558efe47cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:47.010110 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bfe53-dc45-4257-be5b-08558efe47cb None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:47.010394 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bfe53-dc45-4257-be5b-08558efe47cb None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:47.010667 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bfe53-dc45-4257-be5b-08558efe47cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:47.022938 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46bfe53-dc45-4257-be5b-08558efe47cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:47.023312 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4fd5c-a344-4af2-b37d-8db7e959a258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:47.024261 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4fd5c-a344-4af2-b37d-8db7e959a258 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:47.024698 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4fd5c-a344-4af2-b37d-8db7e959a258 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:47.025129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4fd5c-a344-4af2-b37d-8db7e959a258 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:47.025483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46bfe53-dc45-4257-be5b-08558efe47cb None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:47.037232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4fd5c-a344-4af2-b37d-8db7e959a258 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:47.039860 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4fd5c-a344-4af2-b37d-8db7e959a258 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:47.046880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-d46bfe53-dc45-4257-be5b-08558efe47cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:47.046880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:47.046880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:47.046880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:47.046880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:47.046880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:47.046880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:47.046880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:47.046880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:47.046880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:47.046880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:47.046880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:47.046880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:35:47.046880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:35:47.046880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:35:47.048741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:35:47.048741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:47.048741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:47.048741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:47.048741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:47.048741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:47.048741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:47.048741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:47.048741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:47.048741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:47.048741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:47.048741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:47.048741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:47.048741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:47.048741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:47.048741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:47.048741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:47.051324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:35:47.051324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:35:47.051324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:35:47.051324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:35:47.051324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:35:47.051324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:35:47.051324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:47.051324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:47.051324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 336/672] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:35:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:47.051324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bfe53-dc45-4257-be5b-08558efe47cb None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:47.060021 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-c9d4fd5c-a344-4af2-b37d-8db7e959a258 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:47.060021 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:47.060021 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:47.060021 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:47.060021 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:47.060021 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:47.060021 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:47.060021 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:47.060021 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:47.060021 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:47.060021 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:47.060021 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:47.060021 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:35:47.060021 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:35:47.060021 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:35:47.061495 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:35:47.061495 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:47.061495 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:47.061495 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:47.061495 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:47.061495 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:47.061495 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:47.061495 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:47.061495 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:47.061495 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:47.061495 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:47.061495 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:47.061495 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:47.061495 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:47.061495 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:47.061495 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:47.061495 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:47.062753 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:35:47.062753 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:35:47.062753 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:35:47.062753 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:35:47.062753 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:35:47.062753 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:35:47.062753 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:47.062753 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:47.066947 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 337/673] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:35:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:47.066947 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4fd5c-a344-4af2-b37d-8db7e959a258 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:47.221692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4fd5c-a344-4af2-b37d-8db7e959a258 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:47.234796 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bfe53-dc45-4257-be5b-08558efe47cb None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:47.242028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:47.271067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82385692-6788-4eae-9b71-0c94c6cf389a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:47.272090 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82385692-6788-4eae-9b71-0c94c6cf389a None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:47.272512 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82385692-6788-4eae-9b71-0c94c6cf389a None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:47.273182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82385692-6788-4eae-9b71-0c94c6cf389a None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:47.273842 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82385692-6788-4eae-9b71-0c94c6cf389a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:47.274234 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82385692-6788-4eae-9b71-0c94c6cf389a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:47.275978 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82385692-6788-4eae-9b71-0c94c6cf389a None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:47.296714 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 338/674] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:47.298510 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b32ab9-e372-4118-93dd-c6de88a72016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:47.298677 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87eb1e5-0e72-43fa-9a47-a047f44be878 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:47.299153 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87eb1e5-0e72-43fa-9a47-a047f44be878 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:47.299509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87eb1e5-0e72-43fa-9a47-a047f44be878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:47.299676 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b32ab9-e372-4118-93dd-c6de88a72016 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:47.299942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b32ab9-e372-4118-93dd-c6de88a72016 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:47.300363 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b32ab9-e372-4118-93dd-c6de88a72016 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:47.319767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b32ab9-e372-4118-93dd-c6de88a72016 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:47.322497 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b32ab9-e372-4118-93dd-c6de88a72016 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:47.334420 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-e87eb1e5-0e72-43fa-9a47-a047f44be878 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:47.336594 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-e87eb1e5-0e72-43fa-9a47-a047f44be878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:47.351027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-84b32ab9-e372-4118-93dd-c6de88a72016 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:47.351027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:47.351027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:47.351027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:47.351027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:47.351027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:47.351027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:47.351027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:47.351027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:47.351027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:47.351027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:47.351027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:47.351027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:47.351027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:47.351027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:47.351027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:47.363416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:47.363416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:47.363416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:47.363416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:47.363416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:47.363416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:47.363416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:47.363416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:47.363416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:47.363416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:47.363416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:47.363416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:47.363416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:47.363416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:47.363416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:47.363416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:47.363416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:47.365164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:47.365164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:47.365164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:47.365164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 337/675] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:47.365164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b32ab9-e372-4118-93dd-c6de88a72016 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:47.419365 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:47.444014 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 339/676] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:47.445121 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87eb1e5-0e72-43fa-9a47-a047f44be878 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:47.556276 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b32ab9-e372-4118-93dd-c6de88a72016 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:47.629264 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc9a05-fbbc-42f4-a57c-6b1ad5d0ff95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:47.630626 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc9a05-fbbc-42f4-a57c-6b1ad5d0ff95 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:47.631385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc9a05-fbbc-42f4-a57c-6b1ad5d0ff95 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:47.631861 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc9a05-fbbc-42f4-a57c-6b1ad5d0ff95 None admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:47.633136 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc9a05-fbbc-42f4-a57c-6b1ad5d0ff95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:47.633737 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc9a05-fbbc-42f4-a57c-6b1ad5d0ff95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:47.637196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc9a05-fbbc-42f4-a57c-6b1ad5d0ff95 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:47.642440 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87eb1e5-0e72-43fa-9a47-a047f44be878 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:47.648710 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:47.661050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 338/677] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:35:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:47.662548 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc9a05-fbbc-42f4-a57c-6b1ad5d0ff95 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:47.740752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9938b60-9a4b-4593-9cf9-fe7c588015b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:47.741476 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9938b60-9a4b-4593-9cf9-fe7c588015b1 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:47.741742 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9938b60-9a4b-4593-9cf9-fe7c588015b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:47.742015 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9938b60-9a4b-4593-9cf9-fe7c588015b1 None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:47.742737 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9938b60-9a4b-4593-9cf9-fe7c588015b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:47.743045 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9938b60-9a4b-4593-9cf9-fe7c588015b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:47.744538 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9938b60-9a4b-4593-9cf9-fe7c588015b1 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:47.760522 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 340/678] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:35:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:47.762153 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9938b60-9a4b-4593-9cf9-fe7c588015b1 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:47.842527 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:47.854119 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc9a05-fbbc-42f4-a57c-6b1ad5d0ff95 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:47.914691 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699da18-fb9f-4ffb-abe2-ef591657be05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:47.915475 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699da18-fb9f-4ffb-abe2-ef591657be05 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:47.915763 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699da18-fb9f-4ffb-abe2-ef591657be05 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:47.916039 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699da18-fb9f-4ffb-abe2-ef591657be05 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:47.924622 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699da18-fb9f-4ffb-abe2-ef591657be05 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:47.926285 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699da18-fb9f-4ffb-abe2-ef591657be05 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:47.945307 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9938b60-9a4b-4593-9cf9-fe7c588015b1 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:47.947010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-2699da18-fb9f-4ffb-abe2-ef591657be05 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:35:47.947010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:47.947010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:47.947010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:47.947010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:47.947010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:47.947010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:47.947010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:47.947010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:47.947010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:47.947010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:47.947010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:47.947010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:35:47.947010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:35:47.947010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:35:47.947010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:35:47.948059 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:47.948059 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:47.948059 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:35:47.948059 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:47.948059 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:35:47.948059 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:47.948059 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:47.948059 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:47.948059 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:47.948059 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:47.948059 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:47.948059 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:47.948059 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:47.948059 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:47.948059 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:47.948059 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:47.948059 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:47.948059 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:47.949927 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:47.949927 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:47.949927 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:35:47.949927 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:35:47.949927 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:35:47.949927 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:35:47.949927 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:35:47.949927 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:35:47.949927 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:35:47.949927 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:47.949927 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 339/679] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:35:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:47.951264 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699da18-fb9f-4ffb-abe2-ef591657be05 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:47.999833 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fcd7c-342c-4002-8ba3-50bb57523d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:48.000455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fcd7c-342c-4002-8ba3-50bb57523d57 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:48.000763 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fcd7c-342c-4002-8ba3-50bb57523d57 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:48.000995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fcd7c-342c-4002-8ba3-50bb57523d57 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:48.001758 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fcd7c-342c-4002-8ba3-50bb57523d57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:48.002072 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fcd7c-342c-4002-8ba3-50bb57523d57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:48.003479 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fcd7c-342c-4002-8ba3-50bb57523d57 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:48.019474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 341/680] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:48.020373 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fcd7c-342c-4002-8ba3-50bb57523d57 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:48.086097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:48.142182 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699da18-fb9f-4ffb-abe2-ef591657be05 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:48.214986 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a1e83-bb28-4878-bc09-e49162ce0e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:48.215939 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a1e83-bb28-4878-bc09-e49162ce0e69 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:48.216297 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a1e83-bb28-4878-bc09-e49162ce0e69 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:48.216621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a1e83-bb28-4878-bc09-e49162ce0e69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:48.217602 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a1e83-bb28-4878-bc09-e49162ce0e69 None admin] RBAC: Adding query filter params (role.id=5e5c4aa158a845b981b0e847f8bd47a6, scope.project.id=4416325d266642f3a786ff9f16c827aa, user.id=bbec984d81c84035887220056b3790ec) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:48.218013 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a1e83-bb28-4878-bc09-e49162ce0e69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:48.219687 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a1e83-bb28-4878-bc09-e49162ce0e69 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:48.223798 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fcd7c-342c-4002-8ba3-50bb57523d57 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:48.229470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 340/681] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:35:47 2022] GET /identity/v3/role_assignments?user.id=bbec984d81c84035887220056b3790ec&scope.project.id=4416325d266642f3a786ff9f16c827aa&role.id=5e5c4aa158a845b981b0e847f8bd47a6 => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:48.229470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a1e83-bb28-4878-bc09-e49162ce0e69 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:48.271308 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:48.296070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaef63a-c7e1-48ed-965d-c259ca603e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:48.296772 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaef63a-c7e1-48ed-965d-c259ca603e45 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:48.297053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaef63a-c7e1-48ed-965d-c259ca603e45 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:48.297362 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaef63a-c7e1-48ed-965d-c259ca603e45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:48.298442 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaef63a-c7e1-48ed-965d-c259ca603e45 None admin] RBAC: Adding query filter params (role.id=5e5c4aa158a845b981b0e847f8bd47a6, scope.project.id=4416325d266642f3a786ff9f16c827aa, user.id=6d36675e4e6045158add36ac528d6c7b) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:48.298839 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaef63a-c7e1-48ed-965d-c259ca603e45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:48.300976 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaef63a-c7e1-48ed-965d-c259ca603e45 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:48.313974 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 342/682] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:35:48 2022] GET /identity/v3/role_assignments?user.id=6d36675e4e6045158add36ac528d6c7b&scope.project.id=4416325d266642f3a786ff9f16c827aa&role.id=5e5c4aa158a845b981b0e847f8bd47a6 => generated 608 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:48.316055 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaef63a-c7e1-48ed-965d-c259ca603e45 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:48.434718 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a1e83-bb28-4878-bc09-e49162ce0e69 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:48.507228 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77a33f-f210-4ff9-b10d-8f117eccd106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:48.508733 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77a33f-f210-4ff9-b10d-8f117eccd106 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:48.509604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77a33f-f210-4ff9-b10d-8f117eccd106 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:48.510308 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77a33f-f210-4ff9-b10d-8f117eccd106 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:48.515096 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:48.533959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77a33f-f210-4ff9-b10d-8f117eccd106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:48.536174 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaef63a-c7e1-48ed-965d-c259ca603e45 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:48.544258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-6b77a33f-f210-4ff9-b10d-8f117eccd106 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:35:48.544258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:48.544258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:48.544258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:48.544258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:48.544258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:48.544258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:48.544258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:48.544258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:48.544258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:48.544258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:48.544258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:48.544258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:48.544258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:48.544258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:48.544258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:48.545867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:48.545867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:48.545867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:48.545867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:48.545867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:48.545867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:48.545867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:48.545867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:48.545867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:48.545867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:48.545867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:48.545867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:48.545867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:48.545867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:48.545867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:48.545867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:48.547735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:48.547735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:48.547735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:48.547735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:48.547735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:48.547735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:48.547735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:48.547735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:48.547735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:48.547735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:48.547735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:35:48.547735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:48.547735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 341/683] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:35:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:48.549053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77a33f-f210-4ff9-b10d-8f117eccd106 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:48.614445 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414d511-d057-44f6-a546-28584b8ed183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:48.615101 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414d511-d057-44f6-a546-28584b8ed183 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:48.615570 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414d511-d057-44f6-a546-28584b8ed183 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:48.615815 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414d511-d057-44f6-a546-28584b8ed183 None admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:48.616781 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414d511-d057-44f6-a546-28584b8ed183 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:48.617016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414d511-d057-44f6-a546-28584b8ed183 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:48.618963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414d511-d057-44f6-a546-28584b8ed183 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:48.645053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 343/684] 10.222.0.94 () {56 vars in 1135 bytes} [Wed Aug 24 04:35:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:48.646034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414d511-d057-44f6-a546-28584b8ed183 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:48.703137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:48.725832 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77a33f-f210-4ff9-b10d-8f117eccd106 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:48.783469 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff24aa-b69d-42b2-b158-a4ea9c16b323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:48.784683 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff24aa-b69d-42b2-b158-a4ea9c16b323 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:48.784991 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff24aa-b69d-42b2-b158-a4ea9c16b323 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:48.785269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff24aa-b69d-42b2-b158-a4ea9c16b323 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:48.795822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff24aa-b69d-42b2-b158-a4ea9c16b323 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:48.797688 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff24aa-b69d-42b2-b158-a4ea9c16b323 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:48.798678 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414d511-d057-44f6-a546-28584b8ed183 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:48.812282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-1bff24aa-b69d-42b2-b158-a4ea9c16b323 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:48.812282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:48.812282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:48.812282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:48.812282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:48.812282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:48.812282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:48.812282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:48.812282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:48.812282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:48.812282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:48.812282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:48.812282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:35:48.812282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:35:48.812282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:35:48.813525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:35:48.813525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:48.813525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:48.813525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:48.813525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:48.813525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:48.813525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:48.813525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:48.813525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:48.813525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:48.813525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:48.813525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:48.813525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:48.813525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:48.813525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:48.813525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:48.813525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:48.814618 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:35:48.814618 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:35:48.814618 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:35:48.814618 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:35:48.814618 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:35:48.814618 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:35:48.814618 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:48.814618 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:48.818556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 342/685] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:35:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:48.820106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff24aa-b69d-42b2-b158-a4ea9c16b323 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:48.859029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6fea2-4727-4bb1-b387-2aebb22fb8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:48.860547 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6fea2-4727-4bb1-b387-2aebb22fb8e5 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:48.861267 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6fea2-4727-4bb1-b387-2aebb22fb8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:48.861804 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6fea2-4727-4bb1-b387-2aebb22fb8e5 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:48.863450 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6fea2-4727-4bb1-b387-2aebb22fb8e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:48.864274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6fea2-4727-4bb1-b387-2aebb22fb8e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:48.867311 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6fea2-4727-4bb1-b387-2aebb22fb8e5 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:48.880869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 344/686] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:48.882223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6fea2-4727-4bb1-b387-2aebb22fb8e5 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:48.899237 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:48.990899 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff24aa-b69d-42b2-b158-a4ea9c16b323 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:49.036691 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfe39f-1e31-4e91-83ba-7251d406239d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:49.037723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfe39f-1e31-4e91-83ba-7251d406239d None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:49.038372 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfe39f-1e31-4e91-83ba-7251d406239d None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:49.038907 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfe39f-1e31-4e91-83ba-7251d406239d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:49.056172 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:49.063715 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6fea2-4727-4bb1-b387-2aebb22fb8e5 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:49.124348 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2cb15-6529-4da2-ac83-33aac7bbdbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:49.125798 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2cb15-6529-4da2-ac83-33aac7bbdbdb None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:49.126557 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2cb15-6529-4da2-ac83-33aac7bbdbdb None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:49.127229 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2cb15-6529-4da2-ac83-33aac7bbdbdb None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:49.129137 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2cb15-6529-4da2-ac83-33aac7bbdbdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:49.129972 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2cb15-6529-4da2-ac83-33aac7bbdbdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:49.133295 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2cb15-6529-4da2-ac83-33aac7bbdbdb None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:49.161459 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 345/687] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:35:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:49.163366 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2cb15-6529-4da2-ac83-33aac7bbdbdb None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:49.187688 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dfe39f-1e31-4e91-83ba-7251d406239d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:49.190769 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dfe39f-1e31-4e91-83ba-7251d406239d None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:49.301908 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:49.348957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2cb15-6529-4da2-ac83-33aac7bbdbdb None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:49.349443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 343/688] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:49.352101 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfe39f-1e31-4e91-83ba-7251d406239d None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:49.396986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf55b1-1555-4ee3-93d0-0aa64bf223da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:49.397757 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf55b1-1555-4ee3-93d0-0aa64bf223da None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:49.398044 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf55b1-1555-4ee3-93d0-0aa64bf223da None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:49.398320 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf55b1-1555-4ee3-93d0-0aa64bf223da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:49.411712 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf55b1-1555-4ee3-93d0-0aa64bf223da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:49.413360 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf55b1-1555-4ee3-93d0-0aa64bf223da None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:49.433903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-d7bf55b1-1555-4ee3-93d0-0aa64bf223da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:49.433903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:49.433903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:49.433903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:49.433903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:49.433903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:49.433903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:49.433903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:49.433903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:49.433903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:49.433903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:49.433903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:49.433903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:49.433903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:49.433903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:49.433903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:49.435995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:49.435995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:49.435995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:49.435995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:49.435995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:49.435995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:49.435995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:49.435995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:49.435995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:49.435995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:49.435995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:49.435995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:49.435995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:49.435995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:49.435995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:49.435995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:49.435995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:49.437836 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:49.437836 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:49.437836 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:49.440696 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 346/689] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:49.441663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf55b1-1555-4ee3-93d0-0aa64bf223da None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:49.449798 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:49.567961 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfe39f-1e31-4e91-83ba-7251d406239d None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:49.581011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf55b1-1555-4ee3-93d0-0aa64bf223da None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:49.610254 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:49.634620 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2ce41-94b1-4803-8f0b-97d3b0ba168f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:49.635125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d11a7-ca30-49cc-8b81-ca3b8a8cf40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:49.635671 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2ce41-94b1-4803-8f0b-97d3b0ba168f None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:49.636720 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2ce41-94b1-4803-8f0b-97d3b0ba168f None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:49.637129 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d11a7-ca30-49cc-8b81-ca3b8a8cf40f None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:49.637294 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2ce41-94b1-4803-8f0b-97d3b0ba168f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:49.637990 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d11a7-ca30-49cc-8b81-ca3b8a8cf40f None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:49.638603 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d11a7-ca30-49cc-8b81-ca3b8a8cf40f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:49.639987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d11a7-ca30-49cc-8b81-ca3b8a8cf40f None admin] RBAC: Adding query filter params (role.id=5e5c4aa158a845b981b0e847f8bd47a6, scope.project.id=4416325d266642f3a786ff9f16c827aa, user.id=0742c7ecf68d40a38c8947a05eee2797) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:49.640719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d11a7-ca30-49cc-8b81-ca3b8a8cf40f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:49.642687 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d11a7-ca30-49cc-8b81-ca3b8a8cf40f None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:49.654141 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2ce41-94b1-4803-8f0b-97d3b0ba168f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:49.655663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2ce41-94b1-4803-8f0b-97d3b0ba168f None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:49.656705 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 344/690] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:35:49 2022] GET /identity/v3/role_assignments?user.id=0742c7ecf68d40a38c8947a05eee2797&scope.project.id=4416325d266642f3a786ff9f16c827aa&role.id=5e5c4aa158a845b981b0e847f8bd47a6 => generated 608 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:49.658513 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d11a7-ca30-49cc-8b81-ca3b8a8cf40f None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:49.681215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-8db2ce41-94b1-4803-8f0b-97d3b0ba168f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:49.681215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:49.681215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:49.681215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:49.681215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:49.681215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:49.681215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:49.681215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:49.681215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:49.681215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:49.681215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:49.681215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:49.681215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:49.681215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:49.681215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:49.681215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:49.682819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:49.682819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:49.682819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:49.682819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:49.682819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:49.682819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:49.682819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:49.682819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:49.682819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:49.682819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:49.682819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:49.682819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:49.682819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:49.682819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:49.682819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:49.682819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:49.682819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:49.684973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:49.684973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:49.684973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:49.684973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 347/691] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:49.697110 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2ce41-94b1-4803-8f0b-97d3b0ba168f None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:49.875449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2ce41-94b1-4803-8f0b-97d3b0ba168f None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:49.923855 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9b7cf-6e41-40f0-8f19-ad09c03c5ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:49.924703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9b7cf-6e41-40f0-8f19-ad09c03c5ac7 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:49.925071 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9b7cf-6e41-40f0-8f19-ad09c03c5ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:49.925437 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9b7cf-6e41-40f0-8f19-ad09c03c5ac7 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:49.926197 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9b7cf-6e41-40f0-8f19-ad09c03c5ac7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:49.926604 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9b7cf-6e41-40f0-8f19-ad09c03c5ac7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:49.928142 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9b7cf-6e41-40f0-8f19-ad09c03c5ac7 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:49.946248 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 348/692] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:35:49.955480 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9b7cf-6e41-40f0-8f19-ad09c03c5ac7 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:49.961516 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d11a7-ca30-49cc-8b81-ca3b8a8cf40f None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:49.964785 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:50.000462 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:50.014356 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1472b63-7b00-4456-93b8-2adebfff3d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:50.015741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1472b63-7b00-4456-93b8-2adebfff3d8c None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:50.016214 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1472b63-7b00-4456-93b8-2adebfff3d8c None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:50.016770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1472b63-7b00-4456-93b8-2adebfff3d8c None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:50.017702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1472b63-7b00-4456-93b8-2adebfff3d8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:50.018319 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1472b63-7b00-4456-93b8-2adebfff3d8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:50.020335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1472b63-7b00-4456-93b8-2adebfff3d8c None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:50.038763 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 345/693] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:50.045934 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1472b63-7b00-4456-93b8-2adebfff3d8c None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:50.101507 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9b7cf-6e41-40f0-8f19-ad09c03c5ac7 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:50.147679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65021906-7980-4252-8b9b-7a35288bad7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:50.148422 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65021906-7980-4252-8b9b-7a35288bad7d None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:50.148835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65021906-7980-4252-8b9b-7a35288bad7d None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:50.149203 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65021906-7980-4252-8b9b-7a35288bad7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:50.159213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65021906-7980-4252-8b9b-7a35288bad7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:50.161431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65021906-7980-4252-8b9b-7a35288bad7d None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:50.174439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-65021906-7980-4252-8b9b-7a35288bad7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:50.174439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:50.174439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:50.174439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:50.174439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:50.174439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:50.174439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:50.174439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:50.174439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:50.174439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:50.174439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:50.174439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:50.174439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:35:50.174439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:35:50.174439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:35:50.175625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:35:50.175625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:50.175625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:50.175625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:50.175625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:50.175625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:50.175625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:50.175625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:50.175625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:50.175625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:50.175625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:50.175625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:50.175625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:50.175625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:50.175625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:50.175625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:50.175625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:50.176755 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:35:50.176755 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:35:50.176755 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:35:50.176755 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:35:50.176755 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:35:50.176755 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:35:50.176755 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:50.176755 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:50.183343 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 349/694] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:35:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:50.191782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65021906-7980-4252-8b9b-7a35288bad7d None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:50.192460 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1472b63-7b00-4456-93b8-2adebfff3d8c None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:50.250217 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60df314-5261-4af5-8365-d336783fb394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:50.250217 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60df314-5261-4af5-8365-d336783fb394 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:50.250573 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60df314-5261-4af5-8365-d336783fb394 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:50.250945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60df314-5261-4af5-8365-d336783fb394 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:50.260653 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60df314-5261-4af5-8365-d336783fb394 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:50.263347 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60df314-5261-4af5-8365-d336783fb394 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:50.281345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-e60df314-5261-4af5-8365-d336783fb394 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:35:50.281345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:50.281345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:50.281345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:50.281345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:50.281345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:50.281345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:50.281345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:50.281345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:50.281345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:50.281345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:50.281345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:50.281345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:35:50.281345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:35:50.281345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:35:50.281345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:35:50.283591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:50.283591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:50.283591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:35:50.283591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:50.283591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:35:50.283591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:50.283591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:50.283591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:50.283591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:50.283591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:50.283591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:50.283591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:50.283591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:50.283591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:50.283591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:50.283591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:50.283591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:50.283591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:50.285016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:50.285016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:50.285016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:35:50.285016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:35:50.285016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:35:50.285016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:35:50.285016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:35:50.285016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:35:50.285016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:35:50.285016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:50.288314 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 346/695] 10.222.0.94 () {56 vars in 1093 bytes} [Wed Aug 24 04:35:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:50.291455 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60df314-5261-4af5-8365-d336783fb394 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:50.333633 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:50.337872 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:50.351534 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65021906-7980-4252-8b9b-7a35288bad7d None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:50.402144 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f879aa0-5c97-44e6-ac92-943630fbdebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:50.403382 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f879aa0-5c97-44e6-ac92-943630fbdebc None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:50.403854 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f879aa0-5c97-44e6-ac92-943630fbdebc None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:50.404276 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f879aa0-5c97-44e6-ac92-943630fbdebc None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:50.405167 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f879aa0-5c97-44e6-ac92-943630fbdebc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:50.405706 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f879aa0-5c97-44e6-ac92-943630fbdebc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:50.407351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f879aa0-5c97-44e6-ac92-943630fbdebc None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:50.427796 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60df314-5261-4af5-8365-d336783fb394 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:50.428490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 350/696] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:35:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:50.431129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f879aa0-5c97-44e6-ac92-943630fbdebc None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:50.465600 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cabb5-a81d-41fe-9ce5-9a21209233d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:50.466350 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cabb5-a81d-41fe-9ce5-9a21209233d9 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:50.466841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cabb5-a81d-41fe-9ce5-9a21209233d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:50.467303 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cabb5-a81d-41fe-9ce5-9a21209233d9 None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:50.468549 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192cabb5-a81d-41fe-9ce5-9a21209233d9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:50.469074 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192cabb5-a81d-41fe-9ce5-9a21209233d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:50.471913 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192cabb5-a81d-41fe-9ce5-9a21209233d9 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:50.507330 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 347/697] 10.222.0.94 () {56 vars in 1133 bytes} [Wed Aug 24 04:35:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:35:50.516857 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cabb5-a81d-41fe-9ce5-9a21209233d9 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:50.645830 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:50.668554 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cabb5-a81d-41fe-9ce5-9a21209233d9 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:50.677238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f879aa0-5c97-44e6-ac92-943630fbdebc None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:50.740829 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647d091-573d-4c66-a33c-41a7cab531e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:50.741886 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647d091-573d-4c66-a33c-41a7cab531e7 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:50.742391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647d091-573d-4c66-a33c-41a7cab531e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:50.742794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647d091-573d-4c66-a33c-41a7cab531e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:50.809372 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7491d0e-f078-412b-94c4-0767b058f023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:50.810031 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7491d0e-f078-412b-94c4-0767b058f023 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:50.810322 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7491d0e-f078-412b-94c4-0767b058f023 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:50.810575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7491d0e-f078-412b-94c4-0767b058f023 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:50.811328 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7491d0e-f078-412b-94c4-0767b058f023 None admin] RBAC: Adding query filter params (role.id=5e5c4aa158a845b981b0e847f8bd47a6, scope.project.id=4416325d266642f3a786ff9f16c827aa, user.id=40d2202203204b06a41e57b9d1a300fc) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:50.811643 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7491d0e-f078-412b-94c4-0767b058f023 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:50.813127 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7491d0e-f078-412b-94c4-0767b058f023 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:50.842852 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 351/698] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:35:50 2022] GET /identity/v3/role_assignments?user.id=40d2202203204b06a41e57b9d1a300fc&scope.project.id=4416325d266642f3a786ff9f16c827aa&role.id=5e5c4aa158a845b981b0e847f8bd47a6 => generated 608 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:35:50.902953 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647d091-573d-4c66-a33c-41a7cab531e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:50.904519 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647d091-573d-4c66-a33c-41a7cab531e7 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:51.105312 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:51.154813 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 348/699] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 04:35:51.164532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7491d0e-f078-412b-94c4-0767b058f023 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:51.211205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:51.338306 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7491d0e-f078-412b-94c4-0767b058f023 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:51.383515 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b34c48-3c12-4534-b929-8ccee947b0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:51.384169 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b34c48-3c12-4534-b929-8ccee947b0bf None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:51.384458 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b34c48-3c12-4534-b929-8ccee947b0bf None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:51.384729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b34c48-3c12-4534-b929-8ccee947b0bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:51.399023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b34c48-3c12-4534-b929-8ccee947b0bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:51.400515 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b34c48-3c12-4534-b929-8ccee947b0bf None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:51.420296 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-61b34c48-3c12-4534-b929-8ccee947b0bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:51.420296 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:51.420296 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:51.420296 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:51.420296 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:51.420296 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:51.420296 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:51.420296 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:51.420296 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:51.420296 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:51.420296 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:51.420296 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:51.420296 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:51.420296 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:51.420296 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:51.420296 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:51.421353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:51.421353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:51.421353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:51.421353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:51.421353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:51.421353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:51.421353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:51.421353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:51.421353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:51.421353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:51.421353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:51.421353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:51.421353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:51.421353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:51.421353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:51.421353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:51.421353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:51.422285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:51.422285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:51.422285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:51.422285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 352/700] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:35:51.428883 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647d091-573d-4c66-a33c-41a7cab531e7 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:51.553288 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647d091-573d-4c66-a33c-41a7cab531e7 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:51.585781 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0863a8e-a5e9-4b59-b5a6-2a79f9673f2b None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:51.586279 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0863a8e-a5e9-4b59-b5a6-2a79f9673f2b None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:51.586753 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0863a8e-a5e9-4b59-b5a6-2a79f9673f2b None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:51.589237 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 353/701] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:35:51.596360 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909219a6-6c3f-4669-9ff6-4c1e9ae34536 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:51.596651 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909219a6-6c3f-4669-9ff6-4c1e9ae34536 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:51.596930 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909219a6-6c3f-4669-9ff6-4c1e9ae34536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:51.601645 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb333483-16bf-4d26-bccd-2419fab3c4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:51.602528 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb333483-16bf-4d26-bccd-2419fab3c4a7 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:51.603021 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb333483-16bf-4d26-bccd-2419fab3c4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:51.603474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb333483-16bf-4d26-bccd-2419fab3c4a7 None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:51.604337 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb333483-16bf-4d26-bccd-2419fab3c4a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:51.605759 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb333483-16bf-4d26-bccd-2419fab3c4a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:51.607777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb333483-16bf-4d26-bccd-2419fab3c4a7 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:51.623628 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 349/702] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:35:51.624711 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-909219a6-6c3f-4669-9ff6-4c1e9ae34536 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:51.627046 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-909219a6-6c3f-4669-9ff6-4c1e9ae34536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:51.629687 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb333483-16bf-4d26-bccd-2419fab3c4a7 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:51.720962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:51.776756 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:51.789883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 354/703] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:35:51.794037 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498f1f7-4618-4084-8981-5a61a4822c13 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:51.794520 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498f1f7-4618-4084-8981-5a61a4822c13 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:51.794997 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498f1f7-4618-4084-8981-5a61a4822c13 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:51.797884 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 355/704] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:51.811155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8ef5d-9cc1-420c-848b-dc9c8e37fe89 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:51.811615 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8ef5d-9cc1-420c-848b-dc9c8e37fe89 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:51.812094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8ef5d-9cc1-420c-848b-dc9c8e37fe89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:51.858734 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb333483-16bf-4d26-bccd-2419fab3c4a7 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:51.877997 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-26f8ef5d-9cc1-420c-848b-dc9c8e37fe89 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:51.880043 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-26f8ef5d-9cc1-420c-848b-dc9c8e37fe89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:51.904223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdd7ed-9251-423d-8a80-334043b8faa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:51.904870 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdd7ed-9251-423d-8a80-334043b8faa3 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:51.905148 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdd7ed-9251-423d-8a80-334043b8faa3 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:51.905450 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdd7ed-9251-423d-8a80-334043b8faa3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:51.914398 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bdd7ed-9251-423d-8a80-334043b8faa3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:51.915920 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bdd7ed-9251-423d-8a80-334043b8faa3 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:51.930261 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-18bdd7ed-9251-423d-8a80-334043b8faa3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:51.930261 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:51.930261 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:51.930261 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:51.930261 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:51.930261 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:51.930261 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:51.930261 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:51.930261 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:51.930261 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:51.930261 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:51.930261 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:51.930261 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:35:51.930261 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:35:51.930261 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:35:51.931293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:35:51.931293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:51.931293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:51.931293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:51.931293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:51.931293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:51.931293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:51.931293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:51.931293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:51.931293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:51.931293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:51.931293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:51.931293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:51.931293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:51.931293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:51.931293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:51.931293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:51.932225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:35:51.932225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:35:51.932225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:35:51.932225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:35:51.932225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:35:51.932225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:35:51.932225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:35:51.932225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:51.932225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 350/705] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:35:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:35:51.938895 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdd7ed-9251-423d-8a80-334043b8faa3 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:52.114037 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 356/706] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:52.135332 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdd7ed-9251-423d-8a80-334043b8faa3 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:52.139014 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:52.190907 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bef92-b5e8-46e7-b2f4-b1f938831d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:52.191540 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bef92-b5e8-46e7-b2f4-b1f938831d40 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:52.191824 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bef92-b5e8-46e7-b2f4-b1f938831d40 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:52.192096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bef92-b5e8-46e7-b2f4-b1f938831d40 None admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:52.192822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6bef92-b5e8-46e7-b2f4-b1f938831d40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:52.193119 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6bef92-b5e8-46e7-b2f4-b1f938831d40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:52.194766 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6bef92-b5e8-46e7-b2f4-b1f938831d40 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:52.226042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 351/707] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:35:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:52.234902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8ef5d-9cc1-420c-848b-dc9c8e37fe89 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:52.303651 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bef92-b5e8-46e7-b2f4-b1f938831d40 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:52.412693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8ef5d-9cc1-420c-848b-dc9c8e37fe89 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:52.460752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:52.485465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26372469-081c-46d4-aab5-e31fc6f81995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:52.486524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26372469-081c-46d4-aab5-e31fc6f81995 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:52.487006 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26372469-081c-46d4-aab5-e31fc6f81995 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:52.487485 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26372469-081c-46d4-aab5-e31fc6f81995 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:52.488893 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26372469-081c-46d4-aab5-e31fc6f81995 None admin] RBAC: Adding query filter params (role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2, scope.project.id=4416325d266642f3a786ff9f16c827aa, user.id=5bdbda2b9c8f48338c5117585a229cb6) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:52.489461 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26372469-081c-46d4-aab5-e31fc6f81995 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:52.496792 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26372469-081c-46d4-aab5-e31fc6f81995 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:52.520963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 357/708] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:35:52 2022] GET /identity/v3/role_assignments?user.id=5bdbda2b9c8f48338c5117585a229cb6&scope.project.id=4416325d266642f3a786ff9f16c827aa&role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:52.670080 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bef92-b5e8-46e7-b2f4-b1f938831d40 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:52.780385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d49b8-c010-4c90-b00c-9c92fe157fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:52.781564 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d49b8-c010-4c90-b00c-9c92fe157fce None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:52.782054 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d49b8-c010-4c90-b00c-9c92fe157fce None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:52.782538 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d49b8-c010-4c90-b00c-9c92fe157fce None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:52.783855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d49b8-c010-4c90-b00c-9c92fe157fce None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:52.786467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d49b8-c010-4c90-b00c-9c92fe157fce None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:52.814936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-624d49b8-c010-4c90-b00c-9c92fe157fce None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:35:52.814936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:52.814936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:35:52.814936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:35:52.814936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:35:52.814936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:35:52.814936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:35:52.814936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:35:52.814936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:35:52.814936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:52.814936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:35:52.814936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:52.814936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:52.814936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:52.814936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:52.814936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:52.814936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:52.816121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:52.816121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:52.816121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:52.816121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:52.816121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:52.816121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:52.816121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:35:52.816121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:35:52.816121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:35:52.816121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:35:52.816121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:52.816121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:52.816121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:52.816121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:52.816121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:52.816121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:52.817517 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:52.817517 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:52.817517 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:52.817517 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:52.817517 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:52.817517 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:52.817517 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:52.817517 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:52.817517 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:52.817517 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:52.817517 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:35:52.817517 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:35:52.817517 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:35:52.817517 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:52.817517 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 352/709] 10.222.0.94 () {56 vars in 1129 bytes} [Wed Aug 24 04:35:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 515 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:52.826415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26372469-081c-46d4-aab5-e31fc6f81995 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:52.907130 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d49b8-c010-4c90-b00c-9c92fe157fce None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:52.961506 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:53.160999 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26372469-081c-46d4-aab5-e31fc6f81995 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:53.197884 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d49b8-c010-4c90-b00c-9c92fe157fce None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:53.248742 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90447455-0b64-459f-b7fb-30b565c32da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:53.249636 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90447455-0b64-459f-b7fb-30b565c32da3 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:53.250094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90447455-0b64-459f-b7fb-30b565c32da3 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:53.250567 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90447455-0b64-459f-b7fb-30b565c32da3 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:53.251620 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90447455-0b64-459f-b7fb-30b565c32da3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:53.252120 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90447455-0b64-459f-b7fb-30b565c32da3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:53.254597 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90447455-0b64-459f-b7fb-30b565c32da3 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:53.263283 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 358/710] 10.222.0.94 () {56 vars in 1124 bytes} [Wed Aug 24 04:35:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:53.280418 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90447455-0b64-459f-b7fb-30b565c32da3 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:53.289344 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f9f3d-422a-4a30-a665-fb76340ad873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:53.290279 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f9f3d-422a-4a30-a665-fb76340ad873 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:53.290568 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f9f3d-422a-4a30-a665-fb76340ad873 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:53.290986 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f9f3d-422a-4a30-a665-fb76340ad873 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:53.321740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f9f3d-422a-4a30-a665-fb76340ad873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:53.323587 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f9f3d-422a-4a30-a665-fb76340ad873 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:53.348686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-234f9f3d-422a-4a30-a665-fb76340ad873 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:53.348686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:53.348686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:53.348686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:53.348686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:53.348686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:53.348686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:53.348686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:53.348686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:53.348686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:53.348686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:53.348686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:53.348686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:53.348686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:53.348686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:53.348686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:53.350485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:53.350485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:53.350485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:53.350485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:53.350485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:53.350485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:53.350485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:53.350485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:53.350485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:53.350485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:53.350485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:53.350485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:53.350485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:53.350485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:53.350485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:53.350485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:53.350485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:53.352143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:53.352143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:53.352143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:53.352143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 353/711] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 444 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:53.352143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052809f-f154-4825-ae43-099c5966e22a None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:53.352143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052809f-f154-4825-ae43-099c5966e22a None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:53.352143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052809f-f154-4825-ae43-099c5966e22a None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:53.356980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 354/712] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:53.365232 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052809f-f154-4825-ae43-099c5966e22a None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:53.441073 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:53.538934 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:53.553663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90447455-0b64-459f-b7fb-30b565c32da3 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:53.595367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052809f-f154-4825-ae43-099c5966e22a None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:53.630157 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8aa23-e5c4-4d3c-b136-5098502e48d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:53.631520 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8aa23-e5c4-4d3c-b136-5098502e48d9 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:53.633324 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8aa23-e5c4-4d3c-b136-5098502e48d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:53.634129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8aa23-e5c4-4d3c-b136-5098502e48d9 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:53.635433 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8aa23-e5c4-4d3c-b136-5098502e48d9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:53.636521 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8aa23-e5c4-4d3c-b136-5098502e48d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:53.639631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8aa23-e5c4-4d3c-b136-5098502e48d9 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:53.651366 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 359/713] 10.222.0.94 () {56 vars in 1124 bytes} [Wed Aug 24 04:35:53 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:53.658693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3c845-5809-45ef-a342-9c930969bbcd None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:53.658693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3c845-5809-45ef-a342-9c930969bbcd None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:53.658693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3c845-5809-45ef-a342-9c930969bbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:53.668237 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5464239-f6e3-40d5-ad7c-159a8a5bed09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:53.669323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5464239-f6e3-40d5-ad7c-159a8a5bed09 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:53.669837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5464239-f6e3-40d5-ad7c-159a8a5bed09 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:53.670305 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5464239-f6e3-40d5-ad7c-159a8a5bed09 None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:53.671534 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5464239-f6e3-40d5-ad7c-159a8a5bed09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:53.672077 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5464239-f6e3-40d5-ad7c-159a8a5bed09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:53.681533 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5464239-f6e3-40d5-ad7c-159a8a5bed09 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:53.716989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-1dc3c845-5809-45ef-a342-9c930969bbcd None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:53.718368 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-1dc3c845-5809-45ef-a342-9c930969bbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:53.724111 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 355/714] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:53.736459 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5464239-f6e3-40d5-ad7c-159a8a5bed09 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:53.967231 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5464239-f6e3-40d5-ad7c-159a8a5bed09 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:53.991071 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 360/715] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:54.040253 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df24a6f-f9ec-43f4-9b62-2e8762a57162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:54.041292 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df24a6f-f9ec-43f4-9b62-2e8762a57162 None admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:54.041812 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df24a6f-f9ec-43f4-9b62-2e8762a57162 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:54.042802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df24a6f-f9ec-43f4-9b62-2e8762a57162 None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:54.044144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df24a6f-f9ec-43f4-9b62-2e8762a57162 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:54.047045 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df24a6f-f9ec-43f4-9b62-2e8762a57162 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:54.065454 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:54.100420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 356/716] 10.222.0.94 () {60 vars in 1132 bytes} [Wed Aug 24 04:35:53 2022] POST /identity/v3/users => generated 254 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:35:54.513848 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3c845-5809-45ef-a342-9c930969bbcd None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:54.637453 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:54.765636 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3c845-5809-45ef-a342-9c930969bbcd None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:54.851078 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8957120-17d1-4b77-a135-c317fccb179c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:54.852688 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8957120-17d1-4b77-a135-c317fccb179c None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:54.853555 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8957120-17d1-4b77-a135-c317fccb179c None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:54.854860 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8957120-17d1-4b77-a135-c317fccb179c None admin] PATH_INFO: `/v3/services/network` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:54.856463 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8957120-17d1-4b77-a135-c317fccb179c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:54.859748 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8957120-17d1-4b77-a135-c317fccb179c None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:54.884685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-e8957120-17d1-4b77-a135-c317fccb179c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:35:54.884685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:54.884685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:35:54.884685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:35:54.884685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:35:54.884685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:35:54.884685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:35:54.884685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:35:54.884685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:35:54.884685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:54.884685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:35:54.884685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:54.884685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:54.884685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:54.884685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:54.884685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:54.884685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:54.886680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:54.886680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:54.886680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:54.886680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:54.886680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:54.886680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:54.886680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:35:54.886680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:35:54.886680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:35:54.886680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:35:54.886680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:54.886680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:54.886680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:54.886680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:54.886680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:54.886680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:54.888416 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:54.888416 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:54.888416 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:54.888416 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:54.888416 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:54.888416 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:54.888416 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:54.888416 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:54.888416 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:54.888416 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:54.888416 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:35:54.888416 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:35:54.888416 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:35:54.888416 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:54.893090 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 361/717] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:35:54 2022] GET /identity/v3/services/network => generated 88 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:54.904573 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df24a6f-f9ec-43f4-9b62-2e8762a57162 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:55.097125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2e3bc-1d18-4dd0-8af3-ca37fa8e1594 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:55.098117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2e3bc-1d18-4dd0-8af3-ca37fa8e1594 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:55.098649 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2e3bc-1d18-4dd0-8af3-ca37fa8e1594 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:55.114382 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 362/718] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:55 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:35:55.123966 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c14fde-4743-49d7-8ad0-f51ce55f184a None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:55.124756 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c14fde-4743-49d7-8ad0-f51ce55f184a None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:55.125474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c14fde-4743-49d7-8ad0-f51ce55f184a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:55.191598 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-99c14fde-4743-49d7-8ad0-f51ce55f184a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:55.194610 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-99c14fde-4743-49d7-8ad0-f51ce55f184a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:55.202077 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df24a6f-f9ec-43f4-9b62-2e8762a57162 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:55.290222 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8a000-e584-4bc5-b50a-1c6d16897ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:55.291667 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8a000-e584-4bc5-b50a-1c6d16897ead None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:55.292421 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8a000-e584-4bc5-b50a-1c6d16897ead None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:55.293135 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8a000-e584-4bc5-b50a-1c6d16897ead None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:55.294725 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8a000-e584-4bc5-b50a-1c6d16897ead None admin] RBAC: Adding query filter params (name=network) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:55.295344 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8a000-e584-4bc5-b50a-1c6d16897ead None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:55.296983 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8a000-e584-4bc5-b50a-1c6d16897ead None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:55.307357 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 357/719] 10.222.0.94 () {56 vars in 1112 bytes} [Wed Aug 24 04:35:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:55.319181 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8a000-e584-4bc5-b50a-1c6d16897ead None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:55.385571 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 363/720] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:55.518065 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:55.626637 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8a000-e584-4bc5-b50a-1c6d16897ead None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:55.722948 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e8aec-9ced-41b3-956c-57fd5717f2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:55.723999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e8aec-9ced-41b3-956c-57fd5717f2e5 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:55.724484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e8aec-9ced-41b3-956c-57fd5717f2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:55.724972 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e8aec-9ced-41b3-956c-57fd5717f2e5 None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:55.726206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e8aec-9ced-41b3-956c-57fd5717f2e5 None admin] RBAC: Adding query filter params (type=network) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:55.726745 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e8aec-9ced-41b3-956c-57fd5717f2e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:55.736290 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e8aec-9ced-41b3-956c-57fd5717f2e5 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:55.748557 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 358/721] 10.222.0.94 () {56 vars in 1112 bytes} [Wed Aug 24 04:35:55 2022] GET /identity/v3/services?type=network => generated 124 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:55.901970 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c14fde-4743-49d7-8ad0-f51ce55f184a None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:56.011484 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:56.144290 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c14fde-4743-49d7-8ad0-f51ce55f184a None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:56.219967 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25b521-02aa-47a4-b3bf-16e4c71e906b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:56.221075 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25b521-02aa-47a4-b3bf-16e4c71e906b None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:56.221605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25b521-02aa-47a4-b3bf-16e4c71e906b None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:56.222098 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25b521-02aa-47a4-b3bf-16e4c71e906b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:56.247646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25b521-02aa-47a4-b3bf-16e4c71e906b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:56.259103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-8a25b521-02aa-47a4-b3bf-16e4c71e906b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:35:56.259103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:56.259103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:56.259103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:56.259103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:56.259103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:56.259103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:56.259103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:56.259103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:56.259103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:56.259103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:56.259103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:56.259103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:56.259103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:56.259103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:56.259103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:56.261646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:56.261646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:56.261646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:56.261646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:56.261646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:56.261646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:56.261646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:56.261646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:56.261646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:56.261646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:56.261646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:56.261646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:56.261646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:56.261646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:56.261646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:56.261646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:56.263441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:56.263441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:56.263441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:56.263441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:56.263441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:56.263441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:56.263441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:56.263441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:56.263441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:56.263441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:56.263441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:35:56.263441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:56.263441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 364/722] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:35:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:56.275307 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e8aec-9ced-41b3-956c-57fd5717f2e5 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:56.353115 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fc1f1-0861-4436-84f5-9d1908f960a5 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:56.353115 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fc1f1-0861-4436-84f5-9d1908f960a5 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:56.353115 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fc1f1-0861-4436-84f5-9d1908f960a5 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:56.357307 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 365/723] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:56.364447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3eab78-614c-4b56-83cd-8465f5761377 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:56.364884 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3eab78-614c-4b56-83cd-8465f5761377 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:56.365440 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3eab78-614c-4b56-83cd-8465f5761377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:56.420736 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-8e3eab78-614c-4b56-83cd-8465f5761377 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:56.423285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-8e3eab78-614c-4b56-83cd-8465f5761377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:56.610289 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 366/724] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:56.686294 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e8aec-9ced-41b3-956c-57fd5717f2e5 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:56.763958 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:56.799378 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a545e-fe44-4938-aee6-e36532cee350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:56.800417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a545e-fe44-4938-aee6-e36532cee350 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:56.800907 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a545e-fe44-4938-aee6-e36532cee350 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:56.801374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a545e-fe44-4938-aee6-e36532cee350 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:56.802683 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a545e-fe44-4938-aee6-e36532cee350 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:56.803218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a545e-fe44-4938-aee6-e36532cee350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:56.805935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a545e-fe44-4938-aee6-e36532cee350 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:56.835645 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 359/725] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 562 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:56.845884 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3eab78-614c-4b56-83cd-8465f5761377 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:56.945520 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:57.140258 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3eab78-614c-4b56-83cd-8465f5761377 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:57.246706 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e52c66-3bc7-4b83-b916-ec93ec5fdbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:57.247673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e52c66-3bc7-4b83-b916-ec93ec5fdbcc None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:57.248119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e52c66-3bc7-4b83-b916-ec93ec5fdbcc None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:57.248595 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e52c66-3bc7-4b83-b916-ec93ec5fdbcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:57.269998 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e52c66-3bc7-4b83-b916-ec93ec5fdbcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:57.272915 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e52c66-3bc7-4b83-b916-ec93ec5fdbcc None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:57.305212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-d8e52c66-3bc7-4b83-b916-ec93ec5fdbcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:57.305212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:57.305212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:57.305212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:57.305212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:57.305212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:57.305212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:57.305212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:57.305212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:57.305212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:57.305212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:57.305212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:57.305212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:57.305212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:57.305212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:57.305212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:57.307117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:57.307117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:57.307117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:57.307117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:57.307117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:57.307117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:57.307117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:57.307117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:57.307117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:57.307117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:57.307117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:57.307117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:57.307117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:57.307117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:57.307117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:57.307117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:57.307117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:57.310293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:57.310293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:57.310293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:57.310293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 367/726] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 463 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:57.319734 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a545e-fe44-4938-aee6-e36532cee350 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:57.390946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e52c66-3bc7-4b83-b916-ec93ec5fdbcc None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:57.553577 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:57.587899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e52c66-3bc7-4b83-b916-ec93ec5fdbcc None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:57.644061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8c6ea-7451-4c9f-8999-8bfd2812770f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:57.645825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8c6ea-7451-4c9f-8999-8bfd2812770f None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:57.646694 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8c6ea-7451-4c9f-8999-8bfd2812770f None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:57.647490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8c6ea-7451-4c9f-8999-8bfd2812770f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:57.668965 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8c6ea-7451-4c9f-8999-8bfd2812770f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:57.678247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-69c8c6ea-7451-4c9f-8999-8bfd2812770f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:35:57.678247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:57.678247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:57.678247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:57.678247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:57.678247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:57.678247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:57.678247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:57.678247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:57.678247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:57.678247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:57.678247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:57.678247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:57.678247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:57.678247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:57.678247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:57.679309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:57.679309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:57.679309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:57.679309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:57.679309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:57.679309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:57.679309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:57.679309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:57.679309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:57.679309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:57.679309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:57.679309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:57.679309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:57.679309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:57.679309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:57.679309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:57.680422 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:57.680422 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:57.680422 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:57.680422 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:57.680422 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:57.680422 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:57.680422 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:57.680422 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:57.680422 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:57.680422 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:57.680422 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:35:57.680422 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:57.688769 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 368/727] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:35:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:35:57.691565 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7f774-8d45-4eef-a432-bdf4fc06a854 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:57.692361 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7f774-8d45-4eef-a432-bdf4fc06a854 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:57.693058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7f774-8d45-4eef-a432-bdf4fc06a854 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:57.696714 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 369/728] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:57.700873 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7f774-8d45-4eef-a432-bdf4fc06a854 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:57.712004 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a545e-fe44-4938-aee6-e36532cee350 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:57.792498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c7c64-7ebf-4218-9e31-28417fcd40a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:57.794335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c7c64-7ebf-4218-9e31-28417fcd40a5 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:57.794743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c7c64-7ebf-4218-9e31-28417fcd40a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:57.795344 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c7c64-7ebf-4218-9e31-28417fcd40a5 None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:57.796727 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c7c64-7ebf-4218-9e31-28417fcd40a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:57.797474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c7c64-7ebf-4218-9e31-28417fcd40a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:57.800490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c7c64-7ebf-4218-9e31-28417fcd40a5 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:57.837556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 360/729] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 514 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:35:57.837556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2924887-d3d0-4c22-a553-14608fbb5bd8 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:57.837556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2924887-d3d0-4c22-a553-14608fbb5bd8 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:57.837556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2924887-d3d0-4c22-a553-14608fbb5bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:57.873712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-a2924887-d3d0-4c22-a553-14608fbb5bd8 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:57.876262 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-a2924887-d3d0-4c22-a553-14608fbb5bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:57.891656 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7f774-8d45-4eef-a432-bdf4fc06a854 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:57.955280 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c19c2-ce12-432b-8b32-3828ef42b34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:57.956368 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c19c2-ce12-432b-8b32-3828ef42b34d None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:57.956903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c19c2-ce12-432b-8b32-3828ef42b34d None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:57.957366 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c19c2-ce12-432b-8b32-3828ef42b34d None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:57.958427 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c19c2-ce12-432b-8b32-3828ef42b34d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:57.958983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c19c2-ce12-432b-8b32-3828ef42b34d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:57.960980 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c19c2-ce12-432b-8b32-3828ef42b34d None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:57.980641 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:57.982341 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 370/730] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:57.984762 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c19c2-ce12-432b-8b32-3828ef42b34d None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:58.010025 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:58.038411 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 361/731] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:58.039755 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2924887-d3d0-4c22-a553-14608fbb5bd8 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:58.253978 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2924887-d3d0-4c22-a553-14608fbb5bd8 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:58.336782 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16d498-8660-4f18-b53c-d6d0f1e7a20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:58.339162 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16d498-8660-4f18-b53c-d6d0f1e7a20e None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:58.340693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16d498-8660-4f18-b53c-d6d0f1e7a20e None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:58.341510 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16d498-8660-4f18-b53c-d6d0f1e7a20e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:58.364699 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c19c2-ce12-432b-8b32-3828ef42b34d None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:58.366145 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16d498-8660-4f18-b53c-d6d0f1e7a20e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:58.369926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16d498-8660-4f18-b53c-d6d0f1e7a20e None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:58.406864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-7c16d498-8660-4f18-b53c-d6d0f1e7a20e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:58.406864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:58.406864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:58.406864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:58.406864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:58.406864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:58.406864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:58.406864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:58.406864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:58.406864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:58.406864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:58.406864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:58.406864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:58.406864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:58.406864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:58.406864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:58.409016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:58.409016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:58.409016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:58.409016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:58.409016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:58.409016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:58.409016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:58.409016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:58.409016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:58.409016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:58.409016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:58.409016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:58.409016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:58.409016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:58.409016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:58.409016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:58.409016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:58.411074 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:58.411074 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:58.411074 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:58.417638 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 362/732] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:58.429262 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16d498-8660-4f18-b53c-d6d0f1e7a20e None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:58.506780 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863463cb-48da-4abb-a99c-88257c19323e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:58.508252 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863463cb-48da-4abb-a99c-88257c19323e None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:58.513104 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863463cb-48da-4abb-a99c-88257c19323e None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:58.513997 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863463cb-48da-4abb-a99c-88257c19323e None admin] PATH_INFO: `/v3/users/swift` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:58.536399 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863463cb-48da-4abb-a99c-88257c19323e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:58.540612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863463cb-48da-4abb-a99c-88257c19323e None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:58.545361 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:58.581032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-863463cb-48da-4abb-a99c-88257c19323e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:35:58.581032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:58.581032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:58.581032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:58.581032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:58.581032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:58.581032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:58.581032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:58.581032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:58.581032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:58.581032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:58.581032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:58.581032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:35:58.581032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:35:58.581032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:35:58.581032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:35:58.582870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:58.582870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:58.582870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:35:58.582870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:58.582870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:35:58.582870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:58.582870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:58.582870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:58.582870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:58.582870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:58.582870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:58.582870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:58.582870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:58.582870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:58.582870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:58.582870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:58.582870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:58.582870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:58.583950 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:58.583950 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:58.583950 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:35:58.583950 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:35:58.583950 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:35:58.583950 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:35:58.583950 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:35:58.583950 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:35:58.583950 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:35:58.583950 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:58.597442 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 371/733] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:35:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 607 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:58.602511 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863463cb-48da-4abb-a99c-88257c19323e None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:58.730958 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16d498-8660-4f18-b53c-d6d0f1e7a20e None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:58.739712 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:58.799207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863463cb-48da-4abb-a99c-88257c19323e None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:58.803289 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e09567-9ce8-49ce-ac43-e7851ce3041c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:58.803496 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e09567-9ce8-49ce-ac43-e7851ce3041c None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:58.803845 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e09567-9ce8-49ce-ac43-e7851ce3041c None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:58.804291 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e09567-9ce8-49ce-ac43-e7851ce3041c None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:58.805054 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e09567-9ce8-49ce-ac43-e7851ce3041c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:58.805391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e09567-9ce8-49ce-ac43-e7851ce3041c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:58.807191 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e09567-9ce8-49ce-ac43-e7851ce3041c None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:58.824916 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 363/734] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:58.829487 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e09567-9ce8-49ce-ac43-e7851ce3041c None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:58.857915 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a718d81-aa94-45f2-ba2f-4128cca5c707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:58.858619 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a718d81-aa94-45f2-ba2f-4128cca5c707 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:58.859081 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a718d81-aa94-45f2-ba2f-4128cca5c707 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:58.859436 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a718d81-aa94-45f2-ba2f-4128cca5c707 None admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:58.860342 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a718d81-aa94-45f2-ba2f-4128cca5c707 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:58.860658 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a718d81-aa94-45f2-ba2f-4128cca5c707 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:58.862204 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a718d81-aa94-45f2-ba2f-4128cca5c707 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:58.897484 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 372/735] 10.222.0.94 () {56 vars in 1135 bytes} [Wed Aug 24 04:35:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:58.898199 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add86ac-a888-47d5-bf2c-50cfc8ee1e02 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:58.898704 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add86ac-a888-47d5-bf2c-50cfc8ee1e02 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:58.899276 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add86ac-a888-47d5-bf2c-50cfc8ee1e02 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:58.905825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 373/736] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:58.907684 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add86ac-a888-47d5-bf2c-50cfc8ee1e02 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:58.986698 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:59.021244 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e09567-9ce8-49ce-ac43-e7851ce3041c None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:59.088417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219a3b2-cfbf-4bdb-ac90-8af7b3bd5004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:59.089888 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219a3b2-cfbf-4bdb-ac90-8af7b3bd5004 None admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:59.090208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219a3b2-cfbf-4bdb-ac90-8af7b3bd5004 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:59.090559 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219a3b2-cfbf-4bdb-ac90-8af7b3bd5004 None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:59.091122 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219a3b2-cfbf-4bdb-ac90-8af7b3bd5004 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:59.092599 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219a3b2-cfbf-4bdb-ac90-8af7b3bd5004 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:59.108187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add86ac-a888-47d5-bf2c-50cfc8ee1e02 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:59.111584 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 364/737] 10.222.0.94 () {60 vars in 1141 bytes} [Wed Aug 24 04:35:58 2022] POST /identity/v3/services => generated 251 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:35:59.112648 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219a3b2-cfbf-4bdb-ac90-8af7b3bd5004 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:59.170383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:59.203076 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721cfb38-5095-4b1d-9591-f1676dbe6d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:59.203756 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cfb38-5095-4b1d-9591-f1676dbe6d6b None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:59.204053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cfb38-5095-4b1d-9591-f1676dbe6d6b None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:59.204322 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cfb38-5095-4b1d-9591-f1676dbe6d6b None admin] PATH_INFO: `/v3/users/nova` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:59.216950 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721cfb38-5095-4b1d-9591-f1676dbe6d6b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:59.220277 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721cfb38-5095-4b1d-9591-f1676dbe6d6b None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:59.240789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-721cfb38-5095-4b1d-9591-f1676dbe6d6b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:35:59.240789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:59.240789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:59.240789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:59.240789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:59.240789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:59.240789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:59.240789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:59.240789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:59.240789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:59.240789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:59.240789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:59.240789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:35:59.240789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:35:59.240789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:35:59.240789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:35:59.242509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:59.242509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:59.242509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:35:59.242509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:59.242509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:35:59.242509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:35:59.242509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:59.242509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:59.242509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:59.242509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:59.242509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:59.242509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:59.242509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:59.242509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:59.242509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:59.242509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:59.242509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:59.242509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:59.244741 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:59.244741 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:59.244741 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:35:59.244741 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:35:59.244741 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:35:59.244741 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:35:59.244741 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:35:59.244741 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:35:59.244741 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:35:59.244741 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:59.249149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 374/738] 10.222.0.94 () {56 vars in 1093 bytes} [Wed Aug 24 04:35:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:59.251331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e4c36-328a-47a7-aae3-f60f0f72022c None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:59.251656 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e4c36-328a-47a7-aae3-f60f0f72022c None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:59.251947 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e4c36-328a-47a7-aae3-f60f0f72022c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:59.278419 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-062e4c36-328a-47a7-aae3-f60f0f72022c None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:59.279738 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-062e4c36-328a-47a7-aae3-f60f0f72022c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:59.362522 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219a3b2-cfbf-4bdb-ac90-8af7b3bd5004 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:59.409645 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 375/739] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:59 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:59.409645 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e4c36-328a-47a7-aae3-f60f0f72022c None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:59.433962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5f9f4-9c05-4583-a75d-71b7c2c5c082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:59.435114 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5f9f4-9c05-4583-a75d-71b7c2c5c082 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:59.435716 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5f9f4-9c05-4583-a75d-71b7c2c5c082 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:59.436291 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5f9f4-9c05-4583-a75d-71b7c2c5c082 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:59.462710 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:59.527389 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5f9f4-9c05-4583-a75d-71b7c2c5c082 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:59.529019 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5f9f4-9c05-4583-a75d-71b7c2c5c082 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:59.587782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e4c36-328a-47a7-aae3-f60f0f72022c None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:59.604994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:59.631014 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29a143-90df-41ff-8427-0e8c59bab292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:59.631985 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29a143-90df-41ff-8427-0e8c59bab292 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:59.632418 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29a143-90df-41ff-8427-0e8c59bab292 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:59.632836 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29a143-90df-41ff-8427-0e8c59bab292 None admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:59.633899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29a143-90df-41ff-8427-0e8c59bab292 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:59.634359 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29a143-90df-41ff-8427-0e8c59bab292 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:59.637020 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29a143-90df-41ff-8427-0e8c59bab292 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:59.646951 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 365/740] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:59 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:59.648594 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd3acf-45db-4d1a-8ce8-2b4e49e83314 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:59.648976 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd3acf-45db-4d1a-8ce8-2b4e49e83314 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:59.649343 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd3acf-45db-4d1a-8ce8-2b4e49e83314 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:59.656515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 366/741] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:35:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:59.658209 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd3acf-45db-4d1a-8ce8-2b4e49e83314 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:59.662399 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 376/742] 10.222.0.94 () {56 vars in 1133 bytes} [Wed Aug 24 04:35:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:59.664110 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e7198-c7ce-40a0-bf9b-6bbce3a95f4c None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:59.664546 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e7198-c7ce-40a0-bf9b-6bbce3a95f4c None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:59.664998 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e7198-c7ce-40a0-bf9b-6bbce3a95f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:59.685982 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-6c4e7198-c7ce-40a0-bf9b-6bbce3a95f4c None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:59.688143 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-6c4e7198-c7ce-40a0-bf9b-6bbce3a95f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:59.714449 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:59.768068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 377/743] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:59 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:59.769006 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e7198-c7ce-40a0-bf9b-6bbce3a95f4c None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:59.790153 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd3acf-45db-4d1a-8ce8-2b4e49e83314 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:59.834058 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b94e7-5ef5-44f9-8937-5492c8252c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:59.834936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b94e7-5ef5-44f9-8937-5492c8252c2c None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:59.835889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b94e7-5ef5-44f9-8937-5492c8252c2c None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:59.836345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b94e7-5ef5-44f9-8937-5492c8252c2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:59.851980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b94e7-5ef5-44f9-8937-5492c8252c2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:59.854503 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b94e7-5ef5-44f9-8937-5492c8252c2c None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:59.876838 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-b54b94e7-5ef5-44f9-8937-5492c8252c2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:59.876838 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:59.876838 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:59.876838 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:59.876838 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:59.876838 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:59.876838 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:59.876838 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:59.876838 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:59.876838 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:59.876838 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:59.876838 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:59.876838 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:59.876838 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:59.876838 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:59.876838 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:59.878130 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:59.878130 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:59.878130 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:59.878130 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:59.878130 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:59.878130 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:59.878130 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:59.878130 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:59.878130 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:59.878130 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:59.878130 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:59.878130 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:59.878130 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:59.878130 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:59.878130 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:59.878130 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:59.878130 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:59.879048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:59.879048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:59.879048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:35:59.882796 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 367/744] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:59.883689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b94e7-5ef5-44f9-8937-5492c8252c2c None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:59.895426 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:59.902039 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e7198-c7ce-40a0-bf9b-6bbce3a95f4c None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:59.949132 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af227eb-a066-4e2d-886f-f61de1e8fdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:59.950332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af227eb-a066-4e2d-886f-f61de1e8fdaf None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:59.950798 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af227eb-a066-4e2d-886f-f61de1e8fdaf None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:59.951220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af227eb-a066-4e2d-886f-f61de1e8fdaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:59.966386 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af227eb-a066-4e2d-886f-f61de1e8fdaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:59.968286 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af227eb-a066-4e2d-886f-f61de1e8fdaf None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:59.986497 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-1af227eb-a066-4e2d-886f-f61de1e8fdaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:59.986497 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:59.986497 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:59.986497 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:59.986497 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:59.986497 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:59.986497 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:59.986497 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:59.986497 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:59.986497 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:59.986497 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:59.986497 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:59.986497 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:59.986497 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:59.986497 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:59.986497 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:59.987705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:59.987705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:59.987705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:59.987705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:59.987705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:59.987705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:59.987705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:59.987705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:59.987705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:59.987705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:59.987705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:59.987705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:59.987705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:59.987705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:59.987705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:59.987705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:59.987705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:59.988837 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:59.988837 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:59.988837 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:35:59.993347 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 378/745] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:59.994251 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af227eb-a066-4e2d-886f-f61de1e8fdaf None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:00.004161 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:00.011317 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b94e7-5ef5-44f9-8937-5492c8252c2c None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:00.071363 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f8875-92f2-4afe-9a5a-d465a70bd2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:00.072249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f8875-92f2-4afe-9a5a-d465a70bd2d4 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:00.073229 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f8875-92f2-4afe-9a5a-d465a70bd2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:00.073768 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f8875-92f2-4afe-9a5a-d465a70bd2d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:00.091403 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f8875-92f2-4afe-9a5a-d465a70bd2d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:00.096818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-963f8875-92f2-4afe-9a5a-d465a70bd2d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:00.096818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:00.096818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:00.096818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:00.096818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:00.096818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:00.096818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:00.096818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:00.096818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:00.096818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:00.096818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:00.096818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:00.096818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:00.096818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:00.096818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:00.096818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:00.097926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:00.097926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:00.097926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:00.097926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:00.097926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:00.097926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:00.097926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:00.097926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:00.097926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:00.097926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:00.097926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:00.097926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:00.097926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:00.097926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:00.097926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:00.097926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:00.102767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:00.102767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:00.102767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:00.102767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:00.102767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:00.102767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:00.102767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:00.102767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:00.102767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:00.102767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:00.102767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:00.102767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:00.102767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 368/746] 10.222.0.94 () {56 vars in 1102 bytes} [Wed Aug 24 04:35:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:00.102767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f8875-92f2-4afe-9a5a-d465a70bd2d4 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:00.132610 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af227eb-a066-4e2d-886f-f61de1e8fdaf None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:00.174939 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925f205-bd4b-4e37-b5ad-697f4970fdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:00.175463 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925f205-bd4b-4e37-b5ad-697f4970fdcf None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:00.175742 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925f205-bd4b-4e37-b5ad-697f4970fdcf None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:00.176046 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925f205-bd4b-4e37-b5ad-697f4970fdcf None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:00.176831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925f205-bd4b-4e37-b5ad-697f4970fdcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:00.177042 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925f205-bd4b-4e37-b5ad-697f4970fdcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:00.178455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925f205-bd4b-4e37-b5ad-697f4970fdcf None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:00.195080 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 379/747] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:00.195080 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925f205-bd4b-4e37-b5ad-697f4970fdcf None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:00.215391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:00.239007 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f8875-92f2-4afe-9a5a-d465a70bd2d4 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:00.286324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a0d14-0674-4a1b-a512-909ad766f101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:00.287204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a0d14-0674-4a1b-a512-909ad766f101 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:00.287675 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a0d14-0674-4a1b-a512-909ad766f101 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:00.288066 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a0d14-0674-4a1b-a512-909ad766f101 None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:00.288878 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a0d14-0674-4a1b-a512-909ad766f101 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:00.289384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a0d14-0674-4a1b-a512-909ad766f101 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:00.292174 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a0d14-0674-4a1b-a512-909ad766f101 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:00.306375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 369/748] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:00.306983 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a0d14-0674-4a1b-a512-909ad766f101 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:00.330656 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:00.337141 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925f205-bd4b-4e37-b5ad-697f4970fdcf None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:00.383757 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c58d12-36bd-4c53-bef6-4bbe660a5065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:00.384443 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c58d12-36bd-4c53-bef6-4bbe660a5065 None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:00.384752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c58d12-36bd-4c53-bef6-4bbe660a5065 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:00.385107 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c58d12-36bd-4c53-bef6-4bbe660a5065 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:00.386452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c58d12-36bd-4c53-bef6-4bbe660a5065 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:00.387978 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c58d12-36bd-4c53-bef6-4bbe660a5065 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:00.408131 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 380/749] 10.222.0.94 () {60 vars in 1141 bytes} [Wed Aug 24 04:36:00 2022] POST /identity/v3/services => generated 240 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:00.408993 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c58d12-36bd-4c53-bef6-4bbe660a5065 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:00.477459 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a0d14-0674-4a1b-a512-909ad766f101 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:00.544019 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deaa839-e7ad-4d22-b1d9-67263f503ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:00.544647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deaa839-e7ad-4d22-b1d9-67263f503ab1 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:00.544929 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deaa839-e7ad-4d22-b1d9-67263f503ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:00.545205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deaa839-e7ad-4d22-b1d9-67263f503ab1 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:00.545931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deaa839-e7ad-4d22-b1d9-67263f503ab1 None admin] RBAC: Adding query filter params (name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:00.546239 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deaa839-e7ad-4d22-b1d9-67263f503ab1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:00.547647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deaa839-e7ad-4d22-b1d9-67263f503ab1 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:00.549299 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:00.564263 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 370/750] 10.222.0.94 () {56 vars in 1103 bytes} [Wed Aug 24 04:36:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:00.564263 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deaa839-e7ad-4d22-b1d9-67263f503ab1 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:00.598592 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c58d12-36bd-4c53-bef6-4bbe660a5065 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:00.640879 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2efce6-ad8f-4a8c-a7d6-d9dabba07ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:00.642071 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2efce6-ad8f-4a8c-a7d6-d9dabba07ae5 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:00.642593 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2efce6-ad8f-4a8c-a7d6-d9dabba07ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:00.642890 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2efce6-ad8f-4a8c-a7d6-d9dabba07ae5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:00.652222 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2efce6-ad8f-4a8c-a7d6-d9dabba07ae5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:00.653841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2efce6-ad8f-4a8c-a7d6-d9dabba07ae5 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:00.669025 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-dd2efce6-ad8f-4a8c-a7d6-d9dabba07ae5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:00.669025 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:00.669025 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:00.669025 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:00.669025 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:00.669025 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:00.669025 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:00.669025 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:00.669025 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:00.669025 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:00.669025 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:00.669025 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:00.669025 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:00.669025 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:00.669025 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:00.670612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:00.670612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:00.670612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:00.670612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:00.670612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:00.670612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:00.670612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:00.670612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:00.670612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:00.670612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:00.670612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:00.670612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:00.670612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:00.670612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:00.670612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:00.670612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:00.670612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:00.671614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:00.671614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:00.671614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:00.671614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:00.671614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:00.671614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:00.671614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:00.671614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:00.671614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 381/751] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:00.671614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2efce6-ad8f-4a8c-a7d6-d9dabba07ae5 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:00.672959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:00.711465 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deaa839-e7ad-4d22-b1d9-67263f503ab1 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:00.763952 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e07e5c-39fb-458e-9c47-3d1f4a31a6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:00.764607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e07e5c-39fb-458e-9c47-3d1f4a31a6a3 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:00.764946 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e07e5c-39fb-458e-9c47-3d1f4a31a6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:00.765221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e07e5c-39fb-458e-9c47-3d1f4a31a6a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:00.775707 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e07e5c-39fb-458e-9c47-3d1f4a31a6a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:00.778609 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e07e5c-39fb-458e-9c47-3d1f4a31a6a3 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:00.794724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2efce6-ad8f-4a8c-a7d6-d9dabba07ae5 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:00.797106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-72e07e5c-39fb-458e-9c47-3d1f4a31a6a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:00.797106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:00.797106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:00.797106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:00.797106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:00.797106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:00.797106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:00.797106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:00.797106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:00.797106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:00.797106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:00.797106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:00.797106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:00.797106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:00.797106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:00.798082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:00.798082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:00.798082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:00.798082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:00.798082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:00.798082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:00.798082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:00.798082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:00.798082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:00.798082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:00.798082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:00.798082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:00.798082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:00.798082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:00.798082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:00.798082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:00.798082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:00.799053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:00.799053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:00.799053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:00.799053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:00.799053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:00.799053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:00.799053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:00.799053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:00.799053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 371/752] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:00.799544 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e07e5c-39fb-458e-9c47-3d1f4a31a6a3 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:00.837048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:00.845601 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fb4e2-af40-4f81-b855-5f3cf68a1cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:00.846317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fb4e2-af40-4f81-b855-5f3cf68a1cc3 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:00.846603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fb4e2-af40-4f81-b855-5f3cf68a1cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:00.846879 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fb4e2-af40-4f81-b855-5f3cf68a1cc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:00.863410 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fb4e2-af40-4f81-b855-5f3cf68a1cc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:00.865197 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fb4e2-af40-4f81-b855-5f3cf68a1cc3 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:00.885988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-c12fb4e2-af40-4f81-b855-5f3cf68a1cc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:00.885988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:00.885988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:00.885988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:00.885988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:00.885988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:00.885988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:00.885988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:00.885988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:00.885988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:00.885988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:00.885988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:00.885988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:00.885988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:00.885988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:00.885988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:00.887266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:00.887266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:00.887266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:00.887266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:00.887266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:00.887266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:00.887266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:00.887266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:00.887266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:00.887266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:00.887266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:00.887266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:00.887266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:00.887266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:00.887266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:00.887266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:00.887266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:00.888248 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:00.888248 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:00.888248 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:00.888248 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 382/753] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:00.888479 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fb4e2-af40-4f81-b855-5f3cf68a1cc3 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:00.940140 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e07e5c-39fb-458e-9c47-3d1f4a31a6a3 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:00.982929 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f96a82-2d02-461b-add6-902de9bf8f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:00.983995 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f96a82-2d02-461b-add6-902de9bf8f8c None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:00.984579 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f96a82-2d02-461b-add6-902de9bf8f8c None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:00.985049 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f96a82-2d02-461b-add6-902de9bf8f8c None admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:00.986013 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f96a82-2d02-461b-add6-902de9bf8f8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:00.986573 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f96a82-2d02-461b-add6-902de9bf8f8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:00.988306 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f96a82-2d02-461b-add6-902de9bf8f8c None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:00.991901 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:01.004813 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 372/754] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:01.006195 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f96a82-2d02-461b-add6-902de9bf8f8c None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:01.024835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fb4e2-af40-4f81-b855-5f3cf68a1cc3 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:01.071154 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdae15-c241-4514-8358-6ef42547dd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:01.071772 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdae15-c241-4514-8358-6ef42547dd71 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:01.072053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdae15-c241-4514-8358-6ef42547dd71 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:01.072326 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdae15-c241-4514-8358-6ef42547dd71 None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:01.073615 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdae15-c241-4514-8358-6ef42547dd71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:01.073924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdae15-c241-4514-8358-6ef42547dd71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:01.075371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdae15-c241-4514-8358-6ef42547dd71 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:01.089472 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 383/755] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:01.090368 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdae15-c241-4514-8358-6ef42547dd71 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:01.139733 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:01.141307 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f96a82-2d02-461b-add6-902de9bf8f8c None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:01.183437 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc7d39-8911-4ba0-a2ba-03bd1948918a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:01.184476 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc7d39-8911-4ba0-a2ba-03bd1948918a None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:01.184953 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc7d39-8911-4ba0-a2ba-03bd1948918a None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:01.185486 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc7d39-8911-4ba0-a2ba-03bd1948918a None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:01.186439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc7d39-8911-4ba0-a2ba-03bd1948918a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:01.186981 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc7d39-8911-4ba0-a2ba-03bd1948918a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:01.188612 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc7d39-8911-4ba0-a2ba-03bd1948918a None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:01.199192 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdae15-c241-4514-8358-6ef42547dd71 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:01.202883 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 373/756] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:01.203983 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc7d39-8911-4ba0-a2ba-03bd1948918a None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:01.236680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d2431-256c-4575-802d-9a0e9c2dd69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:01.237298 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d2431-256c-4575-802d-9a0e9c2dd69b None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:01.237623 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d2431-256c-4575-802d-9a0e9c2dd69b None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:01.237905 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d2431-256c-4575-802d-9a0e9c2dd69b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:01.238645 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d2431-256c-4575-802d-9a0e9c2dd69b None admin] RBAC: Adding query filter params (role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2, scope.project.id=4416325d266642f3a786ff9f16c827aa, user.id=40d2202203204b06a41e57b9d1a300fc) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:01.238953 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d2431-256c-4575-802d-9a0e9c2dd69b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:01.240405 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d2431-256c-4575-802d-9a0e9c2dd69b None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:01.246590 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 384/757] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:36:01 2022] GET /identity/v3/role_assignments?user.id=40d2202203204b06a41e57b9d1a300fc&scope.project.id=4416325d266642f3a786ff9f16c827aa&role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:01.247514 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d2431-256c-4575-802d-9a0e9c2dd69b None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:01.275741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:01.339705 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc7d39-8911-4ba0-a2ba-03bd1948918a None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:01.384031 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b44b05-1e5d-48bf-9248-65bc99b35fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:01.384713 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b44b05-1e5d-48bf-9248-65bc99b35fcf None admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:01.384996 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b44b05-1e5d-48bf-9248-65bc99b35fcf None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:01.385830 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b44b05-1e5d-48bf-9248-65bc99b35fcf None admin] PATH_INFO: `/v3/projects/4416325d266642f3a786ff9f16c827aa/users/5bdbda2b9c8f48338c5117585a229cb6/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:01.388339 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b44b05-1e5d-48bf-9248-65bc99b35fcf None admin] RBAC: Authorizing `identity:create_grant(project_id=4416325d266642f3a786ff9f16c827aa, user_id=5bdbda2b9c8f48338c5117585a229cb6, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:01.390023 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b44b05-1e5d-48bf-9248-65bc99b35fcf None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:01.390189 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d2431-256c-4575-802d-9a0e9c2dd69b None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:01.406524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:01.417104 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 374/758] 10.222.0.94 () {58 vars in 1439 bytes} [Wed Aug 24 04:36:01 2022] PUT /identity/v3/projects/4416325d266642f3a786ff9f16c827aa/users/5bdbda2b9c8f48338c5117585a229cb6/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:01.418725 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b79782-46c6-4ed1-88cc-9aaba6ef7924 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:01.419015 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b79782-46c6-4ed1-88cc-9aaba6ef7924 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:01.419287 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b79782-46c6-4ed1-88cc-9aaba6ef7924 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:01.421121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 375/759] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:01.433465 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8728958-e787-4919-b5ff-80161b3869f0 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:01.433465 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8728958-e787-4919-b5ff-80161b3869f0 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:01.433465 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8728958-e787-4919-b5ff-80161b3869f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:01.461782 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-f8728958-e787-4919-b5ff-80161b3869f0 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:01.464886 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-f8728958-e787-4919-b5ff-80161b3869f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:01.470458 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3184dd8-7de6-4bfb-8a59-6412ed5fb6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:01.472093 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3184dd8-7de6-4bfb-8a59-6412ed5fb6b6 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:01.473044 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3184dd8-7de6-4bfb-8a59-6412ed5fb6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:01.473868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3184dd8-7de6-4bfb-8a59-6412ed5fb6b6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:01.492635 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3184dd8-7de6-4bfb-8a59-6412ed5fb6b6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:01.496308 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3184dd8-7de6-4bfb-8a59-6412ed5fb6b6 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:01.523611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-e3184dd8-7de6-4bfb-8a59-6412ed5fb6b6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:36:01.523611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:01.523611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:01.523611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:01.523611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:01.523611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:01.523611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:01.523611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:01.523611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:01.523611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:01.523611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:01.523611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:01.523611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:01.523611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:01.523611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:01.523611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:01.526945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:01.526945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:01.526945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:01.526945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:01.526945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:01.526945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:01.526945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:01.526945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:01.526945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:01.526945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:01.526945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:01.526945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:01.526945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:01.526945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:01.526945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:01.526945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:01.526945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:01.526945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:01.529176 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:01.529176 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:01.529176 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:01.529176 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:01.529176 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:01.529176 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:01.529176 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:01.529176 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:01.529176 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:36:01.529176 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:01.533531 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 385/760] 10.222.0.94 () {56 vars in 1117 bytes} [Wed Aug 24 04:36:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:01.541612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3184dd8-7de6-4bfb-8a59-6412ed5fb6b6 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:01.651969 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 376/761] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:01.803580 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3184dd8-7de6-4bfb-8a59-6412ed5fb6b6 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:01.876045 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074f248-0991-4a82-9baf-69933ef2ee8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:01.877096 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074f248-0991-4a82-9baf-69933ef2ee8f None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:01.877658 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074f248-0991-4a82-9baf-69933ef2ee8f None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:01.878127 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074f248-0991-4a82-9baf-69933ef2ee8f None admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:01.879532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074f248-0991-4a82-9baf-69933ef2ee8f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:01.880096 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074f248-0991-4a82-9baf-69933ef2ee8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:01.882897 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074f248-0991-4a82-9baf-69933ef2ee8f None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:01.921603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 386/762] 10.222.0.94 () {56 vars in 1149 bytes} [Wed Aug 24 04:36:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:01.931433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8728958-e787-4919-b5ff-80161b3869f0 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:02.009838 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074f248-0991-4a82-9baf-69933ef2ee8f None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:02.038485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:02.074999 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:02.164748 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8728958-e787-4919-b5ff-80161b3869f0 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:02.237378 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea722b9b-4030-4909-ad3b-c02d1758d583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:02.238457 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea722b9b-4030-4909-ad3b-c02d1758d583 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:02.238947 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea722b9b-4030-4909-ad3b-c02d1758d583 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:02.239424 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea722b9b-4030-4909-ad3b-c02d1758d583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:02.280669 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074f248-0991-4a82-9baf-69933ef2ee8f None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:02.373711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea722b9b-4030-4909-ad3b-c02d1758d583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:02.375132 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea722b9b-4030-4909-ad3b-c02d1758d583 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:02.378722 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8f881-1cb0-44db-9f09-b5423863b62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:02.379385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8f881-1cb0-44db-9f09-b5423863b62e None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:02.379674 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8f881-1cb0-44db-9f09-b5423863b62e None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:02.379926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8f881-1cb0-44db-9f09-b5423863b62e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:02.380518 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8f881-1cb0-44db-9f09-b5423863b62e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:02.381936 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8f881-1cb0-44db-9f09-b5423863b62e None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:02.409455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-45c8f881-1cb0-44db-9f09-b5423863b62e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:36:02.409455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:02.409455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:36:02.409455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:36:02.409455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:36:02.409455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:36:02.409455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:36:02.409455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:02.409455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:36:02.409455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:02.409455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:36:02.409455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:02.409455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:02.409455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:02.409455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:02.409455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:02.409455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:02.411232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:02.411232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:02.411232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:02.411232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:02.411232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:02.411232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:02.411232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:36:02.411232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:36:02.411232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:36:02.411232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:36:02.411232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:02.411232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:02.411232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:02.411232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:02.411232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:02.411232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:02.412297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:02.412297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:02.412297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:02.412297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:02.412297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:02.412297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:02.412297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:02.412297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:02.412297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:02.412297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:02.412297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:36:02.412297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:02.412297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:36:02.412297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:02.424247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 387/763] 10.222.0.94 () {56 vars in 1129 bytes} [Wed Aug 24 04:36:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:02.425807 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8f881-1cb0-44db-9f09-b5423863b62e None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:02.449814 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:02.521435 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 377/764] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:36:02.523301 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea722b9b-4030-4909-ad3b-c02d1758d583 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:02.642664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea722b9b-4030-4909-ad3b-c02d1758d583 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:02.717532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f47db-2eaf-4649-960f-da32ce7479ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:02.718463 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f47db-2eaf-4649-960f-da32ce7479ad None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:02.718777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f47db-2eaf-4649-960f-da32ce7479ad None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:02.718920 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f47db-2eaf-4649-960f-da32ce7479ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:02.748961 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f47db-2eaf-4649-960f-da32ce7479ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:02.754261 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f47db-2eaf-4649-960f-da32ce7479ad None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:02.758022 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:02.789818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:02.802963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8f881-1cb0-44db-9f09-b5423863b62e None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:02.818661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-393f47db-2eaf-4649-960f-da32ce7479ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:02.818661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:02.818661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:02.818661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:02.818661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:02.818661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:02.818661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:02.818661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:02.818661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:02.818661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:02.818661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:02.818661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:02.818661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:02.818661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:02.818661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:02.818661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:02.820269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:02.820269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:02.820269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:02.820269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:02.820269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:02.820269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:02.820269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:02.820269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:02.820269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:02.820269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:02.820269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:02.820269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:02.820269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:02.820269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:02.820269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:02.820269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:02.820269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:02.821919 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:02.821919 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:02.821919 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:02.827092 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 378/765] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:02.845008 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f47db-2eaf-4649-960f-da32ce7479ad None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:02.919535 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b3646-e0ee-4dee-9672-1c8fe91157fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:02.920453 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b3646-e0ee-4dee-9672-1c8fe91157fa None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:02.920453 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b3646-e0ee-4dee-9672-1c8fe91157fa None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:02.920982 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b3646-e0ee-4dee-9672-1c8fe91157fa None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:02.921216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b3646-e0ee-4dee-9672-1c8fe91157fa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:02.925445 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b3646-e0ee-4dee-9672-1c8fe91157fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:02.925824 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b3646-e0ee-4dee-9672-1c8fe91157fa None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:02.939033 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 388/766] 10.222.0.94 () {56 vars in 1124 bytes} [Wed Aug 24 04:36:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 512 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:02.946039 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b3646-e0ee-4dee-9672-1c8fe91157fa None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:03.096524 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f47db-2eaf-4649-960f-da32ce7479ad None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:03.143142 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f2bc7-130a-4717-a71a-f2c6192a527a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:03.143769 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f2bc7-130a-4717-a71a-f2c6192a527a None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:03.144057 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f2bc7-130a-4717-a71a-f2c6192a527a None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:03.144326 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f2bc7-130a-4717-a71a-f2c6192a527a None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:03.145200 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f2bc7-130a-4717-a71a-f2c6192a527a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:03.145503 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f2bc7-130a-4717-a71a-f2c6192a527a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:03.147190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f2bc7-130a-4717-a71a-f2c6192a527a None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:03.167902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 379/767] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:03.169691 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdff0ab-f851-4c0b-82bd-ac8a0a16ba50 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:03.170019 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdff0ab-f851-4c0b-82bd-ac8a0a16ba50 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:03.170252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdff0ab-f851-4c0b-82bd-ac8a0a16ba50 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:03.176620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 380/768] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:03.177660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdff0ab-f851-4c0b-82bd-ac8a0a16ba50 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:03.178178 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b3646-e0ee-4dee-9672-1c8fe91157fa None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:03.250910 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bd9ee-68c3-483d-8ea5-c09146f58b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:03.251970 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bd9ee-68c3-483d-8ea5-c09146f58b85 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:03.252476 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bd9ee-68c3-483d-8ea5-c09146f58b85 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:03.252978 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bd9ee-68c3-483d-8ea5-c09146f58b85 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:03.254178 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bd9ee-68c3-483d-8ea5-c09146f58b85 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:03.254743 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bd9ee-68c3-483d-8ea5-c09146f58b85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:03.255002 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:03.257355 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bd9ee-68c3-483d-8ea5-c09146f58b85 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:03.277369 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 389/769] 10.222.0.94 () {56 vars in 1124 bytes} [Wed Aug 24 04:36:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:03.279929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9796d-b8ea-493a-bf9d-5ffe447dd245 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:03.280432 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9796d-b8ea-493a-bf9d-5ffe447dd245 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:03.280928 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9796d-b8ea-493a-bf9d-5ffe447dd245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:03.310032 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdff0ab-f851-4c0b-82bd-ac8a0a16ba50 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:03.313073 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-a5a9796d-b8ea-493a-bf9d-5ffe447dd245 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:03.314573 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-a5a9796d-b8ea-493a-bf9d-5ffe447dd245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:03.335278 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:03.356047 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683338a-6d35-4a3f-aa20-fc3e0e1dbba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:03.356999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683338a-6d35-4a3f-aa20-fc3e0e1dbba4 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:03.357466 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683338a-6d35-4a3f-aa20-fc3e0e1dbba4 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:03.357888 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683338a-6d35-4a3f-aa20-fc3e0e1dbba4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:03.366274 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683338a-6d35-4a3f-aa20-fc3e0e1dbba4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:03.368020 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683338a-6d35-4a3f-aa20-fc3e0e1dbba4 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:03.381711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-4683338a-6d35-4a3f-aa20-fc3e0e1dbba4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:03.381711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:03.381711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:03.381711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:03.381711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:03.381711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:03.381711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:03.381711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:03.381711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:03.381711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:03.381711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:03.381711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:03.381711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:03.381711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:03.381711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:03.382789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:03.382789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:03.382789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:03.382789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:03.382789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:03.382789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:03.382789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:03.382789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:03.382789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:03.382789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:03.382789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:03.382789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:03.382789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:03.382789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:03.382789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:03.382789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:03.382789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:03.383787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:03.383787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:03.383787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:03.383787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:03.383787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:03.383787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:03.383787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:03.383787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:03.391417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 381/770] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:03.392719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683338a-6d35-4a3f-aa20-fc3e0e1dbba4 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:03.434376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 390/771] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:03.435636 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9796d-b8ea-493a-bf9d-5ffe447dd245 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:03.567378 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683338a-6d35-4a3f-aa20-fc3e0e1dbba4 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:03.605459 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:03.629188 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1dde1d-be8f-40c1-98f9-0a63cc1df402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:03.630250 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1dde1d-be8f-40c1-98f9-0a63cc1df402 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:03.630720 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1dde1d-be8f-40c1-98f9-0a63cc1df402 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:03.631210 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1dde1d-be8f-40c1-98f9-0a63cc1df402 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:03.632109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1dde1d-be8f-40c1-98f9-0a63cc1df402 None admin] RBAC: Adding query filter params (interface=public, service_id=e0f6ecb4a3b44aff9b14a6a75e89bffb, region_id=RegionOne) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:03.632600 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1dde1d-be8f-40c1-98f9-0a63cc1df402 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:03.634198 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1dde1d-be8f-40c1-98f9-0a63cc1df402 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:03.644346 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 382/772] 10.222.0.94 () {56 vars in 1251 bytes} [Wed Aug 24 04:36:03 2022] GET /identity/v3/endpoints?service_id=e0f6ecb4a3b44aff9b14a6a75e89bffb&interface=public®ion_id=RegionOne => generated 194 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:03.672741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1dde1d-be8f-40c1-98f9-0a63cc1df402 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:03.704279 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9796d-b8ea-493a-bf9d-5ffe447dd245 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:03.762991 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc566bd3-717b-451e-ae3e-343dbcd227e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:03.763630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc566bd3-717b-451e-ae3e-343dbcd227e3 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:03.763942 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc566bd3-717b-451e-ae3e-343dbcd227e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:03.764203 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc566bd3-717b-451e-ae3e-343dbcd227e3 None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:03.764886 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc566bd3-717b-451e-ae3e-343dbcd227e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:03.765194 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc566bd3-717b-451e-ae3e-343dbcd227e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:03.766714 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc566bd3-717b-451e-ae3e-343dbcd227e3 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:03.779634 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 391/773] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:03.798909 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc566bd3-717b-451e-ae3e-343dbcd227e3 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:03.822958 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:03.899126 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1dde1d-be8f-40c1-98f9-0a63cc1df402 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:03.929608 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc566bd3-717b-451e-ae3e-343dbcd227e3 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:03.967506 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960a78b-6c2e-4af6-a1b2-ff77f456f860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:03.968479 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960a78b-6c2e-4af6-a1b2-ff77f456f860 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:03.968921 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960a78b-6c2e-4af6-a1b2-ff77f456f860 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:03.969429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960a78b-6c2e-4af6-a1b2-ff77f456f860 None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:03.970477 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960a78b-6c2e-4af6-a1b2-ff77f456f860 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:03.972747 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960a78b-6c2e-4af6-a1b2-ff77f456f860 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:03.973559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f877d98-c4a8-4c62-a62a-bc6724fd36ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:03.974322 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f877d98-c4a8-4c62-a62a-bc6724fd36ff None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:03.974744 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f877d98-c4a8-4c62-a62a-bc6724fd36ff None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:03.975086 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f877d98-c4a8-4c62-a62a-bc6724fd36ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:03.976063 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f877d98-c4a8-4c62-a62a-bc6724fd36ff None admin] RBAC: Adding query filter params (role.id=5e5c4aa158a845b981b0e847f8bd47a6, scope.project.id=4416325d266642f3a786ff9f16c827aa, user.id=7caa973c63e64d639cc2fb55a4955542) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:03.976444 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f877d98-c4a8-4c62-a62a-bc6724fd36ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:03.978044 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f877d98-c4a8-4c62-a62a-bc6724fd36ff None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:03.983565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 383/774] 10.222.0.94 () {56 vars in 1087 bytes} [Wed Aug 24 04:36:03 2022] GET /identity/v3/services => generated 772 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:03.985004 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960a78b-6c2e-4af6-a1b2-ff77f456f860 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:03.991859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 392/775] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:36:03 2022] GET /identity/v3/role_assignments?user.id=7caa973c63e64d639cc2fb55a4955542&scope.project.id=4416325d266642f3a786ff9f16c827aa&role.id=5e5c4aa158a845b981b0e847f8bd47a6 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:04.082071 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:04.198685 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960a78b-6c2e-4af6-a1b2-ff77f456f860 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:04.245162 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f4af0-67d8-4d28-b5c5-c59bf159a1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:04.245745 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f4af0-67d8-4d28-b5c5-c59bf159a1f8 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:04.246027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f4af0-67d8-4d28-b5c5-c59bf159a1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:04.246275 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f4af0-67d8-4d28-b5c5-c59bf159a1f8 None admin] PATH_INFO: `/v3/services/network` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:04.246875 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f4af0-67d8-4d28-b5c5-c59bf159a1f8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:04.248300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f4af0-67d8-4d28-b5c5-c59bf159a1f8 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:04.258438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-3d6f4af0-67d8-4d28-b5c5-c59bf159a1f8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:36:04.258438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:04.258438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:36:04.258438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:36:04.258438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:36:04.258438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:36:04.258438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:36:04.258438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:04.258438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:36:04.258438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:04.258438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:36:04.258438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:04.258438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:04.258438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:04.258438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:04.258438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:04.258438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:04.262647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:04.262647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:04.262647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:04.262647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:04.262647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:04.262647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:04.262647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:36:04.262647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:36:04.262647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:36:04.262647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:36:04.262647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:04.262647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:04.262647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:04.262647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:04.262647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:04.262647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:04.265270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:04.265270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:04.265270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:04.265270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:04.265270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:04.265270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:04.265270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:04.265270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:04.265270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:04.265270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:04.265270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:36:04.265270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:04.265270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:36:04.265270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:04.265270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 384/776] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:03 2022] GET /identity/v3/services/network => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:04.273768 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f877d98-c4a8-4c62-a62a-bc6724fd36ff None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:04.377974 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:04.413452 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85436e14-c6ab-4007-b190-b7c82fa489e7 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:04.413932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85436e14-c6ab-4007-b190-b7c82fa489e7 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:04.414344 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85436e14-c6ab-4007-b190-b7c82fa489e7 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:04.417285 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 385/777] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:04.435407 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd13ca-5f16-4013-997c-9b011b254e04 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:04.436019 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd13ca-5f16-4013-997c-9b011b254e04 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:04.436550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd13ca-5f16-4013-997c-9b011b254e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:04.466574 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f877d98-c4a8-4c62-a62a-bc6724fd36ff None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:04.486839 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-5afd13ca-5f16-4013-997c-9b011b254e04 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:04.488116 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-5afd13ca-5f16-4013-997c-9b011b254e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:04.572822 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58a379-d2a9-476b-8f2a-8660b0f29b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:04.573799 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58a379-d2a9-476b-8f2a-8660b0f29b59 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:04.574089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58a379-d2a9-476b-8f2a-8660b0f29b59 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:04.574363 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58a379-d2a9-476b-8f2a-8660b0f29b59 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:04.575029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58a379-d2a9-476b-8f2a-8660b0f29b59 None admin] RBAC: Adding query filter params (name=network) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:04.575330 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58a379-d2a9-476b-8f2a-8660b0f29b59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:04.576944 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58a379-d2a9-476b-8f2a-8660b0f29b59 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:04.584408 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 393/778] 10.222.0.94 () {56 vars in 1112 bytes} [Wed Aug 24 04:36:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:04.585878 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae97f19-99f4-4d29-bb2d-b3d090786c4d None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:04.586224 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae97f19-99f4-4d29-bb2d-b3d090786c4d None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:04.586502 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae97f19-99f4-4d29-bb2d-b3d090786c4d None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:04.592488 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 394/779] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:04.593883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bf316-362c-4509-900c-a1fdc9555e3a None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:04.594176 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bf316-362c-4509-900c-a1fdc9555e3a None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:04.594441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bf316-362c-4509-900c-a1fdc9555e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:04.618695 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-b39bf316-362c-4509-900c-a1fdc9555e3a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:04.621298 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-b39bf316-362c-4509-900c-a1fdc9555e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:04.651422 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 386/780] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:04.652362 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd13ca-5f16-4013-997c-9b011b254e04 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:04.704697 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:04.798210 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd13ca-5f16-4013-997c-9b011b254e04 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:04.810846 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 395/781] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:36:04.881772 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f3dc9-e4de-4afb-b106-9d776c449165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:04.882674 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f3dc9-e4de-4afb-b106-9d776c449165 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:04.883148 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f3dc9-e4de-4afb-b106-9d776c449165 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:04.883628 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f3dc9-e4de-4afb-b106-9d776c449165 None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:04.885870 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f3dc9-e4de-4afb-b106-9d776c449165 None admin] RBAC: Adding query filter params (type=network) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:04.886617 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f3dc9-e4de-4afb-b106-9d776c449165 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:04.889303 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f3dc9-e4de-4afb-b106-9d776c449165 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:04.909260 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 387/782] 10.222.0.94 () {56 vars in 1112 bytes} [Wed Aug 24 04:36:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:04.918562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39bf316-362c-4509-900c-a1fdc9555e3a None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:05.026754 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:05.088633 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39bf316-362c-4509-900c-a1fdc9555e3a None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:05.146956 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d61c5-3a61-4f5e-888a-972bc83b5f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:05.147510 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d61c5-3a61-4f5e-888a-972bc83b5f0f None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:05.147792 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d61c5-3a61-4f5e-888a-972bc83b5f0f None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:05.148147 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d61c5-3a61-4f5e-888a-972bc83b5f0f None admin] PATH_INFO: `/v3/endpoints` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:05.148988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d61c5-3a61-4f5e-888a-972bc83b5f0f None admin] RBAC: Adding query filter params (interface=public, service_id=c7e65bd07e6d4346a75d16eacc764381, region_id=RegionOne) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:05.149347 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d61c5-3a61-4f5e-888a-972bc83b5f0f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:05.150974 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d61c5-3a61-4f5e-888a-972bc83b5f0f None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:05.162102 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f3dc9-e4de-4afb-b106-9d776c449165 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:05.165054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 396/783] 10.222.0.94 () {56 vars in 1251 bytes} [Wed Aug 24 04:36:04 2022] GET /identity/v3/endpoints?service_id=c7e65bd07e6d4346a75d16eacc764381&interface=public®ion_id=RegionOne => generated 194 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:05.172437 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d61c5-3a61-4f5e-888a-972bc83b5f0f None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:05.336922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d61c5-3a61-4f5e-888a-972bc83b5f0f None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:05.372399 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f3dc9-e4de-4afb-b106-9d776c449165 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:05.376450 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:05.404363 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:05.414124 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79882d7b-26de-4af4-a355-50fa684f018c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:05.415215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79882d7b-26de-4af4-a355-50fa684f018c None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:05.415603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79882d7b-26de-4af4-a355-50fa684f018c None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:05.417560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79882d7b-26de-4af4-a355-50fa684f018c None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:05.418619 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79882d7b-26de-4af4-a355-50fa684f018c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:05.420684 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79882d7b-26de-4af4-a355-50fa684f018c None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:05.427399 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec0254-2bcb-4e10-9646-c874a25b0958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:05.428379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec0254-2bcb-4e10-9646-c874a25b0958 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:05.428893 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec0254-2bcb-4e10-9646-c874a25b0958 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:05.429386 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec0254-2bcb-4e10-9646-c874a25b0958 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:05.433653 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 397/784] 10.222.0.94 () {56 vars in 1087 bytes} [Wed Aug 24 04:36:05 2022] GET /identity/v3/services => generated 772 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:05.436056 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79882d7b-26de-4af4-a355-50fa684f018c None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:05.460329 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec0254-2bcb-4e10-9646-c874a25b0958 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:05.467374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-a5ec0254-2bcb-4e10-9646-c874a25b0958 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:36:05.467374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:05.467374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:05.467374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:05.467374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:05.467374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:05.467374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:05.467374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:05.467374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:05.467374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:05.467374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:05.467374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:05.467374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:05.467374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:05.467374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:05.467374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:05.468515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:05.468515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:05.468515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:05.468515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:05.468515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:05.468515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:05.468515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:05.468515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:05.468515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:05.468515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:05.468515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:05.468515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:05.468515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:05.468515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:05.468515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:05.468515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:05.469474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:05.469474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:05.469474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:05.469474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:05.469474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:05.469474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:05.469474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:05.469474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:05.469474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:05.469474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:05.469474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:36:05.469474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:05.480088 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 388/785] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:36:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:05.486634 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec0254-2bcb-4e10-9646-c874a25b0958 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:05.708540 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79882d7b-26de-4af4-a355-50fa684f018c None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:05.708840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec0254-2bcb-4e10-9646-c874a25b0958 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:05.761561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85388dd-26e2-4d35-a068-047dcb24474b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:05.762031 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85388dd-26e2-4d35-a068-047dcb24474b None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:05.762272 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85388dd-26e2-4d35-a068-047dcb24474b None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:05.762552 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85388dd-26e2-4d35-a068-047dcb24474b None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:05.765516 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85388dd-26e2-4d35-a068-047dcb24474b None admin] RBAC: Adding query filter params (name=admin) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:05.765516 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85388dd-26e2-4d35-a068-047dcb24474b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:05.765516 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85388dd-26e2-4d35-a068-047dcb24474b None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:05.783233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abb8c8-2145-446c-8b7b-f3b01552105a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:05.783899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abb8c8-2145-446c-8b7b-f3b01552105a None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:05.784173 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abb8c8-2145-446c-8b7b-f3b01552105a None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:05.784450 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abb8c8-2145-446c-8b7b-f3b01552105a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:05.799794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 389/786] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:05.805291 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07abb8c8-2145-446c-8b7b-f3b01552105a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:05.810567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85388dd-26e2-4d35-a068-047dcb24474b None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:05.812650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-07abb8c8-2145-446c-8b7b-f3b01552105a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:36:05.812650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:05.812650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:05.812650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:05.812650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:05.812650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:05.812650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:05.812650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:05.812650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:05.812650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:05.812650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:05.812650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:05.812650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:05.812650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:05.812650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:05.812650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:05.815383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:05.815383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:05.815383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:05.815383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:05.815383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:05.815383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:05.815383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:05.815383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:05.815383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:05.815383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:05.815383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:05.815383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:05.815383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:05.815383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:05.815383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:05.815383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:05.818592 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:05.818592 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:05.818592 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:05.818592 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:05.818592 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:05.818592 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:05.818592 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:05.818592 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:05.818592 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:05.818592 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:05.818592 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:36:05.818592 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:05.818592 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 398/787] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:36:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:05.826471 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abb8c8-2145-446c-8b7b-f3b01552105a None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:05.889648 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:06.002363 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85388dd-26e2-4d35-a068-047dcb24474b None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:06.011327 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:06.076161 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ef438-e5b1-44bc-b6ac-6d94c118d878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:06.076161 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ef438-e5b1-44bc-b6ac-6d94c118d878 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:06.076161 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ef438-e5b1-44bc-b6ac-6d94c118d878 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:06.076161 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ef438-e5b1-44bc-b6ac-6d94c118d878 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:06.113591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ef438-e5b1-44bc-b6ac-6d94c118d878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:06.116798 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ef438-e5b1-44bc-b6ac-6d94c118d878 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:06.173367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-448ef438-e5b1-44bc-b6ac-6d94c118d878 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:06.173367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:06.173367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:06.173367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:06.173367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:06.173367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:06.173367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:06.173367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:06.173367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:06.173367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:06.173367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:06.173367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:06.173367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:06.173367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:06.173367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:06.173367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:06.175218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:06.175218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:06.175218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:06.175218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:06.175218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:06.175218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:06.175218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:06.175218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:06.175218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:06.175218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:06.175218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:06.175218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:06.175218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:06.175218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:06.175218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:06.175218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:06.175218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:06.177132 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:06.177132 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:06.177132 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:06.177132 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 390/788] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:06.185199 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abb8c8-2145-446c-8b7b-f3b01552105a None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:06.186045 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ef438-e5b1-44bc-b6ac-6d94c118d878 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:06.253212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b6249-8974-4a2a-8a87-96fa2917c383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:06.254677 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b6249-8974-4a2a-8a87-96fa2917c383 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:06.255450 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b6249-8974-4a2a-8a87-96fa2917c383 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:06.256224 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b6249-8974-4a2a-8a87-96fa2917c383 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:06.257760 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b6249-8974-4a2a-8a87-96fa2917c383 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:06.258626 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b6249-8974-4a2a-8a87-96fa2917c383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:06.262014 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b6249-8974-4a2a-8a87-96fa2917c383 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:06.282477 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 399/789] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:06.289470 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b6249-8974-4a2a-8a87-96fa2917c383 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:06.446147 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:06.491219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ef438-e5b1-44bc-b6ac-6d94c118d878 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:06.521097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b6249-8974-4a2a-8a87-96fa2917c383 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:06.541544 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:06.567703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb98c3e-c929-49f2-afb0-93e7636cb6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:06.568362 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb98c3e-c929-49f2-afb0-93e7636cb6dc None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:06.568645 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb98c3e-c929-49f2-afb0-93e7636cb6dc None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:06.568906 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb98c3e-c929-49f2-afb0-93e7636cb6dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:06.589019 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb98c3e-c929-49f2-afb0-93e7636cb6dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:06.590813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb98c3e-c929-49f2-afb0-93e7636cb6dc None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:06.606580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2e0d4-8c93-4df8-9608-492e4dd74529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:06.607365 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2e0d4-8c93-4df8-9608-492e4dd74529 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:06.607658 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2e0d4-8c93-4df8-9608-492e4dd74529 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:06.608011 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2e0d4-8c93-4df8-9608-492e4dd74529 None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:06.608789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2e0d4-8c93-4df8-9608-492e4dd74529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:06.609095 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2e0d4-8c93-4df8-9608-492e4dd74529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:06.609207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-ebb98c3e-c929-49f2-afb0-93e7636cb6dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:06.609207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:06.609207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:06.609207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:06.609207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:06.609207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:06.609207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:06.609207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:06.609207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:06.609207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:06.609207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:06.609207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:06.609207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:06.609207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:06.609207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:06.609207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:06.610486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:06.610486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:06.610486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:06.610486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:06.610486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:06.610486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:06.610486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:06.610486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:06.610486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:06.610486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:06.610486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:06.610486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:06.610486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:06.610486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:06.610486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:06.610486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:06.610486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:06.611799 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:06.611799 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:06.611799 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:06.611799 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 400/790] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:06.612117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2e0d4-8c93-4df8-9608-492e4dd74529 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:06.624100 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb98c3e-c929-49f2-afb0-93e7636cb6dc None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:06.648695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 391/791] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:06.657112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2e0d4-8c93-4df8-9608-492e4dd74529 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:06.853899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb98c3e-c929-49f2-afb0-93e7636cb6dc None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:06.928679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2e0d4-8c93-4df8-9608-492e4dd74529 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:06.936300 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250144f5-3848-43d8-9ef9-5c48348980de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:06.937347 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250144f5-3848-43d8-9ef9-5c48348980de None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:06.937989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250144f5-3848-43d8-9ef9-5c48348980de None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:06.938535 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250144f5-3848-43d8-9ef9-5c48348980de None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:06.940390 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250144f5-3848-43d8-9ef9-5c48348980de None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:06.941099 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250144f5-3848-43d8-9ef9-5c48348980de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:06.943307 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250144f5-3848-43d8-9ef9-5c48348980de None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:06.966818 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 401/792] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:06.969297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb2a5c-5580-4648-94a6-b25e0dd4e3a6 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:06.970035 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb2a5c-5580-4648-94a6-b25e0dd4e3a6 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:06.970645 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb2a5c-5580-4648-94a6-b25e0dd4e3a6 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:06.972806 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 402/793] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:06.974168 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb2a5c-5580-4648-94a6-b25e0dd4e3a6 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:06.982793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b95069-9665-46d3-83d2-4c72171b3760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:06.983572 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b95069-9665-46d3-83d2-4c72171b3760 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:06.983908 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b95069-9665-46d3-83d2-4c72171b3760 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:06.984305 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b95069-9665-46d3-83d2-4c72171b3760 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:06.996932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b95069-9665-46d3-83d2-4c72171b3760 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:06.999420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b95069-9665-46d3-83d2-4c72171b3760 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:07.002244 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:07.020221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-71b95069-9665-46d3-83d2-4c72171b3760 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:36:07.020221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:07.020221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:07.020221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:07.020221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:07.020221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:07.020221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:07.020221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:07.020221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:07.020221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:07.020221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:07.020221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:07.020221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:07.020221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:07.020221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:07.020221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:07.022862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:07.022862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:07.022862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:07.022862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:07.022862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:07.022862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:07.022862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:07.022862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:07.022862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:07.022862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:07.022862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:07.022862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:07.022862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:07.022862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:07.022862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:07.022862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:07.022862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:07.022862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:07.024688 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:07.024688 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:07.024688 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:07.024688 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:07.024688 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:07.024688 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:07.024688 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:07.024688 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:07.024688 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:36:07.024688 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:07.028244 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 392/794] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:36:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:07.028816 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e8b8a-6add-4c6e-9df6-b9e6eef9688e None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:07.030448 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e8b8a-6add-4c6e-9df6-b9e6eef9688e None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:07.030448 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e8b8a-6add-4c6e-9df6-b9e6eef9688e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:07.039860 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:07.061286 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-1d5e8b8a-6add-4c6e-9df6-b9e6eef9688e None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:07.062690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-1d5e8b8a-6add-4c6e-9df6-b9e6eef9688e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:07.192916 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb2a5c-5580-4648-94a6-b25e0dd4e3a6 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:07.201931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 393/795] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:07.203125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e8b8a-6add-4c6e-9df6-b9e6eef9688e None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:07.266317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790b29e-81c2-4549-88a1-ec2feefbc5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:07.267751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790b29e-81c2-4549-88a1-ec2feefbc5c5 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:07.268253 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790b29e-81c2-4549-88a1-ec2feefbc5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:07.268757 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790b29e-81c2-4549-88a1-ec2feefbc5c5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:07.284292 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7790b29e-81c2-4549-88a1-ec2feefbc5c5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:07.287747 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7790b29e-81c2-4549-88a1-ec2feefbc5c5 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:07.314887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-7790b29e-81c2-4549-88a1-ec2feefbc5c5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:36:07.314887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:07.314887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:07.314887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:07.314887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:07.314887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:07.314887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:07.314887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:07.314887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:07.314887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:07.314887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:07.314887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:07.314887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:07.314887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:07.314887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:07.314887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:07.316826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:07.316826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:07.316826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:07.316826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:07.316826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:07.316826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:07.316826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:07.316826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:07.316826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:07.316826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:07.316826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:07.316826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:07.316826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:07.316826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:07.316826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:07.316826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:07.316826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:07.316826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:07.319803 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:07.319803 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:07.319803 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:07.319803 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:07.319803 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:07.319803 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:07.319803 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:07.319803 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:07.319803 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:36:07.319803 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:07.325183 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 403/796] 10.222.0.94 () {56 vars in 1093 bytes} [Wed Aug 24 04:36:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:07.328101 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ab65e-1c97-4a3e-be7e-4f70db945da6 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:07.329043 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ab65e-1c97-4a3e-be7e-4f70db945da6 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:07.330279 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ab65e-1c97-4a3e-be7e-4f70db945da6 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:07.333670 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 404/797] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:07.335613 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ab65e-1c97-4a3e-be7e-4f70db945da6 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:07.448481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e8b8a-6add-4c6e-9df6-b9e6eef9688e None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:07.515297 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:07.531802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821d482-4662-41c0-b310-c69092a47db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:07.533301 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821d482-4662-41c0-b310-c69092a47db0 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:07.533943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821d482-4662-41c0-b310-c69092a47db0 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:07.534467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821d482-4662-41c0-b310-c69092a47db0 None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:07.535971 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821d482-4662-41c0-b310-c69092a47db0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:07.536528 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821d482-4662-41c0-b310-c69092a47db0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:07.537927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:07.540589 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821d482-4662-41c0-b310-c69092a47db0 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:07.564692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ab65e-1c97-4a3e-be7e-4f70db945da6 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:07.574505 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 394/798] 10.222.0.94 () {56 vars in 1135 bytes} [Wed Aug 24 04:36:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:07.576770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a558cac-35c5-4174-a56f-3665d3fa7f4e None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:07.577195 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a558cac-35c5-4174-a56f-3665d3fa7f4e None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:07.577704 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a558cac-35c5-4174-a56f-3665d3fa7f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:07.608410 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-4a558cac-35c5-4174-a56f-3665d3fa7f4e None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:07.610584 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-4a558cac-35c5-4174-a56f-3665d3fa7f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:07.615622 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d87534-c588-4045-920b-a94b90336433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:07.617484 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d87534-c588-4045-920b-a94b90336433 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:07.617484 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d87534-c588-4045-920b-a94b90336433 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:07.617484 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d87534-c588-4045-920b-a94b90336433 None admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:07.617928 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d87534-c588-4045-920b-a94b90336433 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:07.618264 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d87534-c588-4045-920b-a94b90336433 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:07.620210 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d87534-c588-4045-920b-a94b90336433 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:07.643242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 405/799] 10.222.0.94 () {56 vars in 1133 bytes} [Wed Aug 24 04:36:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:07.648684 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d87534-c588-4045-920b-a94b90336433 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:07.715956 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 395/800] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:07.717974 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a558cac-35c5-4174-a56f-3665d3fa7f4e None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:07.803298 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d87534-c588-4045-920b-a94b90336433 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:07.852433 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71067581-11b1-4204-b96a-13ac52e23621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:07.853102 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71067581-11b1-4204-b96a-13ac52e23621 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:07.855216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71067581-11b1-4204-b96a-13ac52e23621 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:07.855529 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71067581-11b1-4204-b96a-13ac52e23621 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:07.870764 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71067581-11b1-4204-b96a-13ac52e23621 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:07.876857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-71067581-11b1-4204-b96a-13ac52e23621 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:07.876857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:07.876857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:07.876857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:07.876857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:07.876857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:07.876857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:07.876857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:07.876857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:07.876857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:07.876857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:07.876857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:07.876857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:07.876857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:07.876857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:07.876857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:07.879466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:07.879466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:07.879466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:07.879466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:07.879466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:07.879466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:07.879466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:07.879466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:07.879466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:07.879466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:07.879466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:07.879466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:07.879466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:07.879466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:07.879466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:07.879466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:07.880883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:07.880883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:07.880883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:07.880883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:07.880883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:07.880883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:07.880883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:07.880883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:07.880883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:07.880883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:07.880883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:07.880883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:07.880883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 406/801] 10.222.0.94 () {56 vars in 1102 bytes} [Wed Aug 24 04:36:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:07.880883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71067581-11b1-4204-b96a-13ac52e23621 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:07.904284 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:07.917834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a558cac-35c5-4174-a56f-3665d3fa7f4e None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:07.939792 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:07.965525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669693f-a00f-4383-9d7c-7516521a01c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:07.966250 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669693f-a00f-4383-9d7c-7516521a01c9 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:07.966508 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669693f-a00f-4383-9d7c-7516521a01c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:07.966788 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669693f-a00f-4383-9d7c-7516521a01c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:07.981266 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669693f-a00f-4383-9d7c-7516521a01c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:07.982808 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669693f-a00f-4383-9d7c-7516521a01c9 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:08.001764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-0669693f-a00f-4383-9d7c-7516521a01c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:08.001764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:08.001764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:08.001764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:08.001764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:08.001764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:08.001764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:08.001764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:08.001764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:08.001764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:08.001764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:08.001764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:08.001764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:08.001764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:08.001764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:08.001764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:08.003227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:08.003227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:08.003227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:08.003227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:08.003227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:08.003227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:08.003227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:08.003227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:08.003227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:08.003227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:08.003227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:08.003227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:08.003227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:08.003227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:08.003227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:08.003227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:08.003227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:08.005204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:08.005204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:08.005204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:08.007805 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 396/802] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:08.008764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669693f-a00f-4383-9d7c-7516521a01c9 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:08.099338 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71067581-11b1-4204-b96a-13ac52e23621 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:08.149667 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669693f-a00f-4383-9d7c-7516521a01c9 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:08.150350 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea985931-fc2e-402e-85b0-cdba79bc0e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:08.151415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea985931-fc2e-402e-85b0-cdba79bc0e68 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:08.151989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea985931-fc2e-402e-85b0-cdba79bc0e68 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:08.152175 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea985931-fc2e-402e-85b0-cdba79bc0e68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:08.205361 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd01557-ab5f-4845-b862-cc0b2fac908b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:08.206347 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd01557-ab5f-4845-b862-cc0b2fac908b None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:08.206796 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd01557-ab5f-4845-b862-cc0b2fac908b None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:08.207260 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd01557-ab5f-4845-b862-cc0b2fac908b None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:08.208486 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd01557-ab5f-4845-b862-cc0b2fac908b None admin] RBAC: Adding query filter params (name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:08.208964 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd01557-ab5f-4845-b862-cc0b2fac908b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:08.211280 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd01557-ab5f-4845-b862-cc0b2fac908b None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:08.235272 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 397/803] 10.222.0.94 () {56 vars in 1103 bytes} [Wed Aug 24 04:36:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:08.235272 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd01557-ab5f-4845-b862-cc0b2fac908b None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:08.242896 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea985931-fc2e-402e-85b0-cdba79bc0e68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:08.245198 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea985931-fc2e-402e-85b0-cdba79bc0e68 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:08.255882 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:08.391795 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 407/804] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:36:08.393385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea985931-fc2e-402e-85b0-cdba79bc0e68 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:08.407880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:08.508037 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd01557-ab5f-4845-b862-cc0b2fac908b None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:08.539465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea985931-fc2e-402e-85b0-cdba79bc0e68 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:08.553227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:08.555538 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5674f-17e9-4b81-ad33-51fa144f23d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:08.556323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5674f-17e9-4b81-ad33-51fa144f23d6 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:08.557579 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5674f-17e9-4b81-ad33-51fa144f23d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:08.557579 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5674f-17e9-4b81-ad33-51fa144f23d6 None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:08.558221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5674f-17e9-4b81-ad33-51fa144f23d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:08.558537 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5674f-17e9-4b81-ad33-51fa144f23d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:08.559949 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5674f-17e9-4b81-ad33-51fa144f23d6 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:08.574472 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 398/805] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:08.576370 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e74601-aab5-4a15-b3d2-ac90c37aa8b4 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:08.576906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e74601-aab5-4a15-b3d2-ac90c37aa8b4 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:08.577247 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e74601-aab5-4a15-b3d2-ac90c37aa8b4 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:08.579321 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 399/806] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:08.580474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e74601-aab5-4a15-b3d2-ac90c37aa8b4 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:08.596510 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eee4cd-4b58-4da5-8c30-39de0d845b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:08.597161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eee4cd-4b58-4da5-8c30-39de0d845b9b None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:08.597473 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eee4cd-4b58-4da5-8c30-39de0d845b9b None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:08.597755 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eee4cd-4b58-4da5-8c30-39de0d845b9b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:08.598349 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eee4cd-4b58-4da5-8c30-39de0d845b9b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:08.599735 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eee4cd-4b58-4da5-8c30-39de0d845b9b None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:08.610451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-73eee4cd-4b58-4da5-8c30-39de0d845b9b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:36:08.610451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:08.610451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:36:08.610451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:36:08.610451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:36:08.610451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:36:08.610451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:36:08.610451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:08.610451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:36:08.610451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:08.610451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:36:08.610451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:08.610451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:08.610451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:08.610451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:08.610451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:08.610451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:08.612161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:08.612161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:08.612161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:08.612161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:08.612161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:08.612161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:08.612161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:36:08.612161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:36:08.612161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:36:08.612161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:36:08.612161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:08.612161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:08.612161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:08.612161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:08.612161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:08.612161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:08.613134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:08.613134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:08.613134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:08.613134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:08.613134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:08.613134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:08.613134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:08.613134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:08.613134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:08.613134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:08.613134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:36:08.613134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:08.613134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:36:08.613134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:08.613134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 408/807] 10.222.0.94 () {56 vars in 1129 bytes} [Wed Aug 24 04:36:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:08.613992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eee4cd-4b58-4da5-8c30-39de0d845b9b None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:08.710992 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:08.736213 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e74601-aab5-4a15-b3d2-ac90c37aa8b4 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:08.747064 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eee4cd-4b58-4da5-8c30-39de0d845b9b None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:08.780263 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90967d16-f7af-49f2-9676-0f8ccbacdc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:08.780913 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90967d16-f7af-49f2-9676-0f8ccbacdc65 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:08.781191 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90967d16-f7af-49f2-9676-0f8ccbacdc65 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:08.781498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90967d16-f7af-49f2-9676-0f8ccbacdc65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:08.793344 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90967d16-f7af-49f2-9676-0f8ccbacdc65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:08.793883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d99e7b-f969-43fb-933c-be9006e6e67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:08.794854 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90967d16-f7af-49f2-9676-0f8ccbacdc65 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:08.794975 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d99e7b-f969-43fb-933c-be9006e6e67d None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:08.795429 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d99e7b-f969-43fb-933c-be9006e6e67d None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:08.795896 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d99e7b-f969-43fb-933c-be9006e6e67d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:08.811690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-90967d16-f7af-49f2-9676-0f8ccbacdc65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:08.811690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:08.811690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:08.811690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:08.811690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:08.811690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:08.811690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:08.811690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:08.811690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:08.811690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:08.811690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:08.811690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:08.811690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:08.811690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:08.811690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:08.811690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:08.813396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:08.813396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:08.813396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:08.813396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:08.813396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:08.813396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:08.813396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:08.813396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:08.813396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:08.813396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:08.813396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:08.813396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:08.813396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:08.813396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:08.813396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:08.813396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:08.813396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:08.815515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:08.815515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:08.815515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:08.815515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 400/808] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:08.815515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90967d16-f7af-49f2-9676-0f8ccbacdc65 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:08.821153 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d99e7b-f969-43fb-933c-be9006e6e67d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:08.824408 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d99e7b-f969-43fb-933c-be9006e6e67d None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:08.845853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-44d99e7b-f969-43fb-933c-be9006e6e67d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:08.845853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:08.845853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:08.845853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:08.845853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:08.845853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:08.845853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:08.845853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:08.845853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:08.845853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:08.845853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:08.845853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:08.845853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:08.845853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:08.845853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:08.845853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:08.847810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:08.847810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:08.847810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:08.847810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:08.847810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:08.847810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:08.847810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:08.847810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:08.847810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:08.847810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:08.847810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:08.847810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:08.847810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:08.847810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:08.847810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:08.847810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:08.847810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:08.849587 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:08.849587 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:08.849587 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:08.849587 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 409/809] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:08.852449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f4421-6762-44f9-84b5-91185cbf7739 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:08.852852 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f4421-6762-44f9-84b5-91185cbf7739 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:08.853130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f4421-6762-44f9-84b5-91185cbf7739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:08.872606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-728f4421-6762-44f9-84b5-91185cbf7739 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:08.873862 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-728f4421-6762-44f9-84b5-91185cbf7739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:08.894341 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:08.966667 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 410/810] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:08.967555 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f4421-6762-44f9-84b5-91185cbf7739 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:08.987819 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90967d16-f7af-49f2-9676-0f8ccbacdc65 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:09.053348 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8045f2-9325-408e-aa32-ecbf85c6f20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:09.054416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8045f2-9325-408e-aa32-ecbf85c6f20d None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:09.055031 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8045f2-9325-408e-aa32-ecbf85c6f20d None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:09.055639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8045f2-9325-408e-aa32-ecbf85c6f20d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:09.069164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8045f2-9325-408e-aa32-ecbf85c6f20d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:09.072913 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8045f2-9325-408e-aa32-ecbf85c6f20d None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:09.094196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-2a8045f2-9325-408e-aa32-ecbf85c6f20d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:09.094196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:09.094196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:09.094196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:09.094196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:09.094196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:09.094196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:09.094196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:09.094196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:09.094196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:09.094196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:09.094196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:09.094196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:09.094196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:09.094196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:09.095744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:09.095744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:09.095744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:09.095744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:09.095744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:09.095744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:09.095744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:09.095744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:09.095744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:09.095744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:09.095744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:09.095744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:09.095744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:09.095744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:09.095744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:09.095744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:09.095744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:09.097137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:09.097137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:09.097137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:09.097137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:09.097137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:09.097137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:09.097137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:09.097137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:09.098010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 401/811] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:09.098464 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8045f2-9325-408e-aa32-ecbf85c6f20d None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:09.101200 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:09.161390 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f4421-6762-44f9-84b5-91185cbf7739 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:09.219792 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f4276-1d6a-482a-a024-a1c5d0842089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:09.220574 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f4276-1d6a-482a-a024-a1c5d0842089 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:09.220993 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f4276-1d6a-482a-a024-a1c5d0842089 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:09.221397 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f4276-1d6a-482a-a024-a1c5d0842089 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:09.222243 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f4276-1d6a-482a-a024-a1c5d0842089 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:09.222680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f4276-1d6a-482a-a024-a1c5d0842089 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:09.224284 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f4276-1d6a-482a-a024-a1c5d0842089 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:09.231792 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 411/812] 10.222.0.94 () {56 vars in 1124 bytes} [Wed Aug 24 04:36:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:09.232822 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f4276-1d6a-482a-a024-a1c5d0842089 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:09.256601 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:09.266299 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8045f2-9325-408e-aa32-ecbf85c6f20d None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:09.308075 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a81d95-380d-43f6-a217-87e06de8bca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:09.308677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a81d95-380d-43f6-a217-87e06de8bca7 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:09.308893 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a81d95-380d-43f6-a217-87e06de8bca7 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:09.309168 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a81d95-380d-43f6-a217-87e06de8bca7 None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:09.309875 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a81d95-380d-43f6-a217-87e06de8bca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:09.310182 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a81d95-380d-43f6-a217-87e06de8bca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:09.311590 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a81d95-380d-43f6-a217-87e06de8bca7 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:09.326509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 402/813] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:09.328026 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a81d95-380d-43f6-a217-87e06de8bca7 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:09.362108 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f4276-1d6a-482a-a024-a1c5d0842089 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:09.406966 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:09.410802 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d4fa1-45a3-4e95-80f5-f718c44bdec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:09.411586 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d4fa1-45a3-4e95-80f5-f718c44bdec2 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:09.411977 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d4fa1-45a3-4e95-80f5-f718c44bdec2 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:09.412391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d4fa1-45a3-4e95-80f5-f718c44bdec2 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:09.413308 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d4fa1-45a3-4e95-80f5-f718c44bdec2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:09.413766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d4fa1-45a3-4e95-80f5-f718c44bdec2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:09.415348 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d4fa1-45a3-4e95-80f5-f718c44bdec2 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:09.428903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 412/814] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:09.429821 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d4fa1-45a3-4e95-80f5-f718c44bdec2 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:09.461859 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a81d95-380d-43f6-a217-87e06de8bca7 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:09.507131 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86edb570-012a-4fdc-92b9-f6d81d6bb193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:09.507892 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edb570-012a-4fdc-92b9-f6d81d6bb193 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:09.508272 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edb570-012a-4fdc-92b9-f6d81d6bb193 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:09.508618 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edb570-012a-4fdc-92b9-f6d81d6bb193 None admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:09.510081 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86edb570-012a-4fdc-92b9-f6d81d6bb193 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:09.510554 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86edb570-012a-4fdc-92b9-f6d81d6bb193 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:09.512414 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86edb570-012a-4fdc-92b9-f6d81d6bb193 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:09.524918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 403/815] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:09.526824 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86edb570-012a-4fdc-92b9-f6d81d6bb193 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:09.535907 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:09.565729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d4fa1-45a3-4e95-80f5-f718c44bdec2 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:09.605186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6d4c0-f36d-4922-8ce5-faed8ca6aee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:09.605996 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6d4c0-f36d-4922-8ce5-faed8ca6aee4 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:09.606170 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6d4c0-f36d-4922-8ce5-faed8ca6aee4 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:09.606442 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6d4c0-f36d-4922-8ce5-faed8ca6aee4 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:09.607092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6d4c0-f36d-4922-8ce5-faed8ca6aee4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:09.607396 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6d4c0-f36d-4922-8ce5-faed8ca6aee4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:09.608803 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6d4c0-f36d-4922-8ce5-faed8ca6aee4 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:09.621017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 413/816] 10.222.0.94 () {56 vars in 1124 bytes} [Wed Aug 24 04:36:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:09.621796 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6d4c0-f36d-4922-8ce5-faed8ca6aee4 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:09.652768 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86edb570-012a-4fdc-92b9-f6d81d6bb193 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:09.679489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:09.697046 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c0f2d-f272-41af-8bd0-35beb45cead9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:09.697997 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c0f2d-f272-41af-8bd0-35beb45cead9 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:09.698554 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c0f2d-f272-41af-8bd0-35beb45cead9 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:09.698677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c0f2d-f272-41af-8bd0-35beb45cead9 None admin] PATH_INFO: `/v3/services/network` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:09.699287 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c0f2d-f272-41af-8bd0-35beb45cead9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:09.700670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c0f2d-f272-41af-8bd0-35beb45cead9 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:09.715695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-b09c0f2d-f272-41af-8bd0-35beb45cead9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:36:09.715695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:09.715695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:36:09.715695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:36:09.715695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:36:09.715695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:36:09.715695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:36:09.715695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:09.715695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:36:09.715695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:09.715695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:36:09.715695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:09.715695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:09.715695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:09.715695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:09.715695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:09.715695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:09.716902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:09.716902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:09.716902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:09.716902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:09.716902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:09.716902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:09.716902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:36:09.716902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:36:09.716902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:36:09.716902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:36:09.716902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:09.716902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:09.716902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:09.716902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:09.716902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:09.716902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:09.718204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:09.718204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:09.718204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:09.718204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:09.718204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:09.718204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:09.718204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:09.718204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:09.718204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:09.718204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:09.718204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:36:09.718204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:09.718204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:36:09.718204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:09.718204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 404/817] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:09 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:09.719394 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c0f2d-f272-41af-8bd0-35beb45cead9 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:09.768627 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6d4c0-f36d-4922-8ce5-faed8ca6aee4 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:09.815105 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f727bf9-1d2c-45ae-a4cc-c3161b934626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:09.816089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f727bf9-1d2c-45ae-a4cc-c3161b934626 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:09.816443 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f727bf9-1d2c-45ae-a4cc-c3161b934626 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:09.816891 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f727bf9-1d2c-45ae-a4cc-c3161b934626 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:09.826294 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f727bf9-1d2c-45ae-a4cc-c3161b934626 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:09.827837 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f727bf9-1d2c-45ae-a4cc-c3161b934626 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:09.830603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:09.841371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-2f727bf9-1d2c-45ae-a4cc-c3161b934626 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:36:09.841371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:09.841371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:09.841371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:09.841371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:09.841371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:09.841371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:09.841371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:09.841371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:09.841371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:09.841371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:09.841371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:09.841371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:09.841371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:09.841371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:09.841371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:09.843213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:09.843213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:09.843213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:09.843213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:09.843213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:09.843213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:09.843213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:09.843213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:09.843213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:09.843213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:09.843213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:09.843213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:09.843213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:09.843213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:09.843213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:09.843213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:09.843213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:09.843213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:09.845022 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:09.845022 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:09.845022 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:09.845022 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:09.845022 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:09.845022 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:09.845022 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:09.845022 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:09.845022 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:36:09.845022 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:09.846408 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c0f2d-f272-41af-8bd0-35beb45cead9 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:09.846561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 414/818] 10.222.0.94 () {56 vars in 1117 bytes} [Wed Aug 24 04:36:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:09.846561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f727bf9-1d2c-45ae-a4cc-c3161b934626 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:09.903503 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6130b66-2568-4adf-881e-c15ca4b923b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:09.904452 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6130b66-2568-4adf-881e-c15ca4b923b7 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:09.904931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6130b66-2568-4adf-881e-c15ca4b923b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:09.905291 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6130b66-2568-4adf-881e-c15ca4b923b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:09.916737 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6130b66-2568-4adf-881e-c15ca4b923b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:09.916737 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6130b66-2568-4adf-881e-c15ca4b923b7 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:09.929084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-f6130b66-2568-4adf-881e-c15ca4b923b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:09.929084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:09.929084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:09.929084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:09.929084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:09.929084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:09.929084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:09.929084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:09.929084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:09.929084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:09.929084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:09.929084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:09.929084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:09.929084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:09.929084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:09.930928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:09.930928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:09.930928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:09.930928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:09.930928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:09.930928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:09.930928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:09.930928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:09.930928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:09.930928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:09.930928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:09.930928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:09.930928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:09.930928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:09.930928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:09.930928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:09.930928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:09.933556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:09.933556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:09.933556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:09.933556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:09.933556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:09.933556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:09.933556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:09.933556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:09.933556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 405/819] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:09.933556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6130b66-2568-4adf-881e-c15ca4b923b7 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:09.986955 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:09.999708 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f727bf9-1d2c-45ae-a4cc-c3161b934626 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:10.062680 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6130b66-2568-4adf-881e-c15ca4b923b7 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:10.083431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13761263-eb44-428e-b3e9-40602e335108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:10.084400 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13761263-eb44-428e-b3e9-40602e335108 None admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:10.084831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13761263-eb44-428e-b3e9-40602e335108 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:10.085362 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13761263-eb44-428e-b3e9-40602e335108 None admin] PATH_INFO: `/v3/projects/4416325d266642f3a786ff9f16c827aa/users/40d2202203204b06a41e57b9d1a300fc/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:10.089840 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13761263-eb44-428e-b3e9-40602e335108 None admin] RBAC: Authorizing `identity:create_grant(project_id=4416325d266642f3a786ff9f16c827aa, user_id=40d2202203204b06a41e57b9d1a300fc, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:10.094482 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13761263-eb44-428e-b3e9-40602e335108 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:10.117869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 415/820] 10.222.0.94 () {58 vars in 1439 bytes} [Wed Aug 24 04:36:09 2022] PUT /identity/v3/projects/4416325d266642f3a786ff9f16c827aa/users/40d2202203204b06a41e57b9d1a300fc/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:10.118544 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cffffc-3064-46cb-8fb1-3df3727b3685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:10.119301 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13761263-eb44-428e-b3e9-40602e335108 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:10.120795 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cffffc-3064-46cb-8fb1-3df3727b3685 None admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:10.121287 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cffffc-3064-46cb-8fb1-3df3727b3685 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:10.121829 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cffffc-3064-46cb-8fb1-3df3727b3685 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:10.123170 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cffffc-3064-46cb-8fb1-3df3727b3685 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:10.125739 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cffffc-3064-46cb-8fb1-3df3727b3685 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:10.167374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 406/821] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:36:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:10.168859 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cffffc-3064-46cb-8fb1-3df3727b3685 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:10.288432 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:10.370707 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13761263-eb44-428e-b3e9-40602e335108 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:10.406187 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:10.413794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cffffc-3064-46cb-8fb1-3df3727b3685 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:10.456816 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343ad85-2529-4843-8050-2ffff15270b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:10.458493 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343ad85-2529-4843-8050-2ffff15270b0 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:10.459322 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343ad85-2529-4843-8050-2ffff15270b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:10.460105 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343ad85-2529-4843-8050-2ffff15270b0 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:10.461301 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51e706-6e7a-452a-b7f8-c331aa62dede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:10.462041 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343ad85-2529-4843-8050-2ffff15270b0 None admin] RBAC: Adding query filter params (name=network) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:10.462348 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51e706-6e7a-452a-b7f8-c331aa62dede None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:10.463482 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343ad85-2529-4843-8050-2ffff15270b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:10.463797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51e706-6e7a-452a-b7f8-c331aa62dede None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:10.463797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51e706-6e7a-452a-b7f8-c331aa62dede None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:10.464956 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51e706-6e7a-452a-b7f8-c331aa62dede None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:10.465815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51e706-6e7a-452a-b7f8-c331aa62dede None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:10.465980 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343ad85-2529-4843-8050-2ffff15270b0 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:10.469261 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51e706-6e7a-452a-b7f8-c331aa62dede None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:10.480394 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 416/822] 10.222.0.94 () {56 vars in 1112 bytes} [Wed Aug 24 04:36:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:10.489929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343ad85-2529-4843-8050-2ffff15270b0 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:10.500483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 407/823] 10.222.0.94 () {56 vars in 1149 bytes} [Wed Aug 24 04:36:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:10.501917 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51e706-6e7a-452a-b7f8-c331aa62dede None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:10.709802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51e706-6e7a-452a-b7f8-c331aa62dede None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:10.731649 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343ad85-2529-4843-8050-2ffff15270b0 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:10.783880 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:10.787362 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97450282-0c03-4d6c-8bd5-397fad4c42c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:10.788422 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97450282-0c03-4d6c-8bd5-397fad4c42c3 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:10.788823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97450282-0c03-4d6c-8bd5-397fad4c42c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:10.789218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97450282-0c03-4d6c-8bd5-397fad4c42c3 None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:10.791365 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97450282-0c03-4d6c-8bd5-397fad4c42c3 None admin] RBAC: Adding query filter params (type=network) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:10.791365 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97450282-0c03-4d6c-8bd5-397fad4c42c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:10.796028 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97450282-0c03-4d6c-8bd5-397fad4c42c3 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:10.809513 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 408/824] 10.222.0.94 () {56 vars in 1112 bytes} [Wed Aug 24 04:36:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:10.809513 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97450282-0c03-4d6c-8bd5-397fad4c42c3 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:10.815616 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98881534-58ac-46e7-92dd-91e7ab9606e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:10.817178 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98881534-58ac-46e7-92dd-91e7ab9606e8 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:10.817894 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98881534-58ac-46e7-92dd-91e7ab9606e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:10.818543 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98881534-58ac-46e7-92dd-91e7ab9606e8 None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:10.820000 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98881534-58ac-46e7-92dd-91e7ab9606e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:10.820785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98881534-58ac-46e7-92dd-91e7ab9606e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:10.825946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98881534-58ac-46e7-92dd-91e7ab9606e8 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:10.842702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:10.851241 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 417/825] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:10.853115 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98881534-58ac-46e7-92dd-91e7ab9606e8 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:11.025688 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97450282-0c03-4d6c-8bd5-397fad4c42c3 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:11.095223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab20696-82ef-44d6-ae4f-21e75c07418b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:11.097957 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab20696-82ef-44d6-ae4f-21e75c07418b None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:11.097957 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab20696-82ef-44d6-ae4f-21e75c07418b None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:11.097957 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab20696-82ef-44d6-ae4f-21e75c07418b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:11.108236 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98881534-58ac-46e7-92dd-91e7ab9606e8 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:11.114827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab20696-82ef-44d6-ae4f-21e75c07418b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:11.116375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab20696-82ef-44d6-ae4f-21e75c07418b None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:11.140922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-fab20696-82ef-44d6-ae4f-21e75c07418b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:11.140922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:11.140922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:11.140922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:11.140922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:11.140922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:11.140922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:11.140922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:11.140922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:11.140922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:11.140922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:11.140922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:11.140922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:11.140922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:11.140922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:11.140922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:11.142802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:11.142802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:11.142802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:11.142802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:11.142802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:11.142802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:11.142802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:11.142802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:11.142802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:11.142802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:11.142802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:11.142802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:11.142802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:11.142802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:11.142802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:11.142802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:11.142802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:11.144538 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:11.144538 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:11.144538 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:11.144538 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 409/826] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:11.144967 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab20696-82ef-44d6-ae4f-21e75c07418b None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:11.187059 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc7446-93fa-4f33-a235-668affa8a57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:11.187925 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc7446-93fa-4f33-a235-668affa8a57e None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:11.188261 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc7446-93fa-4f33-a235-668affa8a57e None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:11.188535 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc7446-93fa-4f33-a235-668affa8a57e None admin] PATH_INFO: `/v3/endpoints` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:11.189360 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc7446-93fa-4f33-a235-668affa8a57e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:11.191883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc7446-93fa-4f33-a235-668affa8a57e None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:11.228976 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 418/827] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:36:10 2022] POST /identity/v3/endpoints => generated 337 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:11.228976 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc7446-93fa-4f33-a235-668affa8a57e None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:11.332432 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:11.353092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:11.410259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab20696-82ef-44d6-ae4f-21e75c07418b None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:11.467301 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5258e1d-40dc-49e6-8860-38de8e9f2532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:11.467912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5258e1d-40dc-49e6-8860-38de8e9f2532 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:11.468237 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5258e1d-40dc-49e6-8860-38de8e9f2532 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:11.468520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5258e1d-40dc-49e6-8860-38de8e9f2532 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:11.469322 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5258e1d-40dc-49e6-8860-38de8e9f2532 None admin] RBAC: Adding query filter params (role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2, scope.project.id=4416325d266642f3a786ff9f16c827aa, user.id=5bdbda2b9c8f48338c5117585a229cb6) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:11.469989 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5258e1d-40dc-49e6-8860-38de8e9f2532 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:11.471759 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5258e1d-40dc-49e6-8860-38de8e9f2532 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:11.480187 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 410/828] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:36:11 2022] GET /identity/v3/role_assignments?user.id=5bdbda2b9c8f48338c5117585a229cb6&scope.project.id=4416325d266642f3a786ff9f16c827aa&role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 608 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:11.555134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc7446-93fa-4f33-a235-668affa8a57e None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:11.601366 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38217c56-2ac5-45db-a4b1-c354fe5d062f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:11.601977 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38217c56-2ac5-45db-a4b1-c354fe5d062f None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:11.602259 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38217c56-2ac5-45db-a4b1-c354fe5d062f None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:11.602535 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38217c56-2ac5-45db-a4b1-c354fe5d062f None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:11.603329 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38217c56-2ac5-45db-a4b1-c354fe5d062f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:11.603634 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38217c56-2ac5-45db-a4b1-c354fe5d062f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:11.605196 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38217c56-2ac5-45db-a4b1-c354fe5d062f None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:11.625581 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 419/829] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:11.628998 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5258e1d-40dc-49e6-8860-38de8e9f2532 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:11.881233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5258e1d-40dc-49e6-8860-38de8e9f2532 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:11.943755 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:11.953290 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a3db6-48b7-4ebd-a9d5-c1f9967594fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:11.954402 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a3db6-48b7-4ebd-a9d5-c1f9967594fa None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:11.954864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a3db6-48b7-4ebd-a9d5-c1f9967594fa None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:11.955342 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a3db6-48b7-4ebd-a9d5-c1f9967594fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:11.969340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a3db6-48b7-4ebd-a9d5-c1f9967594fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:11.972287 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a3db6-48b7-4ebd-a9d5-c1f9967594fa None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:11.994711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-a29a3db6-48b7-4ebd-a9d5-c1f9967594fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:11.994711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:11.994711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:11.994711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:11.994711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:11.994711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:11.994711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:11.994711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:11.994711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:11.994711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:11.994711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:11.994711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:11.994711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:11.994711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:11.994711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:11.995846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:11.995846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:11.995846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:11.995846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:11.995846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:11.995846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:11.995846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:11.995846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:11.995846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:11.995846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:11.995846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:11.995846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:11.995846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:11.995846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:11.995846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:11.995846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:11.995846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:11.996748 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:11.996748 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:11.996748 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:11.996748 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:11.996748 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:11.996748 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:11.996748 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:11.996748 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:11.997750 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 411/830] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:12.006976 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38217c56-2ac5-45db-a4b1-c354fe5d062f None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:12.204588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:12.208521 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38217c56-2ac5-45db-a4b1-c354fe5d062f None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:12.254062 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cbbfc-f3a7-4809-95c8-49163014c322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:12.254954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cbbfc-f3a7-4809-95c8-49163014c322 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:12.255388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cbbfc-f3a7-4809-95c8-49163014c322 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:12.255875 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cbbfc-f3a7-4809-95c8-49163014c322 None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:12.256765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cbbfc-f3a7-4809-95c8-49163014c322 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:12.257252 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cbbfc-f3a7-4809-95c8-49163014c322 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:12.258940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cbbfc-f3a7-4809-95c8-49163014c322 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:12.273863 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 420/831] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:12.287943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a3db6-48b7-4ebd-a9d5-c1f9967594fa None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:12.435653 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a3db6-48b7-4ebd-a9d5-c1f9967594fa None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:12.480429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c06fcb-1a35-4fed-b659-fd8b463c5ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:12.481396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c06fcb-1a35-4fed-b659-fd8b463c5ae6 None admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:12.481856 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c06fcb-1a35-4fed-b659-fd8b463c5ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:12.482281 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c06fcb-1a35-4fed-b659-fd8b463c5ae6 None admin] PATH_INFO: `/v3/projects/4416325d266642f3a786ff9f16c827aa/users/7caa973c63e64d639cc2fb55a4955542/roles/5e5c4aa158a845b981b0e847f8bd47a6` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:12.501781 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c06fcb-1a35-4fed-b659-fd8b463c5ae6 None admin] RBAC: Authorizing `identity:create_grant(project_id=4416325d266642f3a786ff9f16c827aa, user_id=7caa973c63e64d639cc2fb55a4955542, role_id=5e5c4aa158a845b981b0e847f8bd47a6)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:12.503556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c06fcb-1a35-4fed-b659-fd8b463c5ae6 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:12.524768 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 412/832] 10.222.0.94 () {58 vars in 1439 bytes} [Wed Aug 24 04:36:12 2022] PUT /identity/v3/projects/4416325d266642f3a786ff9f16c827aa/users/7caa973c63e64d639cc2fb55a4955542/roles/5e5c4aa158a845b981b0e847f8bd47a6 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:13.100721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df77893-450f-43d4-aa22-ce18d5b2c18e None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:13.102408 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df77893-450f-43d4-aa22-ce18d5b2c18e None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:13.103904 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df77893-450f-43d4-aa22-ce18d5b2c18e None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:13.107300 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 421/833] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:13.116640 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e181b6-0e67-49aa-b911-666eaecec91e None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:13.117736 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e181b6-0e67-49aa-b911-666eaecec91e None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:13.118570 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e181b6-0e67-49aa-b911-666eaecec91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:13.151566 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-00e181b6-0e67-49aa-b911-666eaecec91e None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:13.154197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-00e181b6-0e67-49aa-b911-666eaecec91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:13.232308 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:13.297159 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39773c-8aa8-4ddb-8441-b7ab7ca37a12 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:13.298288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39773c-8aa8-4ddb-8441-b7ab7ca37a12 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:13.299216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39773c-8aa8-4ddb-8441-b7ab7ca37a12 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:13.305482 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 422/834] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:36:13.308083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 413/835] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:36:13.312828 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8fd81-efb3-4160-b6a0-de6b8c27116c None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:13.313344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8fd81-efb3-4160-b6a0-de6b8c27116c None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:13.313898 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8fd81-efb3-4160-b6a0-de6b8c27116c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:13.347917 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-fcc8fd81-efb3-4160-b6a0-de6b8c27116c None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:13.350160 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-fcc8fd81-efb3-4160-b6a0-de6b8c27116c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:13.495260 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 423/836] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:13.702341 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e181b6-0e67-49aa-b911-666eaecec91e None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:13.867615 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e181b6-0e67-49aa-b911-666eaecec91e None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:13.907920 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8fd81-efb3-4160-b6a0-de6b8c27116c None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:13.910787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64d19d-34ee-4328-8ac5-4fe0f176c60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:13.911398 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64d19d-34ee-4328-8ac5-4fe0f176c60f None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:13.911696 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64d19d-34ee-4328-8ac5-4fe0f176c60f None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:13.912047 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64d19d-34ee-4328-8ac5-4fe0f176c60f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:13.913789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64d19d-34ee-4328-8ac5-4fe0f176c60f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:13.914195 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64d19d-34ee-4328-8ac5-4fe0f176c60f None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:13.925190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-cd64d19d-34ee-4328-8ac5-4fe0f176c60f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:36:13.925190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:13.925190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:36:13.925190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:36:13.925190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:36:13.925190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:36:13.925190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:36:13.925190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:13.925190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:36:13.925190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:13.925190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:36:13.925190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:13.925190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:13.925190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:13.925190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:13.925190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:13.925190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:13.926323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:13.926323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:13.926323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:13.926323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:13.926323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:13.926323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:13.926323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:36:13.926323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:36:13.926323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:36:13.926323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:36:13.926323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:13.926323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:13.926323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:13.926323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:13.926323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:13.926323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:13.927190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:13.927190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:13.927190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:13.927190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:13.927190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:13.927190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:13.927190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:13.927190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:13.927190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:13.927190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:13.927190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:36:13.927190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:13.927190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:36:13.927190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:13.927190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 414/837] 10.222.0.94 () {56 vars in 1114 bytes} [Wed Aug 24 04:36:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:13.937101 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64d19d-34ee-4328-8ac5-4fe0f176c60f None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:13.987527 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:14.061434 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:14.073518 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8fd81-efb3-4160-b6a0-de6b8c27116c None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:14.077898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64d19d-34ee-4328-8ac5-4fe0f176c60f None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:14.121993 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14ec33-a74d-420f-8abf-9f2c1c5e90b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:14.122741 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14ec33-a74d-420f-8abf-9f2c1c5e90b1 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:14.123027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14ec33-a74d-420f-8abf-9f2c1c5e90b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:14.123304 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14ec33-a74d-420f-8abf-9f2c1c5e90b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:14.124634 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e800c-db7e-4800-a5a4-1f0911b60c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:14.125606 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e800c-db7e-4800-a5a4-1f0911b60c43 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:14.126164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e800c-db7e-4800-a5a4-1f0911b60c43 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:14.126664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e800c-db7e-4800-a5a4-1f0911b60c43 None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:14.127612 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e800c-db7e-4800-a5a4-1f0911b60c43 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:14.128126 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e800c-db7e-4800-a5a4-1f0911b60c43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:14.129774 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e800c-db7e-4800-a5a4-1f0911b60c43 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:14.141725 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14ec33-a74d-420f-8abf-9f2c1c5e90b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:14.142149 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 415/838] 10.222.0.94 () {56 vars in 1114 bytes} [Wed Aug 24 04:36:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:14.143328 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e800c-db7e-4800-a5a4-1f0911b60c43 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:14.148490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-fe14ec33-a74d-420f-8abf-9f2c1c5e90b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:36:14.148490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:14.148490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:14.148490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:14.148490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:14.148490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:14.148490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:14.148490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:14.148490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:14.148490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:14.148490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:14.148490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:14.148490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:14.148490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:14.148490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:14.148490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:14.149575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:14.149575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:14.149575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:14.149575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:14.149575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:14.149575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:14.149575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:14.149575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:14.149575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:14.149575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:14.149575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:14.149575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:14.149575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:14.149575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:14.149575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:14.149575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:14.151561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:14.151561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:14.151561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:14.151561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:14.151561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:14.151561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:14.151561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:14.151561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:14.151561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:14.151561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:14.151561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:36:14.151561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:14.153932 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 424/839] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:36:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:14.159899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14ec33-a74d-420f-8abf-9f2c1c5e90b1 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:14.282212 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:14.287981 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e800c-db7e-4800-a5a4-1f0911b60c43 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:14.340260 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d71f3a-6509-432e-a4de-8b3ef380b1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:14.341157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d71f3a-6509-432e-a4de-8b3ef380b1b9 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:14.341492 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d71f3a-6509-432e-a4de-8b3ef380b1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:14.341779 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d71f3a-6509-432e-a4de-8b3ef380b1b9 None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:14.342428 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d71f3a-6509-432e-a4de-8b3ef380b1b9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:14.342735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d71f3a-6509-432e-a4de-8b3ef380b1b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:14.344887 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d71f3a-6509-432e-a4de-8b3ef380b1b9 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:14.350687 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 416/840] 10.222.0.94 () {56 vars in 1114 bytes} [Wed Aug 24 04:36:14 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:14.355417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd6d2e-d992-41d5-b4c9-55faf688ddfa None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:14.357140 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd6d2e-d992-41d5-b4c9-55faf688ddfa None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:14.357868 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd6d2e-d992-41d5-b4c9-55faf688ddfa None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:14.364913 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 417/841] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:14.367556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e92d5-8fe1-4eea-9075-dcd6c24a42f4 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:14.367981 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e92d5-8fe1-4eea-9075-dcd6c24a42f4 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:14.368382 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e92d5-8fe1-4eea-9075-dcd6c24a42f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:14.399338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-997e92d5-8fe1-4eea-9075-dcd6c24a42f4 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:14.401782 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-997e92d5-8fe1-4eea-9075-dcd6c24a42f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:14.427613 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14ec33-a74d-420f-8abf-9f2c1c5e90b1 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:14.472700 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa846b-60dc-47e6-8ffd-bf40a7a5d4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:14.474094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa846b-60dc-47e6-8ffd-bf40a7a5d4af None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:14.474853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa846b-60dc-47e6-8ffd-bf40a7a5d4af None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:14.475572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa846b-60dc-47e6-8ffd-bf40a7a5d4af None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:14.477095 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa846b-60dc-47e6-8ffd-bf40a7a5d4af None admin] RBAC: Adding query filter params (name=admin) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:14.478626 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa846b-60dc-47e6-8ffd-bf40a7a5d4af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:14.480348 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa846b-60dc-47e6-8ffd-bf40a7a5d4af None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:14.492905 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 425/842] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:14.500183 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa846b-60dc-47e6-8ffd-bf40a7a5d4af None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:14.509668 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 418/843] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:36:14.537604 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:14.661760 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa846b-60dc-47e6-8ffd-bf40a7a5d4af None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:14.710004 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c877601-02bd-4969-b293-982bb674cbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:14.710663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c877601-02bd-4969-b293-982bb674cbd4 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:14.710948 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c877601-02bd-4969-b293-982bb674cbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:14.711216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c877601-02bd-4969-b293-982bb674cbd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:14.740028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c877601-02bd-4969-b293-982bb674cbd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:14.742855 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c877601-02bd-4969-b293-982bb674cbd4 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:14.772223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-3c877601-02bd-4969-b293-982bb674cbd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:14.772223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:14.772223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:14.772223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:14.772223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:14.772223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:14.772223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:14.772223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:14.772223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:14.772223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:14.772223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:14.772223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:14.772223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:14.772223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:14.772223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:14.772223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:14.774132 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:14.774132 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:14.774132 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:14.774132 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:14.774132 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:14.774132 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:14.774132 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:14.774132 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:14.774132 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:14.774132 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:14.774132 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:14.774132 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:14.774132 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:14.774132 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:14.774132 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:14.774132 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:14.774132 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:14.776101 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:14.776101 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:14.776101 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:14.780112 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 426/844] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:14.787190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e92d5-8fe1-4eea-9075-dcd6c24a42f4 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:14.825938 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c877601-02bd-4969-b293-982bb674cbd4 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:14.913358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:14.924894 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:14.934333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e92d5-8fe1-4eea-9075-dcd6c24a42f4 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:14.968686 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c877601-02bd-4969-b293-982bb674cbd4 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:14.977517 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a500d7f-26fa-4c2a-83c7-f67aa86733c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:14.979094 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a500d7f-26fa-4c2a-83c7-f67aa86733c8 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:14.979628 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a500d7f-26fa-4c2a-83c7-f67aa86733c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:14.980236 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a500d7f-26fa-4c2a-83c7-f67aa86733c8 None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:14.981316 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a500d7f-26fa-4c2a-83c7-f67aa86733c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:14.981865 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a500d7f-26fa-4c2a-83c7-f67aa86733c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:14.985622 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a500d7f-26fa-4c2a-83c7-f67aa86733c8 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:15.001123 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 419/845] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:15.011225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a500d7f-26fa-4c2a-83c7-f67aa86733c8 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:15.023670 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34331a11-3683-48e1-af1b-547d7eb9aed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:15.024332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34331a11-3683-48e1-af1b-547d7eb9aed1 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:15.024705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34331a11-3683-48e1-af1b-547d7eb9aed1 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:15.025076 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34331a11-3683-48e1-af1b-547d7eb9aed1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:15.026297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34331a11-3683-48e1-af1b-547d7eb9aed1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:15.027832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34331a11-3683-48e1-af1b-547d7eb9aed1 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:15.038532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-34331a11-3683-48e1-af1b-547d7eb9aed1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:36:15.038532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:15.038532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:36:15.038532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:36:15.038532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:36:15.038532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:36:15.038532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:36:15.038532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:15.038532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:36:15.038532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:15.038532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:36:15.038532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:15.038532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:15.038532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:15.038532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:15.038532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:15.042030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:15.042030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:15.042030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:15.042030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:15.042030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:15.042030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:15.042030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:15.042030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:36:15.042030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:36:15.042030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:36:15.042030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:36:15.042030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:15.042030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:15.042030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:15.042030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:15.042030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:15.042030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:15.043785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:15.043785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:15.043785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:15.043785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:15.043785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:15.043785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:15.043785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:15.043785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:15.043785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:15.043785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:15.043785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:36:15.043785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:15.043785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:36:15.043785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:15.045868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 427/846] 10.222.0.94 () {56 vars in 1132 bytes} [Wed Aug 24 04:36:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:15.051754 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34331a11-3683-48e1-af1b-547d7eb9aed1 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:15.239465 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a500d7f-26fa-4c2a-83c7-f67aa86733c8 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:15.275010 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34331a11-3683-48e1-af1b-547d7eb9aed1 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:15.305255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e133537-0e06-438b-bc6b-aca7f6271fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:15.306947 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e133537-0e06-438b-bc6b-aca7f6271fe7 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:15.307457 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e133537-0e06-438b-bc6b-aca7f6271fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:15.307954 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e133537-0e06-438b-bc6b-aca7f6271fe7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:15.311811 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:15.323274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4ac1c-cd02-4190-bee5-c031ba741134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:15.323617 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e133537-0e06-438b-bc6b-aca7f6271fe7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:15.324340 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4ac1c-cd02-4190-bee5-c031ba741134 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:15.324768 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4ac1c-cd02-4190-bee5-c031ba741134 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:15.325134 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e133537-0e06-438b-bc6b-aca7f6271fe7 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:15.325425 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4ac1c-cd02-4190-bee5-c031ba741134 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:15.326240 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4ac1c-cd02-4190-bee5-c031ba741134 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:15.326693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4ac1c-cd02-4190-bee5-c031ba741134 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:15.329134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4ac1c-cd02-4190-bee5-c031ba741134 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:15.335351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 428/847] 10.222.0.94 () {56 vars in 1126 bytes} [Wed Aug 24 04:36:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:15.342602 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4ac1c-cd02-4190-bee5-c031ba741134 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:15.344124 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-4e133537-0e06-438b-bc6b-aca7f6271fe7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:36:15.344124 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:15.344124 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:15.344124 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:15.344124 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:15.344124 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:15.344124 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:15.344124 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:15.344124 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:15.344124 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:15.344124 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:15.344124 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:15.344124 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:15.344124 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:15.344124 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:15.344124 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:15.345224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:15.345224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:15.345224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:15.345224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:15.345224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:15.345224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:15.345224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:15.345224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:15.345224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:15.345224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:15.345224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:15.345224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:15.345224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:15.345224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:15.345224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:15.345224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:15.345224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:15.345224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:15.346293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:15.346293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:15.346293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:15.346293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:15.346293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:15.346293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:15.346293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:15.346293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:15.346293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:36:15.346293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:15.346293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 420/848] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:36:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:15.359146 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e133537-0e06-438b-bc6b-aca7f6271fe7 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:15.392493 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:15.491239 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4ac1c-cd02-4190-bee5-c031ba741134 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:15.565929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a60e0-3431-46bf-b2ab-dceb8f0f58b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:15.567551 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a60e0-3431-46bf-b2ab-dceb8f0f58b1 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:15.568289 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a60e0-3431-46bf-b2ab-dceb8f0f58b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:15.569005 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a60e0-3431-46bf-b2ab-dceb8f0f58b1 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:15.570598 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a60e0-3431-46bf-b2ab-dceb8f0f58b1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:15.571370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a60e0-3431-46bf-b2ab-dceb8f0f58b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:15.572272 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e133537-0e06-438b-bc6b-aca7f6271fe7 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:15.575186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a60e0-3431-46bf-b2ab-dceb8f0f58b1 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:15.590822 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 429/849] 10.222.0.94 () {56 vars in 1126 bytes} [Wed Aug 24 04:36:15 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:15.593020 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fd225-fd50-4560-95fc-40bdeb54c1ea None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:15.593444 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fd225-fd50-4560-95fc-40bdeb54c1ea None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:15.593828 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fd225-fd50-4560-95fc-40bdeb54c1ea None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:15.603227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 430/850] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:15 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:15.607082 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb0515-8ab2-4964-bc1c-102b683e936d None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:15.607535 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb0515-8ab2-4964-bc1c-102b683e936d None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:15.607991 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb0515-8ab2-4964-bc1c-102b683e936d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:15.643175 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-25eb0515-8ab2-4964-bc1c-102b683e936d None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:15.645297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-25eb0515-8ab2-4964-bc1c-102b683e936d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:15.653005 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c8b2c-4802-4b91-a190-3aaf7670ecf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:15.654223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c8b2c-4802-4b91-a190-3aaf7670ecf8 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:15.654597 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c8b2c-4802-4b91-a190-3aaf7670ecf8 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:15.655041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c8b2c-4802-4b91-a190-3aaf7670ecf8 None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:15.656274 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c8b2c-4802-4b91-a190-3aaf7670ecf8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:15.657062 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c8b2c-4802-4b91-a190-3aaf7670ecf8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:15.660004 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c8b2c-4802-4b91-a190-3aaf7670ecf8 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:15.702889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 421/851] 10.222.0.94 () {56 vars in 1135 bytes} [Wed Aug 24 04:36:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:15.710173 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c8b2c-4802-4b91-a190-3aaf7670ecf8 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:15.756848 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:15.797375 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 431/852] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:36:15.808565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:15.848593 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c8b2c-4802-4b91-a190-3aaf7670ecf8 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:15.895545 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf355091-e224-43e9-a326-1c1399c24675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:15.896205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf355091-e224-43e9-a326-1c1399c24675 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:15.896515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf355091-e224-43e9-a326-1c1399c24675 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:15.896783 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf355091-e224-43e9-a326-1c1399c24675 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:15.989049 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf355091-e224-43e9-a326-1c1399c24675 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:15.990564 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf355091-e224-43e9-a326-1c1399c24675 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:16.118054 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:16.180724 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 422/853] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:15 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 04:36:16.189960 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb0515-8ab2-4964-bc1c-102b683e936d None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:16.306679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf355091-e224-43e9-a326-1c1399c24675 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:16.397805 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb0515-8ab2-4964-bc1c-102b683e936d None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:16.453817 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf355091-e224-43e9-a326-1c1399c24675 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:16.473453 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9a31d-0fb3-45e8-bbdb-26124d8c8e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:16.473453 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9a31d-0fb3-45e8-bbdb-26124d8c8e47 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:16.473453 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9a31d-0fb3-45e8-bbdb-26124d8c8e47 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:16.473453 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9a31d-0fb3-45e8-bbdb-26124d8c8e47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:16.491280 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9a31d-0fb3-45e8-bbdb-26124d8c8e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:16.493905 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9a31d-0fb3-45e8-bbdb-26124d8c8e47 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:16.502773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b468868-b2ea-4ab6-99a3-39426abe6de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:16.503426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b468868-b2ea-4ab6-99a3-39426abe6de2 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:16.503700 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b468868-b2ea-4ab6-99a3-39426abe6de2 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:16.503972 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b468868-b2ea-4ab6-99a3-39426abe6de2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:16.518773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b468868-b2ea-4ab6-99a3-39426abe6de2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:16.522344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-21f9a31d-0fb3-45e8-bbdb-26124d8c8e47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:16.522344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:16.522344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:16.522344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:16.522344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:16.522344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:16.522344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:16.522344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:16.522344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:16.522344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:16.522344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:16.522344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:16.522344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:16.522344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:16.522344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:16.522344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:16.524052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:16.524052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:16.524052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:16.524052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:16.524052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:16.524052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:16.524052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:16.524052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:16.524052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:16.524052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:16.524052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:16.524052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:16.524052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:16.524052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:16.524052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:16.524052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:16.524052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:16.527054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:16.527054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:16.527054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:16.527385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-1b468868-b2ea-4ab6-99a3-39426abe6de2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:16.527385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:16.527385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:16.527385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:16.527385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:16.527385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:16.527385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:16.527385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:16.527385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:16.527385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:16.527385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:16.527385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:16.527385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:16.527385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:16.527385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:16.527385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:16.529096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:16.529096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:16.529096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:16.529096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:16.529096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:16.529096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:16.529096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:16.529096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:16.529096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:16.529096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:16.529096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:16.529096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:16.529096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:16.529096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:16.529096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:16.529096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:16.537053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:16.537053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:16.537053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:16.537053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:16.537053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:16.537053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:16.537053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:16.537053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:16.537053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:16.537053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:16.537053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:16.537053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:16.538556 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 432/854] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:16.538728 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 423/855] 10.222.0.94 () {56 vars in 1102 bytes} [Wed Aug 24 04:36:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:16.538870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9a31d-0fb3-45e8-bbdb-26124d8c8e47 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:16.539016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b468868-b2ea-4ab6-99a3-39426abe6de2 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:16.587980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:16.626701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:16.730387 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9a31d-0fb3-45e8-bbdb-26124d8c8e47 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:16.752605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b468868-b2ea-4ab6-99a3-39426abe6de2 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:16.778237 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd363b-ac28-4065-b61b-fc9647a68db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:16.778888 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd363b-ac28-4065-b61b-fc9647a68db6 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:16.779171 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd363b-ac28-4065-b61b-fc9647a68db6 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:16.779446 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd363b-ac28-4065-b61b-fc9647a68db6 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:16.780149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd363b-ac28-4065-b61b-fc9647a68db6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:16.780562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd363b-ac28-4065-b61b-fc9647a68db6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:16.783092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd363b-ac28-4065-b61b-fc9647a68db6 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:16.813259 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 433/856] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:16.815284 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd363b-ac28-4065-b61b-fc9647a68db6 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:16.825192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfcf7c-e09b-4679-be93-1cd0d0a37b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:16.826497 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfcf7c-e09b-4679-be93-1cd0d0a37b59 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:16.826931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfcf7c-e09b-4679-be93-1cd0d0a37b59 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:16.827356 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfcf7c-e09b-4679-be93-1cd0d0a37b59 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:16.828239 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfcf7c-e09b-4679-be93-1cd0d0a37b59 None admin] RBAC: Adding query filter params (name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:16.828708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfcf7c-e09b-4679-be93-1cd0d0a37b59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:16.830550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfcf7c-e09b-4679-be93-1cd0d0a37b59 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:16.844014 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 424/857] 10.222.0.94 () {56 vars in 1103 bytes} [Wed Aug 24 04:36:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:16.846108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12daddbe-b4cd-40f6-9838-88cf4d73d8d9 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:16.846629 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12daddbe-b4cd-40f6-9838-88cf4d73d8d9 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:16.847271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12daddbe-b4cd-40f6-9838-88cf4d73d8d9 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:16.849610 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 425/858] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:16.851425 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12daddbe-b4cd-40f6-9838-88cf4d73d8d9 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:16.996435 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:17.004392 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd363b-ac28-4065-b61b-fc9647a68db6 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:17.020345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:17.035594 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12daddbe-b4cd-40f6-9838-88cf4d73d8d9 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:17.069077 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cef9e-45f2-4022-9cf4-29851cf1cb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:17.070232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cef9e-45f2-4022-9cf4-29851cf1cb6f None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:17.070740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cef9e-45f2-4022-9cf4-29851cf1cb6f None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:17.071239 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cef9e-45f2-4022-9cf4-29851cf1cb6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:17.081971 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43667969-e056-42b9-aded-8e243501ace3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:17.082261 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62cef9e-45f2-4022-9cf4-29851cf1cb6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:17.083042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43667969-e056-42b9-aded-8e243501ace3 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:17.083453 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62cef9e-45f2-4022-9cf4-29851cf1cb6f None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:17.083623 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43667969-e056-42b9-aded-8e243501ace3 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:17.083986 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43667969-e056-42b9-aded-8e243501ace3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:17.107105 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43667969-e056-42b9-aded-8e243501ace3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:17.107376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-a62cef9e-45f2-4022-9cf4-29851cf1cb6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:17.107376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:17.107376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:17.107376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:17.107376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:17.107376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:17.107376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:17.107376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:17.107376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:17.107376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:17.107376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:17.107376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:17.107376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:17.107376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:17.107376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:17.108986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:17.108986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:17.108986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:17.108986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:17.108986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:17.108986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:17.108986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:17.108986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:17.108986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:17.108986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:17.108986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:17.108986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:17.108986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:17.108986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:17.108986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:17.108986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:17.108986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:17.120284 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:17.120284 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:17.120284 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:17.120284 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:17.120284 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:17.120284 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:17.120284 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:17.120284 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:17.120284 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 434/859] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:17.122470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43667969-e056-42b9-aded-8e243501ace3 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:17.122648 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684b47b-65ac-4b7c-99bc-ec21d3bc6f71 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:17.122648 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684b47b-65ac-4b7c-99bc-ec21d3bc6f71 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:17.122648 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684b47b-65ac-4b7c-99bc-ec21d3bc6f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:17.144779 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-5684b47b-65ac-4b7c-99bc-ec21d3bc6f71 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:17.146936 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-5684b47b-65ac-4b7c-99bc-ec21d3bc6f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:17.151381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-43667969-e056-42b9-aded-8e243501ace3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:17.151381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:17.151381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:17.151381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:17.151381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:17.151381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:17.151381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:17.151381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:17.151381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:17.151381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:17.151381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:17.151381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:17.151381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:17.151381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:17.151381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:17.151381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:17.153041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:17.153041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:17.153041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:17.153041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:17.153041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:17.153041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:17.153041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:17.153041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:17.153041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:17.153041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:17.153041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:17.153041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:17.153041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:17.153041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:17.153041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:17.153041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:17.153041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:17.156971 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:17.156971 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:17.156971 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:17.156971 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 426/860] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:17.156971 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43667969-e056-42b9-aded-8e243501ace3 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:17.257561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 435/861] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:17.259103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684b47b-65ac-4b7c-99bc-ec21d3bc6f71 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:17.386814 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43667969-e056-42b9-aded-8e243501ace3 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:17.466816 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:17.485001 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba2c79-0e4f-4390-83e3-a25bf7862b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:17.486123 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba2c79-0e4f-4390-83e3-a25bf7862b83 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:17.486614 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba2c79-0e4f-4390-83e3-a25bf7862b83 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:17.487094 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba2c79-0e4f-4390-83e3-a25bf7862b83 None admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:17.488465 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba2c79-0e4f-4390-83e3-a25bf7862b83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:17.488864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba2c79-0e4f-4390-83e3-a25bf7862b83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:17.491545 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba2c79-0e4f-4390-83e3-a25bf7862b83 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:17.497194 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684b47b-65ac-4b7c-99bc-ec21d3bc6f71 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:17.525442 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 427/862] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:17.529983 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba2c79-0e4f-4390-83e3-a25bf7862b83 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:17.547179 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:17.576270 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0756ae-bed7-460e-8bb6-d5cae0bdb081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:17.578035 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0756ae-bed7-460e-8bb6-d5cae0bdb081 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:17.578832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0756ae-bed7-460e-8bb6-d5cae0bdb081 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:17.579613 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0756ae-bed7-460e-8bb6-d5cae0bdb081 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:17.581128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0756ae-bed7-460e-8bb6-d5cae0bdb081 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:17.582084 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0756ae-bed7-460e-8bb6-d5cae0bdb081 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:17.585102 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0756ae-bed7-460e-8bb6-d5cae0bdb081 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:17.611174 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 436/863] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:17.620093 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0756ae-bed7-460e-8bb6-d5cae0bdb081 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:17.733965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba2c79-0e4f-4390-83e3-a25bf7862b83 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:17.779883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0756ae-bed7-460e-8bb6-d5cae0bdb081 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:17.789027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413b2ff-bebe-43da-b963-2fa8a2a75664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:17.789889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413b2ff-bebe-43da-b963-2fa8a2a75664 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:17.790319 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413b2ff-bebe-43da-b963-2fa8a2a75664 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:17.790752 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413b2ff-bebe-43da-b963-2fa8a2a75664 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:17.791946 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413b2ff-bebe-43da-b963-2fa8a2a75664 None admin] RBAC: Adding query filter params (role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2, scope.project.id=4416325d266642f3a786ff9f16c827aa, user.id=40d2202203204b06a41e57b9d1a300fc) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:17.792397 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413b2ff-bebe-43da-b963-2fa8a2a75664 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:17.794423 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413b2ff-bebe-43da-b963-2fa8a2a75664 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:17.813438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 428/864] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:36:17 2022] GET /identity/v3/role_assignments?user.id=40d2202203204b06a41e57b9d1a300fc&scope.project.id=4416325d266642f3a786ff9f16c827aa&role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:17.813438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413b2ff-bebe-43da-b963-2fa8a2a75664 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:17.844785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc5b15-187c-4c48-8fde-b6ac3c25f736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:17.846262 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc5b15-187c-4c48-8fde-b6ac3c25f736 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:17.847030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc5b15-187c-4c48-8fde-b6ac3c25f736 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:17.847657 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc5b15-187c-4c48-8fde-b6ac3c25f736 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:17.860090 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc5b15-187c-4c48-8fde-b6ac3c25f736 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:17.861972 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc5b15-187c-4c48-8fde-b6ac3c25f736 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:17.876621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-24fc5b15-187c-4c48-8fde-b6ac3c25f736 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:36:17.876621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:17.876621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:17.876621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:17.876621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:17.876621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:17.876621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:17.876621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:17.876621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:17.876621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:17.876621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:17.876621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:17.876621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:17.876621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:17.876621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:17.876621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:17.877902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:17.877902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:17.877902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:17.877902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:17.877902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:17.877902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:17.877902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:17.877902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:17.877902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:17.877902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:17.877902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:17.877902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:17.877902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:17.877902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:17.877902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:17.877902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:17.877902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:17.877902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:17.879104 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:17.879104 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:17.879104 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:17.879104 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:17.879104 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:17.879104 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:17.879104 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:17.879104 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:17.879104 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:36:17.879104 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:17.886501 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 437/865] 10.222.0.94 () {56 vars in 1117 bytes} [Wed Aug 24 04:36:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:17.887421 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc5b15-187c-4c48-8fde-b6ac3c25f736 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:17.903086 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:17.914410 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:17.980446 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413b2ff-bebe-43da-b963-2fa8a2a75664 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:18.029048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc5b15-187c-4c48-8fde-b6ac3c25f736 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:18.063473 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcc7c2-6e14-4e11-937c-7afc05f4bfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:18.064515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcc7c2-6e14-4e11-937c-7afc05f4bfb1 None admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:18.065039 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcc7c2-6e14-4e11-937c-7afc05f4bfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:18.065788 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcc7c2-6e14-4e11-937c-7afc05f4bfb1 None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:18.067197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcc7c2-6e14-4e11-937c-7afc05f4bfb1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:18.069165 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcc7c2-6e14-4e11-937c-7afc05f4bfb1 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:18.084917 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a34341-9c00-4343-8c13-3f9bb2186f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:18.085135 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a34341-9c00-4343-8c13-3f9bb2186f94 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:18.085554 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a34341-9c00-4343-8c13-3f9bb2186f94 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:18.085786 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a34341-9c00-4343-8c13-3f9bb2186f94 None admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:18.086658 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a34341-9c00-4343-8c13-3f9bb2186f94 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:18.087523 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a34341-9c00-4343-8c13-3f9bb2186f94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:18.089262 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a34341-9c00-4343-8c13-3f9bb2186f94 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:18.096885 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 429/866] 10.222.0.94 () {60 vars in 1141 bytes} [Wed Aug 24 04:36:17 2022] POST /identity/v3/services => generated 251 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:18.124020 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 438/867] 10.222.0.94 () {56 vars in 1149 bytes} [Wed Aug 24 04:36:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:18.135438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcc7c2-6e14-4e11-937c-7afc05f4bfb1 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:18.385351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcc7c2-6e14-4e11-937c-7afc05f4bfb1 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:18.443895 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:18.463903 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c3913-ab0e-426d-9ef6-c54d5b764a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:18.465010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c3913-ab0e-426d-9ef6-c54d5b764a23 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:18.465540 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c3913-ab0e-426d-9ef6-c54d5b764a23 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:18.466069 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c3913-ab0e-426d-9ef6-c54d5b764a23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:18.611775 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c3913-ab0e-426d-9ef6-c54d5b764a23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:18.615164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c3913-ab0e-426d-9ef6-c54d5b764a23 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:18.832789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 430/868] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:18 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:36:18.842068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a34341-9c00-4343-8c13-3f9bb2186f94 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:18.986941 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:19.009305 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e5b76-f28d-418a-bb14-0b2b67b86dbb None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:19.010085 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e5b76-f28d-418a-bb14-0b2b67b86dbb None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:19.010085 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e5b76-f28d-418a-bb14-0b2b67b86dbb None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:19.012928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 431/869] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:19.017883 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a73e46-05e4-4958-8d7d-ee42b1562b82 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:19.018172 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a73e46-05e4-4958-8d7d-ee42b1562b82 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:19.018504 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a73e46-05e4-4958-8d7d-ee42b1562b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:19.041490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-86a73e46-05e4-4958-8d7d-ee42b1562b82 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:19.042795 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-86a73e46-05e4-4958-8d7d-ee42b1562b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:19.061821 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a34341-9c00-4343-8c13-3f9bb2186f94 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:19.071560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:19.149030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6369f4c-3dc4-4e17-b9d1-113604aa77d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:19.150257 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 432/870] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:19 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:36:19.150723 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6369f4c-3dc4-4e17-b9d1-113604aa77d1 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:19.151269 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6369f4c-3dc4-4e17-b9d1-113604aa77d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:19.151736 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6369f4c-3dc4-4e17-b9d1-113604aa77d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:19.173358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6369f4c-3dc4-4e17-b9d1-113604aa77d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:19.176275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6369f4c-3dc4-4e17-b9d1-113604aa77d1 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:19.199034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-f6369f4c-3dc4-4e17-b9d1-113604aa77d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:19.199034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:19.199034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:19.199034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:19.199034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:19.199034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:19.199034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:19.199034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:19.199034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:19.199034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:19.199034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:19.199034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:19.199034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:19.199034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:19.199034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:19.199034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:19.200215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:19.200215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:19.200215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:19.200215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:19.200215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:19.200215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:19.200215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:19.200215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:19.200215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:19.200215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:19.200215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:19.200215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:19.200215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:19.200215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:19.200215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:19.200215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:19.200215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:19.201184 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:19.201184 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:19.201184 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:19.203040 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 439/871] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:19.213826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a73e46-05e4-4958-8d7d-ee42b1562b82 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:19.396760 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a73e46-05e4-4958-8d7d-ee42b1562b82 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:19.437485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac46561-33c4-4d46-a729-23d63b4d44ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:19.438119 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac46561-33c4-4d46-a729-23d63b4d44ef None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:19.438393 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac46561-33c4-4d46-a729-23d63b4d44ef None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:19.438661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac46561-33c4-4d46-a729-23d63b4d44ef None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:19.439318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac46561-33c4-4d46-a729-23d63b4d44ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:19.439652 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac46561-33c4-4d46-a729-23d63b4d44ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:19.441057 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac46561-33c4-4d46-a729-23d63b4d44ef None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:19.455730 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 433/872] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:19.465254 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6369f4c-3dc4-4e17-b9d1-113604aa77d1 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:19.560850 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac46561-33c4-4d46-a729-23d63b4d44ef None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:19.583192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:19.625572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6369f4c-3dc4-4e17-b9d1-113604aa77d1 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:19.648772 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:19.671580 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691e86f-878b-47ad-ae6f-70bd7199602f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:19.672534 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691e86f-878b-47ad-ae6f-70bd7199602f None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:19.672962 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691e86f-878b-47ad-ae6f-70bd7199602f None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:19.673383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691e86f-878b-47ad-ae6f-70bd7199602f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:19.682607 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691e86f-878b-47ad-ae6f-70bd7199602f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:19.684651 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691e86f-878b-47ad-ae6f-70bd7199602f None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:19.693433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac46561-33c4-4d46-a729-23d63b4d44ef None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:19.710465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-7691e86f-878b-47ad-ae6f-70bd7199602f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:19.710465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:19.710465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:19.710465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:19.710465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:19.710465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:19.710465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:19.710465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:19.710465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:19.710465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:19.710465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:19.710465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:19.710465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:19.710465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:19.710465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:19.711449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:19.711449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:19.711449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:19.711449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:19.711449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:19.711449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:19.711449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:19.711449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:19.711449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:19.711449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:19.711449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:19.711449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:19.711449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:19.711449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:19.711449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:19.711449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:19.711449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:19.713267 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:19.713267 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:19.713267 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:19.713267 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:19.713267 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:19.713267 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:19.713267 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:19.713267 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:19.713267 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 440/873] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:19.722317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691e86f-878b-47ad-ae6f-70bd7199602f None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:19.758993 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378a725-68e8-426d-b1e7-7326cb6b2b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:19.759976 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378a725-68e8-426d-b1e7-7326cb6b2b8e None admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:19.760479 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378a725-68e8-426d-b1e7-7326cb6b2b8e None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:19.761262 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378a725-68e8-426d-b1e7-7326cb6b2b8e None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:19.762365 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378a725-68e8-426d-b1e7-7326cb6b2b8e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:19.765034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378a725-68e8-426d-b1e7-7326cb6b2b8e None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:19.797203 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 434/874] 10.222.0.94 () {60 vars in 1141 bytes} [Wed Aug 24 04:36:19 2022] POST /identity/v3/services => generated 269 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:36:19.893974 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691e86f-878b-47ad-ae6f-70bd7199602f None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:19.948012 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b89c6-4745-4b18-8749-57495dddf0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:19.949060 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b89c6-4745-4b18-8749-57495dddf0e7 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:19.949566 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b89c6-4745-4b18-8749-57495dddf0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:19.949984 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b89c6-4745-4b18-8749-57495dddf0e7 None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:19.950892 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b89c6-4745-4b18-8749-57495dddf0e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:19.951361 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b89c6-4745-4b18-8749-57495dddf0e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:19.953070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b89c6-4745-4b18-8749-57495dddf0e7 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:19.969107 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 441/875] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:19.979241 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378a725-68e8-426d-b1e7-7326cb6b2b8e None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:20.131483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:20.183822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378a725-68e8-426d-b1e7-7326cb6b2b8e None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:20.251079 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88948035-a4f9-40aa-bdf3-cee62849ffb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:20.251911 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88948035-a4f9-40aa-bdf3-cee62849ffb8 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:20.252325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88948035-a4f9-40aa-bdf3-cee62849ffb8 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:20.252790 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88948035-a4f9-40aa-bdf3-cee62849ffb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:20.254037 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88948035-a4f9-40aa-bdf3-cee62849ffb8 None admin] RBAC: Adding query filter params (role.id=5e5c4aa158a845b981b0e847f8bd47a6, scope.project.id=4416325d266642f3a786ff9f16c827aa, user.id=7caa973c63e64d639cc2fb55a4955542) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:20.254506 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88948035-a4f9-40aa-bdf3-cee62849ffb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:20.257128 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88948035-a4f9-40aa-bdf3-cee62849ffb8 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:20.269447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 435/876] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:36:19 2022] GET /identity/v3/role_assignments?user.id=7caa973c63e64d639cc2fb55a4955542&scope.project.id=4416325d266642f3a786ff9f16c827aa&role.id=5e5c4aa158a845b981b0e847f8bd47a6 => generated 608 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:20.801937 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fdbe3-905e-4452-985e-0b7f1156aea4 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:20.802212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fdbe3-905e-4452-985e-0b7f1156aea4 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:20.802605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fdbe3-905e-4452-985e-0b7f1156aea4 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:20.804476 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 442/877] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:36:20.811731 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f2034-a759-467c-b0a1-a93255c9818c None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:20.812126 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f2034-a759-467c-b0a1-a93255c9818c None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:20.812410 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f2034-a759-467c-b0a1-a93255c9818c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:20.846510 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-840f2034-a759-467c-b0a1-a93255c9818c None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:20.848577 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-840f2034-a759-467c-b0a1-a93255c9818c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:20.982814 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 436/878] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:20 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:21.122797 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b65dd7-69da-4847-b85f-bb709dd784a6 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:21.123371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b65dd7-69da-4847-b85f-bb709dd784a6 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:21.123738 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b65dd7-69da-4847-b85f-bb709dd784a6 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:21.126491 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 443/879] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:21.135360 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5dad6b-8124-4f7e-971d-ee5420deebd4 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:21.136221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5dad6b-8124-4f7e-971d-ee5420deebd4 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:21.136221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5dad6b-8124-4f7e-971d-ee5420deebd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:21.166693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-1c5dad6b-8124-4f7e-971d-ee5420deebd4 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:21.169344 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-1c5dad6b-8124-4f7e-971d-ee5420deebd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:21.302024 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:21.308413 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 437/880] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:21 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:21.387754 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b65dd7-69da-4847-b85f-bb709dd784a6 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:21.435453 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:21.522345 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b65dd7-69da-4847-b85f-bb709dd784a6 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:21.576105 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0f5e4-600a-4f74-945e-a13c5f65fe0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:21.577010 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0f5e4-600a-4f74-945e-a13c5f65fe0b None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:21.577434 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0f5e4-600a-4f74-945e-a13c5f65fe0b None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:21.577714 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0f5e4-600a-4f74-945e-a13c5f65fe0b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:21.578394 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0f5e4-600a-4f74-945e-a13c5f65fe0b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:21.580387 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0f5e4-600a-4f74-945e-a13c5f65fe0b None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:21.593011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-31f0f5e4-600a-4f74-945e-a13c5f65fe0b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:36:21.593011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:21.593011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:36:21.593011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:36:21.593011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:36:21.593011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:36:21.593011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:36:21.593011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:21.593011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:36:21.593011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:21.593011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:36:21.593011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:21.593011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:21.593011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:21.593011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:21.593011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:21.593011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:21.594983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:21.594983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:21.594983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:21.594983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:21.594983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:21.594983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:21.594983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:36:21.594983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:36:21.594983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:36:21.594983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:36:21.594983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:21.594983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:21.594983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:21.594983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:21.594983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:21.594983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:21.596692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:21.596692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:21.596692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:21.596692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:21.596692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:21.596692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:21.596692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:21.596692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:21.596692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:21.596692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:21.596692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:36:21.596692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:21.596692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:36:21.596692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:21.601452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 444/881] 10.222.0.94 () {56 vars in 1126 bytes} [Wed Aug 24 04:36:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:21.603905 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5dad6b-8124-4f7e-971d-ee5420deebd4 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:21.768428 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5dad6b-8124-4f7e-971d-ee5420deebd4 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:21.840342 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc730244-d8ab-4b29-a947-e6bef2011f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:21.841211 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc730244-d8ab-4b29-a947-e6bef2011f4b None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:21.841692 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc730244-d8ab-4b29-a947-e6bef2011f4b None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:21.842105 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc730244-d8ab-4b29-a947-e6bef2011f4b None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:21.843175 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc730244-d8ab-4b29-a947-e6bef2011f4b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:21.843699 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc730244-d8ab-4b29-a947-e6bef2011f4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:21.846157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc730244-d8ab-4b29-a947-e6bef2011f4b None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:21.856465 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 438/882] 10.222.0.94 () {56 vars in 1122 bytes} [Wed Aug 24 04:36:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:21.862646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0f5e4-600a-4f74-945e-a13c5f65fe0b None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:21.889853 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc730244-d8ab-4b29-a947-e6bef2011f4b None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:21.994789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:21.999524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0f5e4-600a-4f74-945e-a13c5f65fe0b None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:22.016168 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:22.043115 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736943a-9491-4781-bf91-4607506efc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:22.044113 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736943a-9491-4781-bf91-4607506efc75 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:22.044616 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736943a-9491-4781-bf91-4607506efc75 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:22.045200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736943a-9491-4781-bf91-4607506efc75 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:22.046207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736943a-9491-4781-bf91-4607506efc75 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:22.046729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736943a-9491-4781-bf91-4607506efc75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:22.048433 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736943a-9491-4781-bf91-4607506efc75 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:22.061635 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 445/883] 10.222.0.94 () {56 vars in 1122 bytes} [Wed Aug 24 04:36:21 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:22.065151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc730244-d8ab-4b29-a947-e6bef2011f4b None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:22.111504 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde0b86-e144-4fe5-8795-dddc4eca0c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:22.112133 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde0b86-e144-4fe5-8795-dddc4eca0c5e None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:22.112416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde0b86-e144-4fe5-8795-dddc4eca0c5e None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:22.112686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde0b86-e144-4fe5-8795-dddc4eca0c5e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:22.113296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde0b86-e144-4fe5-8795-dddc4eca0c5e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:22.114790 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde0b86-e144-4fe5-8795-dddc4eca0c5e None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:22.125338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-2dde0b86-e144-4fe5-8795-dddc4eca0c5e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:36:22.125338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:22.125338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:36:22.125338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:36:22.125338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:36:22.125338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:36:22.125338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:36:22.125338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:22.125338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:36:22.125338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:22.125338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:36:22.125338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:22.125338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:22.125338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:22.125338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:22.125338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:22.125338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:22.127646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:22.127646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:22.127646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:22.127646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:22.127646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:22.127646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:22.127646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:36:22.127646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:36:22.127646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:36:22.127646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:36:22.127646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:22.127646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:22.127646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:22.127646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:22.127646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:22.127646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:22.129621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:22.129621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:22.129621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:22.129621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:22.129621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:22.129621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:22.129621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:22.129621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:22.129621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:22.129621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:22.129621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:36:22.129621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:22.129621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:36:22.129621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:22.129621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 439/884] 10.222.0.94 () {56 vars in 1114 bytes} [Wed Aug 24 04:36:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:22.139514 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736943a-9491-4781-bf91-4607506efc75 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:22.293864 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736943a-9491-4781-bf91-4607506efc75 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:22.342190 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149df66-e1a6-4bf3-9493-79421e26111b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:22.343640 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149df66-e1a6-4bf3-9493-79421e26111b None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:22.344380 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149df66-e1a6-4bf3-9493-79421e26111b None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:22.345123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149df66-e1a6-4bf3-9493-79421e26111b None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:22.346582 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149df66-e1a6-4bf3-9493-79421e26111b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:22.347345 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149df66-e1a6-4bf3-9493-79421e26111b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:22.350082 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149df66-e1a6-4bf3-9493-79421e26111b None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:22.361656 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 446/885] 10.222.0.94 () {56 vars in 1114 bytes} [Wed Aug 24 04:36:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:22.369440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde0b86-e144-4fe5-8795-dddc4eca0c5e None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:22.568512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde0b86-e144-4fe5-8795-dddc4eca0c5e None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:22.626112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:22.644112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba91bb-56ce-461b-bb92-ed759976ee00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:22.645627 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba91bb-56ce-461b-bb92-ed759976ee00 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:22.646428 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba91bb-56ce-461b-bb92-ed759976ee00 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:22.647238 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba91bb-56ce-461b-bb92-ed759976ee00 None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:22.648640 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba91bb-56ce-461b-bb92-ed759976ee00 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:22.649662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba91bb-56ce-461b-bb92-ed759976ee00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:22.652408 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba91bb-56ce-461b-bb92-ed759976ee00 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:22.663206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 440/886] 10.222.0.94 () {56 vars in 1114 bytes} [Wed Aug 24 04:36:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:22.672832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149df66-e1a6-4bf3-9493-79421e26111b None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:22.737371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:22.831687 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ce93d-9302-4e15-972e-bf3a59480d5f None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:22.832134 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ce93d-9302-4e15-972e-bf3a59480d5f None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:22.832589 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ce93d-9302-4e15-972e-bf3a59480d5f None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:22.835895 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 441/887] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:22.845853 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79710927-d485-40a8-b0bf-9df91b61eedd None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:22.846305 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79710927-d485-40a8-b0bf-9df91b61eedd None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:22.846760 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79710927-d485-40a8-b0bf-9df91b61eedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:22.887925 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-79710927-d485-40a8-b0bf-9df91b61eedd None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:22.891214 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-79710927-d485-40a8-b0bf-9df91b61eedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:22.901583 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149df66-e1a6-4bf3-9493-79421e26111b None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:22.975804 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704d45c-fb50-40c2-a851-5284fb2cd9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:22.976364 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704d45c-fb50-40c2-a851-5284fb2cd9f7 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:22.976648 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704d45c-fb50-40c2-a851-5284fb2cd9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:22.976925 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704d45c-fb50-40c2-a851-5284fb2cd9f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:22.978640 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704d45c-fb50-40c2-a851-5284fb2cd9f7 None admin] RBAC: Adding query filter params (interface=public, service_id=acdea5be10c04e2aa1fb254f4e1696d7, region_id=RegionOne) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:22.979184 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704d45c-fb50-40c2-a851-5284fb2cd9f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:22.980883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704d45c-fb50-40c2-a851-5284fb2cd9f7 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:22.996064 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 447/888] 10.222.0.94 () {56 vars in 1251 bytes} [Wed Aug 24 04:36:22 2022] GET /identity/v3/endpoints?service_id=acdea5be10c04e2aa1fb254f4e1696d7&interface=public®ion_id=RegionOne => generated 194 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:22.998682 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6ff31-a83d-4e53-a8a5-e762ef5e86e6 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:22.999197 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6ff31-a83d-4e53-a8a5-e762ef5e86e6 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:22.999679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6ff31-a83d-4e53-a8a5-e762ef5e86e6 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:23.002463 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 448/889] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:23.003902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6ff31-a83d-4e53-a8a5-e762ef5e86e6 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:23.050514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 442/890] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:22 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:36:23.054198 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa3266-e89d-457e-a148-c32cf098f38c None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:23.054682 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa3266-e89d-457e-a148-c32cf098f38c None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:23.059034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa3266-e89d-457e-a148-c32cf098f38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:23.089649 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-e0aa3266-e89d-457e-a148-c32cf098f38c None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:23.090905 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e0aa3266-e89d-457e-a148-c32cf098f38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:23.146400 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:23.168635 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6ff31-a83d-4e53-a8a5-e762ef5e86e6 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:23.202089 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 443/891] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:23.234901 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2035d-c002-4fd3-89c3-31d6368f466e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:23.235994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2035d-c002-4fd3-89c3-31d6368f466e None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:23.236278 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2035d-c002-4fd3-89c3-31d6368f466e None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:23.236539 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2035d-c002-4fd3-89c3-31d6368f466e None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:23.237284 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2035d-c002-4fd3-89c3-31d6368f466e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:23.239924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2035d-c002-4fd3-89c3-31d6368f466e None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:23.249881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 449/892] 10.222.0.94 () {56 vars in 1087 bytes} [Wed Aug 24 04:36:23 2022] GET /identity/v3/services => generated 1268 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:36:23.517036 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa3266-e89d-457e-a148-c32cf098f38c None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:23.620002 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:23.714109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa3266-e89d-457e-a148-c32cf098f38c None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:23.730605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2035d-c002-4fd3-89c3-31d6368f466e None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:23.787304 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58416e-0e75-4c2f-9a71-8e2eb8df3651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:23.788901 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58416e-0e75-4c2f-9a71-8e2eb8df3651 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:23.790243 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58416e-0e75-4c2f-9a71-8e2eb8df3651 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:23.791218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58416e-0e75-4c2f-9a71-8e2eb8df3651 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:23.792784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58416e-0e75-4c2f-9a71-8e2eb8df3651 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:23.795698 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58416e-0e75-4c2f-9a71-8e2eb8df3651 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:23.814091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-1b58416e-0e75-4c2f-9a71-8e2eb8df3651 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:36:23.814091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:23.814091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:36:23.814091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:36:23.814091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:36:23.814091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:36:23.814091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:36:23.814091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:23.814091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:36:23.814091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:23.814091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:36:23.814091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:23.814091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:23.814091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:23.814091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:23.814091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:23.815906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:23.815906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:23.815906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:23.815906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:23.815906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:23.815906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:23.815906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:23.815906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:36:23.815906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:36:23.815906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:36:23.815906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:36:23.815906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:23.815906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:23.815906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:23.815906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:23.815906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:23.815906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:23.817692 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:23.817692 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:23.817692 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:23.817692 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:23.817692 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:23.817692 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:23.817692 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:23.817692 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:23.817692 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:23.817692 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:23.817692 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:36:23.817692 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:23.817692 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:36:23.817692 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:23.829939 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 444/893] 10.222.0.94 () {56 vars in 1132 bytes} [Wed Aug 24 04:36:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:23.832068 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58416e-0e75-4c2f-9a71-8e2eb8df3651 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:23.850948 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2035d-c002-4fd3-89c3-31d6368f466e None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:23.906105 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7dedf-1a8a-4e09-aaaf-b7b9d55bb838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:23.907089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7dedf-1a8a-4e09-aaaf-b7b9d55bb838 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:23.907525 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7dedf-1a8a-4e09-aaaf-b7b9d55bb838 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:23.907937 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7dedf-1a8a-4e09-aaaf-b7b9d55bb838 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:23.927469 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7dedf-1a8a-4e09-aaaf-b7b9d55bb838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:23.935973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-eed7dedf-1a8a-4e09-aaaf-b7b9d55bb838 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:36:23.935973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:23.935973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:23.935973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:23.935973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:23.935973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:23.935973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:23.935973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:23.935973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:23.935973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:23.935973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:23.935973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:23.935973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:23.935973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:23.935973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:23.935973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:23.938085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:23.938085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:23.938085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:23.938085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:23.938085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:23.938085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:23.938085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:23.938085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:23.938085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:23.938085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:23.938085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:23.938085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:23.938085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:23.938085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:23.938085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:23.938085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:23.939588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:23.939588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:23.939588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:23.939588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:23.939588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:23.939588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:23.939588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:23.939588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:23.939588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:23.939588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:23.939588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:36:23.939588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:23.939588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 450/894] 10.222.0.94 () {56 vars in 1120 bytes} [Wed Aug 24 04:36:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:23.951410 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7dedf-1a8a-4e09-aaaf-b7b9d55bb838 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:23.988360 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:24.056072 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58416e-0e75-4c2f-9a71-8e2eb8df3651 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:24.094887 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:24.138056 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa2b81-33a5-4650-ac19-cbc125271d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:24.139434 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa2b81-33a5-4650-ac19-cbc125271d6b None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:24.139847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa2b81-33a5-4650-ac19-cbc125271d6b None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:24.140289 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa2b81-33a5-4650-ac19-cbc125271d6b None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:24.141331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa2b81-33a5-4650-ac19-cbc125271d6b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:24.141861 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa2b81-33a5-4650-ac19-cbc125271d6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:24.145478 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa2b81-33a5-4650-ac19-cbc125271d6b None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:24.156155 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 445/895] 10.222.0.94 () {56 vars in 1126 bytes} [Wed Aug 24 04:36:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:24.165977 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa2b81-33a5-4650-ac19-cbc125271d6b None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:24.180964 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7dedf-1a8a-4e09-aaaf-b7b9d55bb838 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:24.251313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07fc61-b7fa-4f9b-9910-86367ad139af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:24.252771 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07fc61-b7fa-4f9b-9910-86367ad139af None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:24.253290 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07fc61-b7fa-4f9b-9910-86367ad139af None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:24.253833 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07fc61-b7fa-4f9b-9910-86367ad139af None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:24.254750 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07fc61-b7fa-4f9b-9910-86367ad139af None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:24.256056 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07fc61-b7fa-4f9b-9910-86367ad139af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:24.258132 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07fc61-b7fa-4f9b-9910-86367ad139af None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:24.272943 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 451/896] 10.222.0.94 () {56 vars in 1115 bytes} [Wed Aug 24 04:36:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:24.281259 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07fc61-b7fa-4f9b-9910-86367ad139af None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:24.333505 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa2b81-33a5-4650-ac19-cbc125271d6b None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:24.377222 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d158be7-6ca1-43dd-83b3-7a010617cbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:24.378250 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d158be7-6ca1-43dd-83b3-7a010617cbb2 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:24.378653 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d158be7-6ca1-43dd-83b3-7a010617cbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:24.379028 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d158be7-6ca1-43dd-83b3-7a010617cbb2 None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:24.379795 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d158be7-6ca1-43dd-83b3-7a010617cbb2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:24.380244 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d158be7-6ca1-43dd-83b3-7a010617cbb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:24.381826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d158be7-6ca1-43dd-83b3-7a010617cbb2 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:24.393641 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 446/897] 10.222.0.94 () {56 vars in 1126 bytes} [Wed Aug 24 04:36:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:24.394902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d158be7-6ca1-43dd-83b3-7a010617cbb2 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:24.419970 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:24.458449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07fc61-b7fa-4f9b-9910-86367ad139af None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:24.486316 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:24.512686 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c795f-448e-4951-a6e0-570cf0148e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:24.513643 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c795f-448e-4951-a6e0-570cf0148e56 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:24.514080 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c795f-448e-4951-a6e0-570cf0148e56 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:24.514557 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c795f-448e-4951-a6e0-570cf0148e56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:24.532659 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c795f-448e-4951-a6e0-570cf0148e56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:24.534855 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c795f-448e-4951-a6e0-570cf0148e56 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:24.556225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-381c795f-448e-4951-a6e0-570cf0148e56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:24.556225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:24.556225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:24.556225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:24.556225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:24.556225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:24.556225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:24.556225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:24.556225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:24.556225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:24.556225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:24.556225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:24.556225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:24.556225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:24.556225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:24.556225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:24.557717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:24.557717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:24.557717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:24.557717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:24.557717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:24.557717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:24.557717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:24.557717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:24.557717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:24.557717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:24.557717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:24.557717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:24.557717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:24.557717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:24.557717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:24.557717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:24.557717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:24.558780 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:24.558780 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:24.558780 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:24.565834 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 452/898] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:24.567002 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c795f-448e-4951-a6e0-570cf0148e56 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:24.599070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d158be7-6ca1-43dd-83b3-7a010617cbb2 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:24.649622 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd9bad-4213-4e72-b09a-02478c0e3eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:24.651123 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd9bad-4213-4e72-b09a-02478c0e3eba None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:24.651595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd9bad-4213-4e72-b09a-02478c0e3eba None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:24.652051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd9bad-4213-4e72-b09a-02478c0e3eba None admin] PATH_INFO: `/v3/endpoints` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:24.652959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd9bad-4213-4e72-b09a-02478c0e3eba None admin] RBAC: Adding query filter params (interface=public, service_id=e6786066567d41f083fbfcbca528c02c, region_id=RegionOne) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:24.653920 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd9bad-4213-4e72-b09a-02478c0e3eba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:24.656851 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd9bad-4213-4e72-b09a-02478c0e3eba None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:24.668144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 447/899] 10.222.0.94 () {56 vars in 1251 bytes} [Wed Aug 24 04:36:24 2022] GET /identity/v3/endpoints?service_id=e6786066567d41f083fbfcbca528c02c&interface=public®ion_id=RegionOne => generated 194 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:24.676409 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd9bad-4213-4e72-b09a-02478c0e3eba None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:24.729435 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c795f-448e-4951-a6e0-570cf0148e56 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:24.767469 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:24.783325 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6a390-50f0-4e86-9a5b-5a02ef3c9eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:24.785180 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6a390-50f0-4e86-9a5b-5a02ef3c9eb5 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:24.785751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6a390-50f0-4e86-9a5b-5a02ef3c9eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:24.786531 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6a390-50f0-4e86-9a5b-5a02ef3c9eb5 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:24.787983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6a390-50f0-4e86-9a5b-5a02ef3c9eb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:24.788882 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6a390-50f0-4e86-9a5b-5a02ef3c9eb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:24.792794 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6a390-50f0-4e86-9a5b-5a02ef3c9eb5 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:24.816012 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 453/900] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:24.817486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6a390-50f0-4e86-9a5b-5a02ef3c9eb5 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:24.906417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd9bad-4213-4e72-b09a-02478c0e3eba None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:24.931488 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:24.995469 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630d741-0d0b-4d80-8a9e-1abc55e9c8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:24.996591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630d741-0d0b-4d80-8a9e-1abc55e9c8d7 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:24.997071 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630d741-0d0b-4d80-8a9e-1abc55e9c8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:24.997594 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630d741-0d0b-4d80-8a9e-1abc55e9c8d7 None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:24.998715 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630d741-0d0b-4d80-8a9e-1abc55e9c8d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:25.001333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630d741-0d0b-4d80-8a9e-1abc55e9c8d7 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:25.014004 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 448/901] 10.222.0.94 () {56 vars in 1087 bytes} [Wed Aug 24 04:36:24 2022] GET /identity/v3/services => generated 1268 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:36:25.039526 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6a390-50f0-4e86-9a5b-5a02ef3c9eb5 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:25.095232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c81d59-dabf-42d0-bb62-7b6d0679633c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:25.096582 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c81d59-dabf-42d0-bb62-7b6d0679633c None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:25.097357 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c81d59-dabf-42d0-bb62-7b6d0679633c None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:25.098196 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c81d59-dabf-42d0-bb62-7b6d0679633c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:25.114491 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c81d59-dabf-42d0-bb62-7b6d0679633c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:25.118164 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c81d59-dabf-42d0-bb62-7b6d0679633c None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:25.144650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-d1c81d59-dabf-42d0-bb62-7b6d0679633c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:36:25.144650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:25.144650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:25.144650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:25.144650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:25.144650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:25.144650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:25.144650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:25.144650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:25.144650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:25.144650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:25.144650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:25.144650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:25.144650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:25.144650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:25.144650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:25.146220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:25.146220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:25.146220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:25.146220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:25.146220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:25.146220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:25.146220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:25.146220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:25.146220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:25.146220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:25.146220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:25.146220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:25.146220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:25.146220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:25.146220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:25.146220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:25.146220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:25.146220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:25.148182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:25.148182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:25.148182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:25.148182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:25.148182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:25.148182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:25.148182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:25.148182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:25.148182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:36:25.148182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:25.157754 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 454/902] 10.222.0.94 () {56 vars in 1117 bytes} [Wed Aug 24 04:36:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:25.165064 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630d741-0d0b-4d80-8a9e-1abc55e9c8d7 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:25.177729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241afeea-f1f6-441a-887c-fde511eb8fa9 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:25.178243 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241afeea-f1f6-441a-887c-fde511eb8fa9 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:25.178706 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241afeea-f1f6-441a-887c-fde511eb8fa9 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:25.188821 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 455/903] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:25.191412 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c10776-0536-4719-a091-7918f24a83e0 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:25.191869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c10776-0536-4719-a091-7918f24a83e0 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:25.192815 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c10776-0536-4719-a091-7918f24a83e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:25.227804 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-92c10776-0536-4719-a091-7918f24a83e0 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:25.230084 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-92c10776-0536-4719-a091-7918f24a83e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:25.334743 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:25.343259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630d741-0d0b-4d80-8a9e-1abc55e9c8d7 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:25.392077 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 456/904] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:36:25.394833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d7941-e81d-4b58-9087-2bebf5b8d5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:25.395464 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d7941-e81d-4b58-9087-2bebf5b8d5ff None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:25.395752 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d7941-e81d-4b58-9087-2bebf5b8d5ff None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:25.396030 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d7941-e81d-4b58-9087-2bebf5b8d5ff None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:25.396784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d7941-e81d-4b58-9087-2bebf5b8d5ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:25.397091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d7941-e81d-4b58-9087-2bebf5b8d5ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:25.398598 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d7941-e81d-4b58-9087-2bebf5b8d5ff None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:25.421992 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 449/905] 10.222.0.94 () {56 vars in 1149 bytes} [Wed Aug 24 04:36:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:25.427766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c10776-0536-4719-a091-7918f24a83e0 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:25.548719 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c10776-0536-4719-a091-7918f24a83e0 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:25.570546 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbfd1c-ad6d-4cb8-bcb3-d1dfe0dda3e6 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:25.571414 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbfd1c-ad6d-4cb8-bcb3-d1dfe0dda3e6 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:25.572116 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbfd1c-ad6d-4cb8-bcb3-d1dfe0dda3e6 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:25.581425 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 450/906] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:36:25.583225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dacb5a-6dcb-41e2-bf2a-7302b05fc489 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:25.583508 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dacb5a-6dcb-41e2-bf2a-7302b05fc489 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:25.583790 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dacb5a-6dcb-41e2-bf2a-7302b05fc489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:25.591877 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a3aa3-514c-49c0-84f3-3d57b6fa2911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:25.592514 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a3aa3-514c-49c0-84f3-3d57b6fa2911 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:25.593679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a3aa3-514c-49c0-84f3-3d57b6fa2911 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:25.594013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a3aa3-514c-49c0-84f3-3d57b6fa2911 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:25.609235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-53dacb5a-6dcb-41e2-bf2a-7302b05fc489 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:25.610931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-53dacb5a-6dcb-41e2-bf2a-7302b05fc489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:25.677897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:25.689482 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:25.729618 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 451/907] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:25.729618 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dacb5a-6dcb-41e2-bf2a-7302b05fc489 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:25.730990 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a3aa3-514c-49c0-84f3-3d57b6fa2911 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:25.732624 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a3aa3-514c-49c0-84f3-3d57b6fa2911 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:25.861304 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 457/908] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:25 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 04:36:25.862555 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a3aa3-514c-49c0-84f3-3d57b6fa2911 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:25.870357 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dacb5a-6dcb-41e2-bf2a-7302b05fc489 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:25.914132 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e16627-2dd2-4eda-a352-ebcc02628898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:25.914920 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e16627-2dd2-4eda-a352-ebcc02628898 None admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:25.915331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e16627-2dd2-4eda-a352-ebcc02628898 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:25.915689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e16627-2dd2-4eda-a352-ebcc02628898 None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:25.916462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e16627-2dd2-4eda-a352-ebcc02628898 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:25.918097 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e16627-2dd2-4eda-a352-ebcc02628898 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:25.936836 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 452/909] 10.222.0.94 () {60 vars in 1141 bytes} [Wed Aug 24 04:36:25 2022] POST /identity/v3/services => generated 241 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:25.958985 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:25.987730 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a3aa3-514c-49c0-84f3-3d57b6fa2911 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:26.044276 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c7c97-101b-4c48-98ef-3a75e357228f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:26.045427 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c7c97-101b-4c48-98ef-3a75e357228f None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:26.046045 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c7c97-101b-4c48-98ef-3a75e357228f None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:26.046569 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c7c97-101b-4c48-98ef-3a75e357228f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:26.060194 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c7c97-101b-4c48-98ef-3a75e357228f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:26.062133 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c7c97-101b-4c48-98ef-3a75e357228f None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:26.079703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-d84c7c97-101b-4c48-98ef-3a75e357228f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:26.079703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:26.079703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:26.079703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:26.079703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:26.079703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:26.079703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:26.079703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:26.079703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:26.079703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:26.079703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:26.079703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:26.079703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:26.079703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:26.079703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:26.079703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:26.080870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:26.080870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:26.080870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:26.080870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:26.080870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:26.080870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:26.080870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:26.080870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:26.080870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:26.080870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:26.080870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:26.080870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:26.080870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:26.080870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:26.080870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:26.080870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:26.080870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:26.081828 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:26.081828 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:26.081828 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:26.084205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 458/910] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:26.091965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e16627-2dd2-4eda-a352-ebcc02628898 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:26.127200 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:26.164105 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c7c97-101b-4c48-98ef-3a75e357228f None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:26.271281 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e16627-2dd2-4eda-a352-ebcc02628898 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:26.304490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c7c97-101b-4c48-98ef-3a75e357228f None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:26.340134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:26.351392 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f256b-337c-41c1-aedb-059a0872d8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:26.353515 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f256b-337c-41c1-aedb-059a0872d8e8 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:26.353937 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f256b-337c-41c1-aedb-059a0872d8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:26.354321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f256b-337c-41c1-aedb-059a0872d8e8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:26.355151 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f256b-337c-41c1-aedb-059a0872d8e8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:26.357016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f256b-337c-41c1-aedb-059a0872d8e8 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:26.366257 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3935b3-4a0f-46c0-9fd3-e17735875d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:26.367013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-5c0f256b-337c-41c1-aedb-059a0872d8e8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:36:26.367013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:26.367013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:36:26.367013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:36:26.367013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:36:26.367013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:36:26.367013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:36:26.367013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:26.367013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:36:26.367013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:26.367013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:36:26.367013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:26.367013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:26.367013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:26.367013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:26.367013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:26.367013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:26.369647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:26.369647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:26.369647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:26.369647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:26.369647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:26.369647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:26.369647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:36:26.369647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:36:26.369647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:36:26.369647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:36:26.369647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:26.369647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:26.369647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:26.369647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:26.369647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:26.369647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:26.371205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:26.371205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:26.371205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:26.371205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:26.371205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:26.371205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:26.371205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:26.371205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:26.371205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:26.371205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:26.371205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:36:26.371205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:26.371205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:36:26.371205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:26.374049 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3935b3-4a0f-46c0-9fd3-e17735875d86 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:26.374363 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 459/911] 10.222.0.94 () {56 vars in 1114 bytes} [Wed Aug 24 04:36:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:26.374960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3935b3-4a0f-46c0-9fd3-e17735875d86 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:26.375433 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f256b-337c-41c1-aedb-059a0872d8e8 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:26.376132 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3935b3-4a0f-46c0-9fd3-e17735875d86 None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:26.377670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3935b3-4a0f-46c0-9fd3-e17735875d86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:26.378391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3935b3-4a0f-46c0-9fd3-e17735875d86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:26.382802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3935b3-4a0f-46c0-9fd3-e17735875d86 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:26.406150 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 453/912] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:26.412076 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3935b3-4a0f-46c0-9fd3-e17735875d86 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:26.522766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f256b-337c-41c1-aedb-059a0872d8e8 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:26.552046 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:26.568014 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef2d9e-f31c-4211-a18d-732485c09fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:26.568938 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef2d9e-f31c-4211-a18d-732485c09fab None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:26.569933 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef2d9e-f31c-4211-a18d-732485c09fab None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:26.570433 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef2d9e-f31c-4211-a18d-732485c09fab None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:26.571370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef2d9e-f31c-4211-a18d-732485c09fab None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:26.572134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef2d9e-f31c-4211-a18d-732485c09fab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:26.573915 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef2d9e-f31c-4211-a18d-732485c09fab None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:26.581286 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 460/913] 10.222.0.94 () {56 vars in 1114 bytes} [Wed Aug 24 04:36:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:26.585441 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3935b3-4a0f-46c0-9fd3-e17735875d86 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:26.587577 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef2d9e-f31c-4211-a18d-732485c09fab None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:26.632243 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bd075-7869-42a2-8993-cb7e157055d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:26.633705 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bd075-7869-42a2-8993-cb7e157055d0 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:26.634234 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bd075-7869-42a2-8993-cb7e157055d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:26.634724 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bd075-7869-42a2-8993-cb7e157055d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:26.644822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bd075-7869-42a2-8993-cb7e157055d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:26.648978 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bd075-7869-42a2-8993-cb7e157055d0 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:26.660103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:26.668629 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-b33bd075-7869-42a2-8993-cb7e157055d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:26.668629 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:26.668629 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:26.668629 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:26.668629 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:26.668629 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:26.668629 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:26.668629 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:26.668629 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:26.668629 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:26.668629 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:26.668629 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:26.668629 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:26.668629 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:26.668629 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:26.670384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:26.670384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:26.670384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:26.670384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:26.670384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:26.670384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:26.670384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:26.670384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:26.670384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:26.670384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:26.670384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:26.670384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:26.670384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:26.670384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:26.670384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:26.670384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:26.670384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:26.672049 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:26.672049 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:26.672049 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:26.672049 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:26.672049 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:26.672049 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:26.672049 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:26.672049 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:26.676503 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 454/914] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:26.688861 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bd075-7869-42a2-8993-cb7e157055d0 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:26.759360 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef2d9e-f31c-4211-a18d-732485c09fab None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:26.805521 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863c214-e70b-4a4f-8273-6fe19db1a887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:26.806177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863c214-e70b-4a4f-8273-6fe19db1a887 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:26.806488 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863c214-e70b-4a4f-8273-6fe19db1a887 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:26.806761 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863c214-e70b-4a4f-8273-6fe19db1a887 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:26.807471 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863c214-e70b-4a4f-8273-6fe19db1a887 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:26.807775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863c214-e70b-4a4f-8273-6fe19db1a887 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:26.810349 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863c214-e70b-4a4f-8273-6fe19db1a887 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:26.816752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 461/915] 10.222.0.94 () {56 vars in 1114 bytes} [Wed Aug 24 04:36:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:26.823842 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863c214-e70b-4a4f-8273-6fe19db1a887 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:26.850202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bd075-7869-42a2-8993-cb7e157055d0 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:26.902675 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fcf97-fdd3-46ca-b22d-7433e3c09f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:26.903781 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fcf97-fdd3-46ca-b22d-7433e3c09f36 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:26.904352 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fcf97-fdd3-46ca-b22d-7433e3c09f36 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:26.904890 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fcf97-fdd3-46ca-b22d-7433e3c09f36 None admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:26.906123 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fcf97-fdd3-46ca-b22d-7433e3c09f36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:26.906660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fcf97-fdd3-46ca-b22d-7433e3c09f36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:26.908485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fcf97-fdd3-46ca-b22d-7433e3c09f36 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:26.921034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:26.932922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 455/916] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:26.934483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fcf97-fdd3-46ca-b22d-7433e3c09f36 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:26.957805 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863c214-e70b-4a4f-8273-6fe19db1a887 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:26.980383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:27.004852 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550fb72-d1d2-446a-a1e1-978edea16c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:27.004852 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550fb72-d1d2-446a-a1e1-978edea16c49 None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:27.004852 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550fb72-d1d2-446a-a1e1-978edea16c49 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:27.004852 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550fb72-d1d2-446a-a1e1-978edea16c49 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:27.006483 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550fb72-d1d2-446a-a1e1-978edea16c49 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:27.006483 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550fb72-d1d2-446a-a1e1-978edea16c49 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:27.053441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 462/917] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:36:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:36:27.100124 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fcf97-fdd3-46ca-b22d-7433e3c09f36 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:27.162004 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a1d03-0cc7-4b3d-84b5-8c9f30a997f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:27.162914 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a1d03-0cc7-4b3d-84b5-8c9f30a997f5 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:27.163194 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a1d03-0cc7-4b3d-84b5-8c9f30a997f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:27.163464 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a1d03-0cc7-4b3d-84b5-8c9f30a997f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:27.164226 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a1d03-0cc7-4b3d-84b5-8c9f30a997f5 None admin] RBAC: Adding query filter params (role.id=17fd0dec2fe84d3bb5e22753c3e1300e, scope.project.id=4416325d266642f3a786ff9f16c827aa, user.id=7caa973c63e64d639cc2fb55a4955542) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:27.165112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a1d03-0cc7-4b3d-84b5-8c9f30a997f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:27.166609 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a1d03-0cc7-4b3d-84b5-8c9f30a997f5 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:27.173675 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 456/918] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:36:26 2022] GET /identity/v3/role_assignments?user.id=7caa973c63e64d639cc2fb55a4955542&scope.project.id=4416325d266642f3a786ff9f16c827aa&role.id=17fd0dec2fe84d3bb5e22753c3e1300e => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:28.258855 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4917c1-620a-4501-9732-6aa6e040724a None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:28.259749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4917c1-620a-4501-9732-6aa6e040724a None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:28.259749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4917c1-620a-4501-9732-6aa6e040724a None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:28.261113 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 463/919] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:28.267183 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f50b16-bef1-4427-aace-4d444dc6c794 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:28.267703 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f50b16-bef1-4427-aace-4d444dc6c794 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:28.267703 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f50b16-bef1-4427-aace-4d444dc6c794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:28.290175 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-f6f50b16-bef1-4427-aace-4d444dc6c794 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:28.291405 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-f6f50b16-bef1-4427-aace-4d444dc6c794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:28.366456 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:28.380650 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 457/920] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:28.603232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d34a3-bf5f-4713-bbf9-29844caf2d16 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:28.603889 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d34a3-bf5f-4713-bbf9-29844caf2d16 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:28.604366 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d34a3-bf5f-4713-bbf9-29844caf2d16 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:28.606312 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 464/921] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:28.615434 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b2d64-bbdd-419a-a47e-1ed03b4cb2fd None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:28.615935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b2d64-bbdd-419a-a47e-1ed03b4cb2fd None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:28.616404 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b2d64-bbdd-419a-a47e-1ed03b4cb2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:28.648350 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-da5b2d64-bbdd-419a-a47e-1ed03b4cb2fd None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:28.651051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-da5b2d64-bbdd-419a-a47e-1ed03b4cb2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:28.746233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d34a3-bf5f-4713-bbf9-29844caf2d16 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:28.758017 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 458/922] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:36:28.960302 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d34a3-bf5f-4713-bbf9-29844caf2d16 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:29.034411 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e5851-1651-440f-bda5-77f3191194a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:29.035483 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e5851-1651-440f-bda5-77f3191194a6 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:29.035979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e5851-1651-440f-bda5-77f3191194a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:29.036465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e5851-1651-440f-bda5-77f3191194a6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:29.037588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e5851-1651-440f-bda5-77f3191194a6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:29.041424 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e5851-1651-440f-bda5-77f3191194a6 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:29.059973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-4d4e5851-1651-440f-bda5-77f3191194a6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:36:29.059973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:29.059973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:36:29.059973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:36:29.059973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:36:29.059973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:36:29.059973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:36:29.059973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:29.059973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:36:29.059973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:29.059973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:36:29.059973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:29.059973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:29.059973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:29.059973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:29.059973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:29.059973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:29.061091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:29.061091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:29.061091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:29.061091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:29.061091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:29.061091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:29.061091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:36:29.061091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:36:29.061091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:36:29.061091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:36:29.061091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:29.061091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:29.061091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:29.061091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:29.061091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:29.061091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:29.061988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:29.061988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:29.061988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:29.061988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:29.061988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:29.061988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:29.061988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:29.061988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:29.061988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:29.061988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:29.061988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:36:29.061988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:29.061988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:36:29.061988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:29.069533 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 465/923] 10.222.0.94 () {56 vars in 1126 bytes} [Wed Aug 24 04:36:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:29.072956 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b2d64-bbdd-419a-a47e-1ed03b4cb2fd None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:29.259003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b2d64-bbdd-419a-a47e-1ed03b4cb2fd None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:29.270944 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e5851-1651-440f-bda5-77f3191194a6 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:29.285844 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:29.307373 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e37301-0a46-4081-84ec-684d6dd3c543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:29.308572 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e37301-0a46-4081-84ec-684d6dd3c543 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:29.309122 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e37301-0a46-4081-84ec-684d6dd3c543 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:29.309761 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e37301-0a46-4081-84ec-684d6dd3c543 None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:29.310950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e37301-0a46-4081-84ec-684d6dd3c543 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:29.311456 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e37301-0a46-4081-84ec-684d6dd3c543 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:29.313484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e37301-0a46-4081-84ec-684d6dd3c543 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:29.323464 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 459/924] 10.222.0.94 () {56 vars in 1122 bytes} [Wed Aug 24 04:36:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:29.332696 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e37301-0a46-4081-84ec-684d6dd3c543 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:29.352735 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:29.447481 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e5851-1651-440f-bda5-77f3191194a6 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:29.509280 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900411e-ed51-4711-9221-01b578b27db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:29.510286 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900411e-ed51-4711-9221-01b578b27db2 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:29.510782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900411e-ed51-4711-9221-01b578b27db2 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:29.511272 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900411e-ed51-4711-9221-01b578b27db2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:29.512343 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900411e-ed51-4711-9221-01b578b27db2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:29.514744 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900411e-ed51-4711-9221-01b578b27db2 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:29.523452 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e37301-0a46-4081-84ec-684d6dd3c543 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:29.531275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-5900411e-ed51-4711-9221-01b578b27db2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:36:29.531275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:29.531275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:36:29.531275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:36:29.531275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:36:29.531275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:36:29.531275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:36:29.531275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:29.531275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:36:29.531275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:29.531275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:36:29.531275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:29.531275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:29.531275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:29.531275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:29.531275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:29.532313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:29.532313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:29.532313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:29.532313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:29.532313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:29.532313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:29.532313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:29.532313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:36:29.532313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:36:29.532313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:36:29.532313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:36:29.532313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:29.532313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:29.532313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:29.532313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:29.532313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:29.532313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:29.533230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:29.533230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:29.533230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:29.533230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:29.533230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:29.533230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:29.533230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:29.533230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:29.533230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:29.533230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:29.533230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:36:29.533230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:29.533230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:36:29.533230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:29.534471 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 466/925] 10.222.0.94 () {56 vars in 1132 bytes} [Wed Aug 24 04:36:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:29.536005 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d019e-c7a8-46a2-ba60-74a57d1f5c7f None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:29.536431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d019e-c7a8-46a2-ba60-74a57d1f5c7f None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:29.536890 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d019e-c7a8-46a2-ba60-74a57d1f5c7f None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:29.539499 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 467/926] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:29.541378 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a769b-f22e-413f-bcd6-d838b65df70c None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:29.541906 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a769b-f22e-413f-bcd6-d838b65df70c None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:29.542358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a769b-f22e-413f-bcd6-d838b65df70c None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:29.545551 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 468/927] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:29.546831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a769b-f22e-413f-bcd6-d838b65df70c None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:29.568131 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afb9a3-d46f-4887-92a9-f435bae60c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:29.568750 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afb9a3-d46f-4887-92a9-f435bae60c89 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:29.569029 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afb9a3-d46f-4887-92a9-f435bae60c89 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:29.569301 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afb9a3-d46f-4887-92a9-f435bae60c89 None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:29.569976 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afb9a3-d46f-4887-92a9-f435bae60c89 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:29.570280 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afb9a3-d46f-4887-92a9-f435bae60c89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:29.572232 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afb9a3-d46f-4887-92a9-f435bae60c89 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:29.577903 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 460/928] 10.222.0.94 () {56 vars in 1122 bytes} [Wed Aug 24 04:36:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:29.578968 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d6194-d82b-4cae-a9a0-a1c3043172c3 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:29.579256 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d6194-d82b-4cae-a9a0-a1c3043172c3 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:29.579527 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d6194-d82b-4cae-a9a0-a1c3043172c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:29.598567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-fd3d6194-d82b-4cae-a9a0-a1c3043172c3 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:29.599809 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-fd3d6194-d82b-4cae-a9a0-a1c3043172c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:29.652987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:29.690954 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 461/929] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:29.694694 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa03b2-1214-4732-82c1-c98f2b8be148 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:29.695196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa03b2-1214-4732-82c1-c98f2b8be148 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:29.696347 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa03b2-1214-4732-82c1-c98f2b8be148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:29.728698 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-0daa03b2-1214-4732-82c1-c98f2b8be148 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:29.730930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-0daa03b2-1214-4732-82c1-c98f2b8be148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:29.734691 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a769b-f22e-413f-bcd6-d838b65df70c None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:29.737750 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:29.792374 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8d157-fbcc-4fea-92e6-f82ce1da9abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:29.793492 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8d157-fbcc-4fea-92e6-f82ce1da9abc None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:29.793924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8d157-fbcc-4fea-92e6-f82ce1da9abc None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:29.794396 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8d157-fbcc-4fea-92e6-f82ce1da9abc None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:29.795350 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8d157-fbcc-4fea-92e6-f82ce1da9abc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:29.796047 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8d157-fbcc-4fea-92e6-f82ce1da9abc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:29.798794 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8d157-fbcc-4fea-92e6-f82ce1da9abc None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:29.809923 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 469/930] 10.222.0.94 () {56 vars in 1126 bytes} [Wed Aug 24 04:36:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:29.811780 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8d157-fbcc-4fea-92e6-f82ce1da9abc None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:29.866618 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 462/931] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:29.866618 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa03b2-1214-4732-82c1-c98f2b8be148 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:30.002871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8d157-fbcc-4fea-92e6-f82ce1da9abc None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:30.059778 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa03b2-1214-4732-82c1-c98f2b8be148 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:30.061191 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2dbeff-3caf-4b6d-8713-918050bed171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:30.062479 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dbeff-3caf-4b6d-8713-918050bed171 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:30.063966 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dbeff-3caf-4b6d-8713-918050bed171 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:30.064462 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dbeff-3caf-4b6d-8713-918050bed171 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:30.065632 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2dbeff-3caf-4b6d-8713-918050bed171 None admin] RBAC: Adding query filter params (interface=public, service_id=cb1746bdc07f47ebab9325057667d521, region_id=RegionOne) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:30.066174 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2dbeff-3caf-4b6d-8713-918050bed171 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:30.067927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2dbeff-3caf-4b6d-8713-918050bed171 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:30.073465 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:30.085356 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 470/932] 10.222.0.94 () {56 vars in 1251 bytes} [Wed Aug 24 04:36:29 2022] GET /identity/v3/endpoints?service_id=cb1746bdc07f47ebab9325057667d521&interface=public®ion_id=RegionOne => generated 194 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:30.085356 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2dbeff-3caf-4b6d-8713-918050bed171 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:30.120598 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:30.127886 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd0ecf-9cc0-4cc0-a217-7944c46cf1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:30.128873 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd0ecf-9cc0-4cc0-a217-7944c46cf1c5 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:30.129348 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd0ecf-9cc0-4cc0-a217-7944c46cf1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:30.129897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd0ecf-9cc0-4cc0-a217-7944c46cf1c5 None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:30.131047 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd0ecf-9cc0-4cc0-a217-7944c46cf1c5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:30.131595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd0ecf-9cc0-4cc0-a217-7944c46cf1c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:30.134302 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd0ecf-9cc0-4cc0-a217-7944c46cf1c5 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:30.142930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 463/933] 10.222.0.94 () {56 vars in 1126 bytes} [Wed Aug 24 04:36:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:30.142930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd0ecf-9cc0-4cc0-a217-7944c46cf1c5 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:30.216528 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2dbeff-3caf-4b6d-8713-918050bed171 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:30.256238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff9e03-432d-4bb2-b65b-b40e78f66f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:30.256966 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff9e03-432d-4bb2-b65b-b40e78f66f26 None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:30.257333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff9e03-432d-4bb2-b65b-b40e78f66f26 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:30.257799 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff9e03-432d-4bb2-b65b-b40e78f66f26 None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:30.259097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff9e03-432d-4bb2-b65b-b40e78f66f26 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:30.260618 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff9e03-432d-4bb2-b65b-b40e78f66f26 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:30.263313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: WARNING keystone.server.flask.common [None req-91ff9e03-432d-4bb2-b65b-b40e78f66f26 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 04:36:30.276495 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd0ecf-9cc0-4cc0-a217-7944c46cf1c5 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:30.281903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.sql.core [None req-91ff9e03-432d-4bb2-b65b-b40e78f66f26 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 04:36:30.281903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 04:36:30.281903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [parameters: {'id': 'fb1effeab6c3435fa643259df547b3cf', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 04:36:30.281903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93412) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 04:36:30.298242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-91ff9e03-432d-4bb2-b65b-b40e78f66f26 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fb1effeab6c3435fa643259df547b3cf.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fb1effeab6c3435fa643259df547b3cf. Aug 24 04:36:30.298242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:30.298242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:36:30.298242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:36:30.298242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:36:30.298242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:36:30.298242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:36:30.298242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:36:30.298242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:36:30.298242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:36:30.298242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:36:30.298242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:36:30.298242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:36:30.299205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application result.read() Aug 24 04:36:30.299205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:36:30.299205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:36:30.299205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:36:30.299205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:36:30.299205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:36:30.299205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:36:30.299205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:36:30.299205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:36:30.299205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 04:36:30.299205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:30.299205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 04:36:30.299205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:30.299205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:30.299205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 04:36:30.299205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 04:36:30.299205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 04:36:30.299205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 04:36:30.300208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:36:30.300208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:36:30.300208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 04:36:30.300208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application yield resource Aug 24 04:36:30.300208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:36:30.300208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:36:30.300208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 04:36:30.300208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 04:36:30.300208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 04:36:30.300208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 04:36:30.300208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 04:36:30.300208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise self.value Aug 24 04:36:30.300208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 04:36:30.300208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 04:36:30.300208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 04:36:30.300208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application session.commit() Aug 24 04:36:30.300208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 04:36:30.301206 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 04:36:30.301206 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 04:36:30.301206 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 04:36:30.301206 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 04:36:30.301206 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self.session.flush() Aug 24 04:36:30.301206 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 04:36:30.301206 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 04:36:30.301206 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 04:36:30.301206 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 04:36:30.301206 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 04:36:30.301206 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application compat.raise_( Aug 24 04:36:30.301206 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:36:30.301206 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception Aug 24 04:36:30.301206 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 04:36:30.301206 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 04:36:30.301206 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 04:36:30.301206 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 04:36:30.303288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 04:36:30.303288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 04:36:30.303288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 04:36:30.303288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 04:36:30.303288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 04:36:30.303288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 04:36:30.303288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 04:36:30.303288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 04:36:30.303288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 04:36:30.303288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 04:36:30.303288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 04:36:30.303288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 04:36:30.303288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 04:36:30.303288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 04:36:30.303288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 04:36:30.305751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 04:36:30.305751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:36:30.305751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception Aug 24 04:36:30.305751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:36:30.305751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:36:30.305751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:36:30.305751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:36:30.305751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:36:30.305751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:36:30.305751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:36:30.305751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:36:30.305751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:36:30.305751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:36:30.305751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:36:30.305751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application result.read() Aug 24 04:36:30.305751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:36:30.305751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:36:30.306927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:36:30.306927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:36:30.306927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:36:30.306927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:36:30.306927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:36:30.306927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:36:30.306927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 04:36:30.306927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 04:36:30.306927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [parameters: {'id': 'fb1effeab6c3435fa643259df547b3cf', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 04:36:30.306927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 04:36:30.306927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:30.306927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:36:30.306927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:30.306927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:30.306927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 04:36:30.307979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 04:36:30.307979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 04:36:30.307979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 04:36:30.307979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 04:36:30.307979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:30.307979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:36:30.307979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:30.307979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:30.307979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:30.307979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:30.307979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:30.307979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:30.307979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:30.307979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:30.307979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:30.307979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:30.307979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:30.309214 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:30.309214 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 04:36:30.309214 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 04:36:30.309214 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:30.309214 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:30.309214 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 04:36:30.309214 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 04:36:30.309214 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fb1effeab6c3435fa643259df547b3cf. Aug 24 04:36:30.309214 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:30.309214 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 471/934] 10.222.0.94 () {60 vars in 1140 bytes} [Wed Aug 24 04:36:30 2022] POST /identity/v3/projects => generated 262 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:30.309214 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff9e03-432d-4bb2-b65b-b40e78f66f26 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:30.318192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681599b-902c-45a9-8f6b-3a9041c13a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:30.318930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681599b-902c-45a9-8f6b-3a9041c13a59 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:30.319245 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681599b-902c-45a9-8f6b-3a9041c13a59 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:30.319514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681599b-902c-45a9-8f6b-3a9041c13a59 None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:30.320121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681599b-902c-45a9-8f6b-3a9041c13a59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:30.322346 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681599b-902c-45a9-8f6b-3a9041c13a59 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:30.329055 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 464/935] 10.222.0.94 () {56 vars in 1087 bytes} [Wed Aug 24 04:36:30 2022] GET /identity/v3/services => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:36:30.330002 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681599b-902c-45a9-8f6b-3a9041c13a59 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:30.373783 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:30.418765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:30.444826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff9e03-432d-4bb2-b65b-b40e78f66f26 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:30.477882 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681599b-902c-45a9-8f6b-3a9041c13a59 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:30.501881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99f706-e2b1-483b-9966-f27f22e321b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:30.502906 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99f706-e2b1-483b-9966-f27f22e321b3 None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:30.503466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99f706-e2b1-483b-9966-f27f22e321b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:30.503965 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99f706-e2b1-483b-9966-f27f22e321b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:30.505181 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99f706-e2b1-483b-9966-f27f22e321b3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:30.508755 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99f706-e2b1-483b-9966-f27f22e321b3 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:30.536987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae77873-10d3-4761-baa2-a7679f755458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:30.537947 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae77873-10d3-4761-baa2-a7679f755458 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:30.538441 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae77873-10d3-4761-baa2-a7679f755458 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:30.538875 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae77873-10d3-4761-baa2-a7679f755458 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:30.551653 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 472/936] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:36:30 2022] POST /identity/v3/endpoints => generated 347 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:30.552888 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99f706-e2b1-483b-9966-f27f22e321b3 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:30.568860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae77873-10d3-4761-baa2-a7679f755458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:30.585959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-8ae77873-10d3-4761-baa2-a7679f755458 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:36:30.585959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:30.585959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:30.585959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:30.585959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:30.585959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:30.585959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:30.585959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:30.585959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:30.585959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:30.585959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:30.585959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:30.585959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:30.585959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:30.585959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:30.585959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:30.588574 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:30.588574 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:30.588574 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:30.588574 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:30.588574 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:30.588574 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:30.588574 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:30.588574 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:30.588574 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:30.588574 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:30.588574 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:30.588574 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:30.588574 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:30.588574 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:30.588574 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:30.588574 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:30.590987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:30.590987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:30.590987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:30.590987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:30.590987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:30.590987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:30.590987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:30.590987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:30.590987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:30.590987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:30.590987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:36:30.590987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:30.593850 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 465/937] 10.222.0.94 () {56 vars in 1120 bytes} [Wed Aug 24 04:36:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:30.602128 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae77873-10d3-4761-baa2-a7679f755458 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:30.767070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:30.775526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae77873-10d3-4761-baa2-a7679f755458 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:30.782859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99f706-e2b1-483b-9966-f27f22e321b3 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:30.838500 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291f439-80a7-45d1-82f9-f1121ad797ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:30.839054 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291f439-80a7-45d1-82f9-f1121ad797ac None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:30.839484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291f439-80a7-45d1-82f9-f1121ad797ac None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:30.839908 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291f439-80a7-45d1-82f9-f1121ad797ac None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:30.840617 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291f439-80a7-45d1-82f9-f1121ad797ac None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:30.840928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291f439-80a7-45d1-82f9-f1121ad797ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:30.842941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291f439-80a7-45d1-82f9-f1121ad797ac None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:30.850272 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd92eb-3cdc-419c-8345-f83d038b09ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:30.851262 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd92eb-3cdc-419c-8345-f83d038b09ec None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:30.851979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd92eb-3cdc-419c-8345-f83d038b09ec None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:30.852428 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd92eb-3cdc-419c-8345-f83d038b09ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:30.854375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 466/938] 10.222.0.94 () {56 vars in 1115 bytes} [Wed Aug 24 04:36:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:30.862692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd92eb-3cdc-419c-8345-f83d038b09ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:30.863098 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291f439-80a7-45d1-82f9-f1121ad797ac None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:30.865153 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd92eb-3cdc-419c-8345-f83d038b09ec None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:30.873813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:30.884200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-e6dd92eb-3cdc-419c-8345-f83d038b09ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:30.884200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:30.884200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:30.884200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:30.884200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:30.884200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:30.884200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:30.884200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:30.884200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:30.884200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:30.884200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:30.884200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:30.884200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:30.884200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:30.884200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:30.885572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:30.885572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:30.885572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:30.885572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:30.885572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:30.885572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:30.885572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:30.885572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:30.885572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:30.885572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:30.885572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:30.885572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:30.885572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:30.885572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:30.885572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:30.885572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:30.885572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:30.886771 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:30.886771 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:30.886771 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:30.886771 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:30.886771 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:30.886771 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:30.886771 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:30.886771 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:30.894792 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 473/939] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:30.896670 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd92eb-3cdc-419c-8345-f83d038b09ec None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:31.028085 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291f439-80a7-45d1-82f9-f1121ad797ac None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:31.039838 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd92eb-3cdc-419c-8345-f83d038b09ec None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:31.069086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab60601-746a-4ab7-ab51-3ea4e4c6d156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:31.070073 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab60601-746a-4ab7-ab51-3ea4e4c6d156 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:31.071246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab60601-746a-4ab7-ab51-3ea4e4c6d156 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:31.071910 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab60601-746a-4ab7-ab51-3ea4e4c6d156 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:31.085359 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab60601-746a-4ab7-ab51-3ea4e4c6d156 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:31.087914 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df591c-97cc-4bcc-a440-29f57d47b16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:31.088372 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab60601-746a-4ab7-ab51-3ea4e4c6d156 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:31.088819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df591c-97cc-4bcc-a440-29f57d47b16e None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:31.089086 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df591c-97cc-4bcc-a440-29f57d47b16e None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:31.089607 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df591c-97cc-4bcc-a440-29f57d47b16e None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:31.090849 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df591c-97cc-4bcc-a440-29f57d47b16e None admin] RBAC: Adding query filter params (name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:31.091547 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df591c-97cc-4bcc-a440-29f57d47b16e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:31.094579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df591c-97cc-4bcc-a440-29f57d47b16e None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:31.106896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-3ab60601-746a-4ab7-ab51-3ea4e4c6d156 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:31.106896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:31.106896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:31.106896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:31.106896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:31.106896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:31.106896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:31.106896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:31.106896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:31.106896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:31.106896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:31.106896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:31.106896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:31.106896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:31.106896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:31.106896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:31.108144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:31.108144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:31.108144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:31.108144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:31.108144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:31.108144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:31.108144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:31.108144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:31.108144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:31.108144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:31.108144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:31.108144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:31.108144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:31.108144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:31.108144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:31.108144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:31.108144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:31.109204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:31.109204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:31.109204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:31.111108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 467/940] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:31.119056 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab60601-746a-4ab7-ab51-3ea4e4c6d156 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:31.121779 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 474/941] 10.222.0.94 () {56 vars in 1112 bytes} [Wed Aug 24 04:36:30 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:31.138934 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:31.264489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab60601-746a-4ab7-ab51-3ea4e4c6d156 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:31.306883 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a09fb9-558f-480f-b931-e7ba2e48fb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:31.307794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a09fb9-558f-480f-b931-e7ba2e48fb2d None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:31.308244 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a09fb9-558f-480f-b931-e7ba2e48fb2d None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:31.308666 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a09fb9-558f-480f-b931-e7ba2e48fb2d None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:31.309507 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a09fb9-558f-480f-b931-e7ba2e48fb2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:31.309978 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a09fb9-558f-480f-b931-e7ba2e48fb2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:31.311525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a09fb9-558f-480f-b931-e7ba2e48fb2d None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:31.327553 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 468/942] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:31.334338 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df591c-97cc-4bcc-a440-29f57d47b16e None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:31.416259 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:31.495595 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df591c-97cc-4bcc-a440-29f57d47b16e None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:31.559398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5521e-6a6b-45fe-9fbb-fb74e6b166d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:31.560446 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5521e-6a6b-45fe-9fbb-fb74e6b166d0 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:31.560921 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5521e-6a6b-45fe-9fbb-fb74e6b166d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:31.561397 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5521e-6a6b-45fe-9fbb-fb74e6b166d0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:31.572895 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b5521e-6a6b-45fe-9fbb-fb74e6b166d0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:31.574413 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b5521e-6a6b-45fe-9fbb-fb74e6b166d0 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:31.588992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-c3b5521e-6a6b-45fe-9fbb-fb74e6b166d0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:36:31.588992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:31.588992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:31.588992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:31.588992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:31.588992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:31.588992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:31.588992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:31.588992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:31.588992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:31.588992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:31.588992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:31.588992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:31.588992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:31.588992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:31.588992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:31.590083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:31.590083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:31.590083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:31.590083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:31.590083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:31.590083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:31.590083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:31.590083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:31.590083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:31.590083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:31.590083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:31.590083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:31.590083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:31.590083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:31.590083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:31.590083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:31.590083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:31.590083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:31.591070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:31.591070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:31.591070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:31.591070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:31.591070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:31.591070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:31.591070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:31.591070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:31.591070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:36:31.591070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:31.591070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 475/943] 10.222.0.94 () {56 vars in 1117 bytes} [Wed Aug 24 04:36:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:31.598201 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a09fb9-558f-480f-b931-e7ba2e48fb2d None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:31.685534 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:31.748288 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a09fb9-558f-480f-b931-e7ba2e48fb2d None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:31.808688 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbe89a-b6af-4ca6-8da7-e9519d1b72b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:31.809501 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbe89a-b6af-4ca6-8da7-e9519d1b72b6 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:31.809836 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbe89a-b6af-4ca6-8da7-e9519d1b72b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:31.810154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbe89a-b6af-4ca6-8da7-e9519d1b72b6 None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:31.812355 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfbe89a-b6af-4ca6-8da7-e9519d1b72b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:31.812726 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfbe89a-b6af-4ca6-8da7-e9519d1b72b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:31.814883 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfbe89a-b6af-4ca6-8da7-e9519d1b72b6 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:31.839310 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 469/944] 10.222.0.94 () {56 vars in 1149 bytes} [Wed Aug 24 04:36:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:31.845672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5521e-6a6b-45fe-9fbb-fb74e6b166d0 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:31.980821 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5521e-6a6b-45fe-9fbb-fb74e6b166d0 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:32.000892 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:32.022630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26277a1f-b1c2-4e98-83ee-1c36fbfc91d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:32.023801 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26277a1f-b1c2-4e98-83ee-1c36fbfc91d5 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:32.024606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26277a1f-b1c2-4e98-83ee-1c36fbfc91d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:32.025342 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26277a1f-b1c2-4e98-83ee-1c36fbfc91d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:32.038692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26277a1f-b1c2-4e98-83ee-1c36fbfc91d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:32.041608 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26277a1f-b1c2-4e98-83ee-1c36fbfc91d5 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:32.070067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-26277a1f-b1c2-4e98-83ee-1c36fbfc91d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:32.070067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:32.070067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:32.070067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:32.070067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:32.070067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:32.070067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:32.070067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:32.070067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:32.070067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:32.070067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:32.070067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:32.070067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:32.070067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:32.070067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:32.070067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:32.072402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:32.072402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:32.072402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:32.072402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:32.072402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:32.072402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:32.072402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:32.072402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:32.072402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:32.072402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:32.072402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:32.072402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:32.072402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:32.072402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:32.072402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:32.072402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:32.072402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:32.074187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:32.074187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:32.074187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:32.078216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 476/945] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:32.087740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbe89a-b6af-4ca6-8da7-e9519d1b72b6 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:32.274520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbe89a-b6af-4ca6-8da7-e9519d1b72b6 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:32.326303 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:32.335042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cb08a-eac6-46b0-8a4a-e5257fea0a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:32.335676 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cb08a-eac6-46b0-8a4a-e5257fea0a4e None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:32.337447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cb08a-eac6-46b0-8a4a-e5257fea0a4e None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:32.337447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cb08a-eac6-46b0-8a4a-e5257fea0a4e None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:32.337447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87cb08a-eac6-46b0-8a4a-e5257fea0a4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:32.337447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87cb08a-eac6-46b0-8a4a-e5257fea0a4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:32.338679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87cb08a-eac6-46b0-8a4a-e5257fea0a4e None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:32.351108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 470/946] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:32.356935 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26277a1f-b1c2-4e98-83ee-1c36fbfc91d5 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:32.475885 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26277a1f-b1c2-4e98-83ee-1c36fbfc91d5 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:32.516116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8932eb-a6db-47fe-88e7-192d26613b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:32.517107 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8932eb-a6db-47fe-88e7-192d26613b02 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:32.517609 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8932eb-a6db-47fe-88e7-192d26613b02 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:32.518071 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8932eb-a6db-47fe-88e7-192d26613b02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:32.527061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8932eb-a6db-47fe-88e7-192d26613b02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:32.528810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8932eb-a6db-47fe-88e7-192d26613b02 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:32.542119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-2e8932eb-a6db-47fe-88e7-192d26613b02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:32.542119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:32.542119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:32.542119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:32.542119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:32.542119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:32.542119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:32.542119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:32.542119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:32.542119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:32.542119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:32.542119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:32.542119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:32.542119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:32.542119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:32.543097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:32.543097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:32.543097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:32.543097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:32.543097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:32.543097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:32.543097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:32.543097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:32.543097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:32.543097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:32.543097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:32.543097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:32.543097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:32.543097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:32.543097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:32.543097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:32.543097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:32.544232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:32.544232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:32.544232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:32.544232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:32.544232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:32.544232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:32.544232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:32.544232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:32.547383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 477/947] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:32.556861 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cb08a-eac6-46b0-8a4a-e5257fea0a4e None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:32.700154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cb08a-eac6-46b0-8a4a-e5257fea0a4e None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:32.737899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3e567-a0f1-49a8-b2c2-200e63f1aab8 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:32.738217 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3e567-a0f1-49a8-b2c2-200e63f1aab8 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:32.738459 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3e567-a0f1-49a8-b2c2-200e63f1aab8 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:32.740162 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 478/948] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:32.744400 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef17a94-1125-47c7-bb77-a53b618ebf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:32.745936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef17a94-1125-47c7-bb77-a53b618ebf42 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:32.746336 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac77788-591d-40e2-90b1-c9d280b4ac04 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:32.746481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef17a94-1125-47c7-bb77-a53b618ebf42 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:32.746738 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef17a94-1125-47c7-bb77-a53b618ebf42 None admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:32.746842 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac77788-591d-40e2-90b1-c9d280b4ac04 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:32.747177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac77788-591d-40e2-90b1-c9d280b4ac04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:32.747828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef17a94-1125-47c7-bb77-a53b618ebf42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:32.748210 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef17a94-1125-47c7-bb77-a53b618ebf42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:32.750033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef17a94-1125-47c7-bb77-a53b618ebf42 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:32.764342 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 471/949] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:32.774728 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef17a94-1125-47c7-bb77-a53b618ebf42 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:32.779940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-9ac77788-591d-40e2-90b1-c9d280b4ac04 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:32.783785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-9ac77788-591d-40e2-90b1-c9d280b4ac04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:32.819994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:32.885816 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 479/950] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:32.897604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:32.959324 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d5b1a-21a7-422b-90e8-427e1cf2c0a7 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:32.959785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d5b1a-21a7-422b-90e8-427e1cf2c0a7 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:32.960251 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d5b1a-21a7-422b-90e8-427e1cf2c0a7 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:32.963878 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 480/951] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:32.969149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc2b9c-bb8b-4de1-abac-68222d5c0db1 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:32.969463 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc2b9c-bb8b-4de1-abac-68222d5c0db1 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:32.969746 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc2b9c-bb8b-4de1-abac-68222d5c0db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:32.989006 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-47cc2b9c-bb8b-4de1-abac-68222d5c0db1 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:32.990295 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-47cc2b9c-bb8b-4de1-abac-68222d5c0db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:32.996149 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef17a94-1125-47c7-bb77-a53b618ebf42 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:33.048270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e464221-3ecc-4ada-a49a-d650c4d459e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:33.049810 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e464221-3ecc-4ada-a49a-d650c4d459e8 None admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:33.050564 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e464221-3ecc-4ada-a49a-d650c4d459e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:33.051025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e464221-3ecc-4ada-a49a-d650c4d459e8 None admin] PATH_INFO: `/v3/projects/4416325d266642f3a786ff9f16c827aa/users/7caa973c63e64d639cc2fb55a4955542/roles/17fd0dec2fe84d3bb5e22753c3e1300e` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:33.054221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e464221-3ecc-4ada-a49a-d650c4d459e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=4416325d266642f3a786ff9f16c827aa, user_id=7caa973c63e64d639cc2fb55a4955542, role_id=17fd0dec2fe84d3bb5e22753c3e1300e)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:33.056669 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e464221-3ecc-4ada-a49a-d650c4d459e8 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:33.087094 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 472/952] 10.222.0.94 () {58 vars in 1439 bytes} [Wed Aug 24 04:36:32 2022] PUT /identity/v3/projects/4416325d266642f3a786ff9f16c827aa/users/7caa973c63e64d639cc2fb55a4955542/roles/17fd0dec2fe84d3bb5e22753c3e1300e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:33.097576 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 481/953] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:33.281234 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e464221-3ecc-4ada-a49a-d650c4d459e8 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:33.436596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e464221-3ecc-4ada-a49a-d650c4d459e8 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:33.448326 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:33.476088 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d5231-f32a-4e7d-a9ce-e09f59c55fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:33.476770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d5231-f32a-4e7d-a9ce-e09f59c55fbf None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:33.477044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d5231-f32a-4e7d-a9ce-e09f59c55fbf None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:33.477322 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d5231-f32a-4e7d-a9ce-e09f59c55fbf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:33.478148 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d5231-f32a-4e7d-a9ce-e09f59c55fbf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:33.479523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d5231-f32a-4e7d-a9ce-e09f59c55fbf None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:33.489299 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-f31d5231-f32a-4e7d-a9ce-e09f59c55fbf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:36:33.489299 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:33.489299 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:36:33.489299 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:36:33.489299 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:36:33.489299 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:36:33.489299 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:36:33.489299 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:33.489299 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:36:33.489299 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:33.489299 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:36:33.489299 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:33.489299 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:33.489299 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:33.489299 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:33.489299 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:33.489299 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:33.490498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:33.490498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:33.490498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:33.490498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:33.490498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:33.490498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:33.490498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:36:33.490498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:36:33.490498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:36:33.490498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:36:33.490498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:33.490498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:33.490498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:33.490498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:33.490498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:33.490498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:33.491412 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:33.491412 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:33.491412 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:33.491412 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:33.491412 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:33.491412 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:33.491412 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:33.491412 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:33.491412 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:33.491412 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:33.491412 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:36:33.491412 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:33.491412 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:36:33.491412 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:33.491412 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 473/954] 10.222.0.94 () {56 vars in 1126 bytes} [Wed Aug 24 04:36:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:33.498762 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc2b9c-bb8b-4de1-abac-68222d5c0db1 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:33.536936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d5231-f32a-4e7d-a9ce-e09f59c55fbf None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:33.603941 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:33.615981 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc2b9c-bb8b-4de1-abac-68222d5c0db1 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:33.650521 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d5231-f32a-4e7d-a9ce-e09f59c55fbf None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:33.654382 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fa649-ef5c-40bf-8b23-541595d09d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:33.654999 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fa649-ef5c-40bf-8b23-541595d09d79 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:33.655584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fa649-ef5c-40bf-8b23-541595d09d79 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:33.655856 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fa649-ef5c-40bf-8b23-541595d09d79 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:33.656491 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fa649-ef5c-40bf-8b23-541595d09d79 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:33.656790 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fa649-ef5c-40bf-8b23-541595d09d79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:33.658180 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fa649-ef5c-40bf-8b23-541595d09d79 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:33.669870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 482/955] 10.222.0.94 () {56 vars in 1122 bytes} [Wed Aug 24 04:36:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:33.669870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121e72c-4b07-4f0b-b901-e26f5b56b71e None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:33.669870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121e72c-4b07-4f0b-b901-e26f5b56b71e None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:33.669870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121e72c-4b07-4f0b-b901-e26f5b56b71e None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:33.669870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 483/956] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:33.673760 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121e72c-4b07-4f0b-b901-e26f5b56b71e None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:33.695174 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906b58a-acb5-441e-8a13-6ab9aa9b2ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:33.695986 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906b58a-acb5-441e-8a13-6ab9aa9b2ec5 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:33.696089 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906b58a-acb5-441e-8a13-6ab9aa9b2ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:33.696382 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906b58a-acb5-441e-8a13-6ab9aa9b2ec5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:33.696905 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906b58a-acb5-441e-8a13-6ab9aa9b2ec5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:33.698310 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906b58a-acb5-441e-8a13-6ab9aa9b2ec5 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:33.707754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-4906b58a-acb5-441e-8a13-6ab9aa9b2ec5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:36:33.707754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:33.707754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:36:33.707754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:36:33.707754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:36:33.707754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:36:33.707754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:36:33.707754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:33.707754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:36:33.707754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:33.707754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:36:33.707754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:33.707754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:33.707754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:33.707754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:33.707754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:33.707754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:33.708784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:33.708784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:33.708784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:33.708784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:33.708784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:33.708784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:33.708784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:36:33.708784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:36:33.708784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:36:33.708784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:36:33.708784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:33.708784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:33.708784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:33.708784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:33.708784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:33.708784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:33.710154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:33.710154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:33.710154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:33.710154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:33.710154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:33.710154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:33.710154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:33.710154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:33.710154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:33.710154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:33.710154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:36:33.710154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:33.710154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:36:33.710154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:33.710154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 474/957] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:33.711034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7579095-20bf-4b57-9945-24a512b30028 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:33.711034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7579095-20bf-4b57-9945-24a512b30028 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:33.711034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7579095-20bf-4b57-9945-24a512b30028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:33.733088 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-b7579095-20bf-4b57-9945-24a512b30028 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:33.734330 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-b7579095-20bf-4b57-9945-24a512b30028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:33.769117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:33.800361 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121e72c-4b07-4f0b-b901-e26f5b56b71e None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:33.825432 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 475/958] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:33.825432 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7579095-20bf-4b57-9945-24a512b30028 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:33.845103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a876a00-e630-4925-821d-a5ccc4a77588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:33.845766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a876a00-e630-4925-821d-a5ccc4a77588 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:33.846463 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a876a00-e630-4925-821d-a5ccc4a77588 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:33.846801 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a876a00-e630-4925-821d-a5ccc4a77588 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:33.847783 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a876a00-e630-4925-821d-a5ccc4a77588 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:33.848089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a876a00-e630-4925-821d-a5ccc4a77588 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:33.850120 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a876a00-e630-4925-821d-a5ccc4a77588 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:33.861866 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 484/959] 10.222.0.94 () {56 vars in 1122 bytes} [Wed Aug 24 04:36:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:33.863871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a876a00-e630-4925-821d-a5ccc4a77588 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:33.892309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:33.963126 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7579095-20bf-4b57-9945-24a512b30028 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:33.994492 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a876a00-e630-4925-821d-a5ccc4a77588 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:34.004022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae7bf5-86ff-48f3-bded-06987eeb819e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:34.004667 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae7bf5-86ff-48f3-bded-06987eeb819e None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:34.005084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae7bf5-86ff-48f3-bded-06987eeb819e None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:34.005541 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae7bf5-86ff-48f3-bded-06987eeb819e None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:34.006381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae7bf5-86ff-48f3-bded-06987eeb819e None admin] RBAC: Adding query filter params (name=compute) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:34.006899 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae7bf5-86ff-48f3-bded-06987eeb819e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:34.009043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae7bf5-86ff-48f3-bded-06987eeb819e None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:34.017225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 476/960] 10.222.0.94 () {56 vars in 1112 bytes} [Wed Aug 24 04:36:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:34.031398 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae7bf5-86ff-48f3-bded-06987eeb819e None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:34.046162 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e2118-e8cd-4ff3-b238-7ddf19f53efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:34.047037 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e2118-e8cd-4ff3-b238-7ddf19f53efb None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:34.047502 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e2118-e8cd-4ff3-b238-7ddf19f53efb None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:34.047989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e2118-e8cd-4ff3-b238-7ddf19f53efb None admin] PATH_INFO: `/v3/endpoints` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:34.049001 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e2118-e8cd-4ff3-b238-7ddf19f53efb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:34.050905 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e2118-e8cd-4ff3-b238-7ddf19f53efb None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:34.076674 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:34.082647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 485/961] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:36:33 2022] POST /identity/v3/endpoints => generated 349 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:36:34.202898 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e2118-e8cd-4ff3-b238-7ddf19f53efb None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:34.209849 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae7bf5-86ff-48f3-bded-06987eeb819e None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:34.279793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f346b-9b2a-4bda-afa4-6d600a081f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:34.280667 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f346b-9b2a-4bda-afa4-6d600a081f71 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:34.280954 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f346b-9b2a-4bda-afa4-6d600a081f71 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:34.281223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f346b-9b2a-4bda-afa4-6d600a081f71 None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:34.283306 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f346b-9b2a-4bda-afa4-6d600a081f71 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:34.283644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f346b-9b2a-4bda-afa4-6d600a081f71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:34.285830 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f346b-9b2a-4bda-afa4-6d600a081f71 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:34.295769 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 477/962] 10.222.0.94 () {56 vars in 1112 bytes} [Wed Aug 24 04:36:34 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:34.352548 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:34.395847 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e2118-e8cd-4ff3-b238-7ddf19f53efb None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:34.454758 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cfb1d-9055-42d5-b54e-6cfb001a40f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:34.455963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cfb1d-9055-42d5-b54e-6cfb001a40f9 None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:34.456477 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cfb1d-9055-42d5-b54e-6cfb001a40f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:34.456977 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cfb1d-9055-42d5-b54e-6cfb001a40f9 None admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:34.458343 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cfb1d-9055-42d5-b54e-6cfb001a40f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:34.461656 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cfb1d-9055-42d5-b54e-6cfb001a40f9 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:34.480107 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.sql.core [None req-361cfb1d-9055-42d5-b54e-6cfb001a40f9 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 04:36:34.480107 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 04:36:34.480107 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [parameters: {'user_id': 'a20a14350a414e0a9ccab2523f45304e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 04:36:34.480107 dv-cinder-854264-1-smb devstack@keystone.service[93412]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93412) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 04:36:34.489289 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-361cfb1d-9055-42d5-b54e-6cfb001a40f9 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 04:36:34.489289 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:34.489289 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:36:34.489289 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:36:34.489289 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:36:34.489289 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:36:34.489289 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:36:34.489289 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:36:34.489289 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:36:34.489289 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:36:34.489289 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:36:34.489289 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:36:34.489289 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:36:34.489289 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application result.read() Aug 24 04:36:34.489289 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:36:34.490274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:36:34.490274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:36:34.490274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:36:34.490274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:36:34.490274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:36:34.490274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:36:34.490274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:36:34.490274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 04:36:34.490274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:34.490274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 04:36:34.490274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:34.490274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:34.490274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 04:36:34.490274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 04:36:34.490274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 04:36:34.490274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 04:36:34.490274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:36:34.490274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:36:34.491255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 04:36:34.491255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application yield resource Aug 24 04:36:34.491255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:36:34.491255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:36:34.491255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 04:36:34.491255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 04:36:34.491255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 04:36:34.491255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 04:36:34.491255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 04:36:34.491255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise self.value Aug 24 04:36:34.491255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 04:36:34.491255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 04:36:34.491255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 04:36:34.491255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application session.commit() Aug 24 04:36:34.491255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 04:36:34.491255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 04:36:34.491255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 04:36:34.492829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 04:36:34.492829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 04:36:34.492829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self.session.flush() Aug 24 04:36:34.492829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 04:36:34.492829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 04:36:34.492829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 04:36:34.492829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 04:36:34.492829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 04:36:34.492829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application compat.raise_( Aug 24 04:36:34.492829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:36:34.492829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception Aug 24 04:36:34.492829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 04:36:34.492829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 04:36:34.492829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 04:36:34.492829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 04:36:34.492829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 04:36:34.492829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 04:36:34.493899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 04:36:34.493899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 04:36:34.493899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 04:36:34.493899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 04:36:34.493899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 04:36:34.493899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 04:36:34.493899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 04:36:34.493899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 04:36:34.493899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 04:36:34.493899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 04:36:34.493899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 04:36:34.493899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 04:36:34.493899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 04:36:34.493899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 04:36:34.493899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:36:34.493899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception Aug 24 04:36:34.494831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:36:34.494831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:36:34.494831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:36:34.494831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:36:34.494831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:36:34.494831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:36:34.494831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:36:34.494831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:36:34.494831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:36:34.494831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:36:34.494831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:36:34.494831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application result.read() Aug 24 04:36:34.494831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:36:34.494831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:36:34.494831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:36:34.494831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:36:34.496027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:36:34.496027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:36:34.496027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:36:34.496027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:36:34.496027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 04:36:34.496027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 04:36:34.496027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a20a14350a414e0a9ccab2523f45304e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 04:36:34.496027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 04:36:34.496027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:34.496027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:36:34.496027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:34.496027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:34.496027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:34.496027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:34.496027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:34.498644 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:34.498644 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:34.498644 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:34.498644 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:34.498644 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:34.498644 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:34.498644 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:34.498644 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 04:36:34.498644 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 04:36:34.498644 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:34.498644 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:34.498644 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:34.498644 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:34.498644 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:34.498644 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:34.498644 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 04:36:34.498644 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 04:36:34.501338 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 04:36:34.501338 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 04:36:34.501338 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 04:36:34.501338 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 04:36:34.501338 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 04:36:34.501338 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:34.501338 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 486/963] 10.222.0.94 () {60 vars in 1131 bytes} [Wed Aug 24 04:36:34 2022] POST /identity/v3/users => generated 160 bytes in 289 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:34.502379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f346b-9b2a-4bda-afa4-6d600a081f71 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:34.638498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:34.651215 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f346b-9b2a-4bda-afa4-6d600a081f71 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:34.693507 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8aa71f-5884-4b23-bd8b-c7f8fccbf28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:34.694212 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8aa71f-5884-4b23-bd8b-c7f8fccbf28e None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:34.694498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8aa71f-5884-4b23-bd8b-c7f8fccbf28e None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:34.694773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8aa71f-5884-4b23-bd8b-c7f8fccbf28e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:34.703456 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8aa71f-5884-4b23-bd8b-c7f8fccbf28e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:34.704924 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8aa71f-5884-4b23-bd8b-c7f8fccbf28e None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:34.718994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-2d8aa71f-5884-4b23-bd8b-c7f8fccbf28e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:36:34.718994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:34.718994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:34.718994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:34.718994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:34.718994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:34.718994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:34.718994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:34.718994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:34.718994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:34.718994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:34.718994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:34.718994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:34.718994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:34.718994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:34.718994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:34.720117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:34.720117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:34.720117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:34.720117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:34.720117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:34.720117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:34.720117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:34.720117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:34.720117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:34.720117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:34.720117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:34.720117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:34.720117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:34.720117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:34.720117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:34.720117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:34.720117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:34.720117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:34.721126 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:34.721126 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:34.721126 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:34.721126 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:34.721126 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:34.721126 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:34.721126 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:34.721126 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:34.721126 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:36:34.721126 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:34.721126 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 478/964] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:34.727462 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cfb1d-9055-42d5-b54e-6cfb001a40f9 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:34.847719 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cfb1d-9055-42d5-b54e-6cfb001a40f9 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:34.887253 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a6c80-345d-4385-b190-ca9cabef049e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:34.887884 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a6c80-345d-4385-b190-ca9cabef049e None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:34.888162 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a6c80-345d-4385-b190-ca9cabef049e None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:34.888438 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a6c80-345d-4385-b190-ca9cabef049e None admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:34.889213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a6c80-345d-4385-b190-ca9cabef049e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:34.889491 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a6c80-345d-4385-b190-ca9cabef049e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:34.891140 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a6c80-345d-4385-b190-ca9cabef049e None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:34.903994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:34.938494 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 487/965] 10.222.0.94 () {56 vars in 1101 bytes} [Wed Aug 24 04:36:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:35.472371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07806805-cbd0-465e-8d18-4309729b0d35 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:35.472650 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07806805-cbd0-465e-8d18-4309729b0d35 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:35.473102 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07806805-cbd0-465e-8d18-4309729b0d35 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:35.474639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 479/966] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:35.480298 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f5d02-e802-4f54-a2a5-c16f19385db4 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:35.480592 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f5d02-e802-4f54-a2a5-c16f19385db4 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:35.480887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f5d02-e802-4f54-a2a5-c16f19385db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:35.501757 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-005f5d02-e802-4f54-a2a5-c16f19385db4 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:35.503288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-005f5d02-e802-4f54-a2a5-c16f19385db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:35.605521 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 488/967] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:35.886219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07806805-cbd0-465e-8d18-4309729b0d35 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:36.012148 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07806805-cbd0-465e-8d18-4309729b0d35 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:36.048524 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e079bc-0e12-44b7-9219-12ddac8a9ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:36.049170 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e079bc-0e12-44b7-9219-12ddac8a9ed4 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:36.049620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e079bc-0e12-44b7-9219-12ddac8a9ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:36.049904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e079bc-0e12-44b7-9219-12ddac8a9ed4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:36.063107 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e079bc-0e12-44b7-9219-12ddac8a9ed4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:36.068192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-42e079bc-0e12-44b7-9219-12ddac8a9ed4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:36:36.068192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:36.068192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:36.068192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:36.068192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:36.068192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:36.068192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:36.068192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:36.068192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:36.068192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:36.068192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:36.068192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:36.068192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:36.068192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:36.068192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:36.068192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:36.069340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:36.069340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:36.069340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:36.069340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:36.069340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:36.069340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:36.069340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:36.069340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:36.069340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:36.069340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:36.069340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:36.069340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:36.069340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:36.069340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:36.069340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:36.069340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:36.070782 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:36.070782 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:36.070782 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:36.070782 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:36.070782 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:36.070782 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:36.070782 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:36.070782 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:36.070782 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:36.070782 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:36.070782 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:36:36.070782 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:36.072174 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 480/968] 10.222.0.94 () {56 vars in 1120 bytes} [Wed Aug 24 04:36:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:36.076311 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f5d02-e802-4f54-a2a5-c16f19385db4 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:36.194266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f5d02-e802-4f54-a2a5-c16f19385db4 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:36.223354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:36.241201 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78916a96-c6ec-432c-84ec-5ee6f8c3befe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:36.242315 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78916a96-c6ec-432c-84ec-5ee6f8c3befe None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:36.242764 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78916a96-c6ec-432c-84ec-5ee6f8c3befe None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:36.243044 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78916a96-c6ec-432c-84ec-5ee6f8c3befe None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:36.243765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78916a96-c6ec-432c-84ec-5ee6f8c3befe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:36.244133 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78916a96-c6ec-432c-84ec-5ee6f8c3befe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:36.245526 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78916a96-c6ec-432c-84ec-5ee6f8c3befe None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:36.264557 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 489/969] 10.222.0.94 () {56 vars in 1115 bytes} [Wed Aug 24 04:36:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:36.270048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e079bc-0e12-44b7-9219-12ddac8a9ed4 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:36.284687 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:36.339071 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb3cdc-ec25-48e8-82d1-9dbef0b3ef27 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:36.339360 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb3cdc-ec25-48e8-82d1-9dbef0b3ef27 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:36.339633 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb3cdc-ec25-48e8-82d1-9dbef0b3ef27 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:36.341223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 490/970] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:36:36.346268 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342803d6-eca8-4886-8847-b7c2f7448b46 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:36.346690 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342803d6-eca8-4886-8847-b7c2f7448b46 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:36.346955 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342803d6-eca8-4886-8847-b7c2f7448b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:36.364928 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-342803d6-eca8-4886-8847-b7c2f7448b46 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:36.366141 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-342803d6-eca8-4886-8847-b7c2f7448b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:36.383540 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e079bc-0e12-44b7-9219-12ddac8a9ed4 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:36.420766 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdab76-1eda-4290-b462-f18771c9b158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:36.421376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdab76-1eda-4290-b462-f18771c9b158 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:36.421672 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdab76-1eda-4290-b462-f18771c9b158 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:36.421946 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdab76-1eda-4290-b462-f18771c9b158 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:36.434096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fdab76-1eda-4290-b462-f18771c9b158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:36.435890 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fdab76-1eda-4290-b462-f18771c9b158 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:36.438643 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 491/971] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:36.454511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-e2fdab76-1eda-4290-b462-f18771c9b158 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:36.454511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:36.454511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:36.454511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:36.454511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:36.454511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:36.454511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:36.454511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:36.454511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:36.454511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:36.454511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:36.454511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:36.454511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:36.454511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:36.454511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:36.454511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:36.455607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:36.455607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:36.455607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:36.455607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:36.455607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:36.455607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:36.455607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:36.455607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:36.455607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:36.455607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:36.455607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:36.455607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:36.455607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:36.455607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:36.455607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:36.455607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:36.455607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:36.456573 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:36.456573 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:36.456573 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:36.457615 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 481/972] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:36.461492 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342803d6-eca8-4886-8847-b7c2f7448b46 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:36.546296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49eb6f9-f271-4b29-8906-163bc8ad1da6 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:36.546580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49eb6f9-f271-4b29-8906-163bc8ad1da6 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:36.546887 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49eb6f9-f271-4b29-8906-163bc8ad1da6 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:36.548232 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 482/973] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:36:36.553533 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a60ee7-0948-478d-944a-2501a5b4c8fe None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:36.553863 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a60ee7-0948-478d-944a-2501a5b4c8fe None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:36.554074 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a60ee7-0948-478d-944a-2501a5b4c8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:36.571828 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342803d6-eca8-4886-8847-b7c2f7448b46 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:36.573388 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-64a60ee7-0948-478d-944a-2501a5b4c8fe None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:36.575081 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-64a60ee7-0948-478d-944a-2501a5b4c8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:36.595108 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:36.615483 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246e3b1-c4f4-4a6e-b4e2-03c9ad11f116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:36.616207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246e3b1-c4f4-4a6e-b4e2-03c9ad11f116 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:36.616639 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246e3b1-c4f4-4a6e-b4e2-03c9ad11f116 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:36.617521 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246e3b1-c4f4-4a6e-b4e2-03c9ad11f116 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:36.618367 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246e3b1-c4f4-4a6e-b4e2-03c9ad11f116 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:36.618535 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246e3b1-c4f4-4a6e-b4e2-03c9ad11f116 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:36.620067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246e3b1-c4f4-4a6e-b4e2-03c9ad11f116 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:36.632981 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 492/974] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:36.638367 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246e3b1-c4f4-4a6e-b4e2-03c9ad11f116 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:36.644581 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:36.657944 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 483/975] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:36:36.708335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a60ee7-0948-478d-944a-2501a5b4c8fe None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:36.757931 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246e3b1-c4f4-4a6e-b4e2-03c9ad11f116 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:36.795842 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af14b0-f6c1-49d3-8af9-d8884130a2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:36.796492 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af14b0-f6c1-49d3-8af9-d8884130a2fa None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:36.796784 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af14b0-f6c1-49d3-8af9-d8884130a2fa None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:36.797017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af14b0-f6c1-49d3-8af9-d8884130a2fa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:36.806159 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af14b0-f6c1-49d3-8af9-d8884130a2fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:36.807585 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af14b0-f6c1-49d3-8af9-d8884130a2fa None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:36.818989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-41af14b0-f6c1-49d3-8af9-d8884130a2fa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:36:36.818989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:36.818989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:36.818989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:36.818989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:36.818989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:36.818989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:36.818989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:36.818989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:36.818989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:36.818989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:36.818989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:36.818989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:36.818989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:36.818989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:36.818989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:36.820605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:36.820605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:36.820605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:36.820605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:36.820605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:36.820605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:36.820605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:36.820605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:36.820605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:36.820605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:36.820605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:36.820605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:36.820605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:36.820605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:36.820605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:36.820605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:36.820605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:36.820605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:36.821637 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:36.821637 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:36.821637 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:36.821637 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:36.821637 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:36.821637 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:36.821637 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:36.821637 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:36.821637 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:36:36.821637 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:36.822233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a60ee7-0948-478d-944a-2501a5b4c8fe None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:36.822321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 493/976] 10.222.0.94 () {56 vars in 1117 bytes} [Wed Aug 24 04:36:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:36.826317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af14b0-f6c1-49d3-8af9-d8884130a2fa None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:36.870508 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:36.872582 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f45ce8-3002-4851-9067-ee6e045d4990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:36.873487 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f45ce8-3002-4851-9067-ee6e045d4990 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:36.873770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f45ce8-3002-4851-9067-ee6e045d4990 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:36.874039 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f45ce8-3002-4851-9067-ee6e045d4990 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:36.874625 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f45ce8-3002-4851-9067-ee6e045d4990 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:36.876772 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f45ce8-3002-4851-9067-ee6e045d4990 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:36.886714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-92f45ce8-3002-4851-9067-ee6e045d4990 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:36:36.886714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:36.886714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:36:36.886714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:36:36.886714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:36:36.886714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:36:36.886714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:36:36.886714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:36.886714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:36:36.886714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:36.886714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:36:36.886714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:36.886714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:36.886714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:36.886714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:36.886714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:36.886714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:36.890112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:36.890112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:36.890112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:36.890112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:36.890112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:36.890112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:36.890112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:36:36.890112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:36:36.890112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:36:36.890112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:36:36.890112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:36.890112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:36.890112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:36.890112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:36.890112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:36.890112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:36.890990 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:36.890990 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:36.890990 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:36.890990 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:36.890990 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:36.890990 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:36.890990 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:36.890990 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:36.890990 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:36.890990 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:36.890990 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:36:36.890990 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:36.890990 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:36:36.890990 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:36.890990 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 484/977] 10.222.0.94 () {56 vars in 1126 bytes} [Wed Aug 24 04:36:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:36.894062 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f45ce8-3002-4851-9067-ee6e045d4990 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:36.949436 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af14b0-f6c1-49d3-8af9-d8884130a2fa None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:36.964913 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:36.985177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e44f1-e563-493e-a3c5-bd442690facc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:36.985814 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e44f1-e563-493e-a3c5-bd442690facc None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:36.986094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e44f1-e563-493e-a3c5-bd442690facc None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:36.986360 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e44f1-e563-493e-a3c5-bd442690facc None admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:36.987088 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e44f1-e563-493e-a3c5-bd442690facc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:36.987389 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e44f1-e563-493e-a3c5-bd442690facc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:36.988799 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e44f1-e563-493e-a3c5-bd442690facc None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:37.008940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 494/978] 10.222.0.94 () {56 vars in 1149 bytes} [Wed Aug 24 04:36:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:37.009742 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e44f1-e563-493e-a3c5-bd442690facc None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:37.021311 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f45ce8-3002-4851-9067-ee6e045d4990 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:37.057332 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87527c1-6a63-439b-9a33-e7afd8470131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:37.057976 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87527c1-6a63-439b-9a33-e7afd8470131 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:37.058255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87527c1-6a63-439b-9a33-e7afd8470131 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:37.058522 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87527c1-6a63-439b-9a33-e7afd8470131 None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:37.059155 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87527c1-6a63-439b-9a33-e7afd8470131 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:37.059456 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87527c1-6a63-439b-9a33-e7afd8470131 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:37.060824 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87527c1-6a63-439b-9a33-e7afd8470131 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:37.066047 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 485/979] 10.222.0.94 () {56 vars in 1122 bytes} [Wed Aug 24 04:36:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:37.072293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87527c1-6a63-439b-9a33-e7afd8470131 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:37.109896 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:37.120713 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e44f1-e563-493e-a3c5-bd442690facc None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:37.157789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a04c7-d0fd-4ec4-be19-e431f89e8b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:37.158389 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a04c7-d0fd-4ec4-be19-e431f89e8b91 None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:37.158674 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a04c7-d0fd-4ec4-be19-e431f89e8b91 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:37.158940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a04c7-d0fd-4ec4-be19-e431f89e8b91 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:37.159581 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a04c7-d0fd-4ec4-be19-e431f89e8b91 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:37.160936 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a04c7-d0fd-4ec4-be19-e431f89e8b91 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:37.176929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 495/980] 10.222.0.94 () {60 vars in 1141 bytes} [Wed Aug 24 04:36:37 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:37.177817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a04c7-d0fd-4ec4-be19-e431f89e8b91 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:37.199467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87527c1-6a63-439b-9a33-e7afd8470131 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:37.225355 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:37.254273 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303ad22-5287-497e-ae8c-addc30835f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:37.254971 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303ad22-5287-497e-ae8c-addc30835f93 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:37.255254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303ad22-5287-497e-ae8c-addc30835f93 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:37.255523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303ad22-5287-497e-ae8c-addc30835f93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:37.376913 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a04c7-d0fd-4ec4-be19-e431f89e8b91 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:37.387549 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303ad22-5287-497e-ae8c-addc30835f93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:37.390870 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303ad22-5287-497e-ae8c-addc30835f93 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:37.442808 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e4ea9-ec11-492f-9e2a-91d8e80a4695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:37.443886 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e4ea9-ec11-492f-9e2a-91d8e80a4695 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:37.444326 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e4ea9-ec11-492f-9e2a-91d8e80a4695 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:37.445339 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e4ea9-ec11-492f-9e2a-91d8e80a4695 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:37.446223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e4ea9-ec11-492f-9e2a-91d8e80a4695 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:37.446752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e4ea9-ec11-492f-9e2a-91d8e80a4695 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:37.449235 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e4ea9-ec11-492f-9e2a-91d8e80a4695 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:37.457483 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 496/981] 10.222.0.94 () {56 vars in 1122 bytes} [Wed Aug 24 04:36:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:37.466317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e4ea9-ec11-492f-9e2a-91d8e80a4695 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:37.498011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:37.579474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 486/982] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:37 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:36:37.590086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303ad22-5287-497e-ae8c-addc30835f93 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:37.619783 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:37.622371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e4ea9-ec11-492f-9e2a-91d8e80a4695 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:37.692051 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8cec4-2fc4-48a7-be21-c9cabf103d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:37.692836 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8cec4-2fc4-48a7-be21-c9cabf103d14 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:37.693290 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8cec4-2fc4-48a7-be21-c9cabf103d14 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:37.693785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8cec4-2fc4-48a7-be21-c9cabf103d14 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:37.695569 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8cec4-2fc4-48a7-be21-c9cabf103d14 None admin] RBAC: Adding query filter params (interface=admin, service_id=cb1746bdc07f47ebab9325057667d521, region_id=RegionOne) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:37.696133 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8cec4-2fc4-48a7-be21-c9cabf103d14 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:37.698500 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8cec4-2fc4-48a7-be21-c9cabf103d14 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:37.707333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 497/983] 10.222.0.94 () {56 vars in 1249 bytes} [Wed Aug 24 04:36:37 2022] GET /identity/v3/endpoints?service_id=cb1746bdc07f47ebab9325057667d521&interface=admin®ion_id=RegionOne => generated 193 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:37.716499 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8cec4-2fc4-48a7-be21-c9cabf103d14 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:37.759351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303ad22-5287-497e-ae8c-addc30835f93 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:37.808840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205bc79-3b12-423e-b4b4-5705cde1e685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:37.809705 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205bc79-3b12-423e-b4b4-5705cde1e685 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:37.809984 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205bc79-3b12-423e-b4b4-5705cde1e685 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:37.810396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205bc79-3b12-423e-b4b4-5705cde1e685 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:37.825095 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205bc79-3b12-423e-b4b4-5705cde1e685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:37.826712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205bc79-3b12-423e-b4b4-5705cde1e685 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:37.845206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-4205bc79-3b12-423e-b4b4-5705cde1e685 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:37.845206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:37.845206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:37.845206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:37.845206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:37.845206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:37.845206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:37.845206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:37.845206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:37.845206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:37.845206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:37.845206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:37.845206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:37.845206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:37.845206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:37.845206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:37.851963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:37.851963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:37.851963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:37.851963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:37.851963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:37.851963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:37.851963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:37.851963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:37.851963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:37.851963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:37.851963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:37.851963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:37.851963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:37.851963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:37.851963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:37.851963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:37.851963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:37.853104 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:37.853104 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:37.853104 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:37.853104 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 487/984] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:37.853390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205bc79-3b12-423e-b4b4-5705cde1e685 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:37.862466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:37.884952 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8cec4-2fc4-48a7-be21-c9cabf103d14 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:37.929163 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54484909-1cb8-4a84-976a-8c72e8f3f943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:37.930047 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54484909-1cb8-4a84-976a-8c72e8f3f943 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:37.930339 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54484909-1cb8-4a84-976a-8c72e8f3f943 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:37.930623 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54484909-1cb8-4a84-976a-8c72e8f3f943 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:37.931240 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54484909-1cb8-4a84-976a-8c72e8f3f943 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:37.932680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54484909-1cb8-4a84-976a-8c72e8f3f943 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:37.939759 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 498/985] 10.222.0.94 () {56 vars in 1087 bytes} [Wed Aug 24 04:36:37 2022] GET /identity/v3/services => generated 1727 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:36:37.943137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:37.990584 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205bc79-3b12-423e-b4b4-5705cde1e685 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:38.032715 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0de098-46fd-409e-a4ca-c5390ff1794c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:38.033564 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0de098-46fd-409e-a4ca-c5390ff1794c None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:38.033809 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0de098-46fd-409e-a4ca-c5390ff1794c None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:38.034084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0de098-46fd-409e-a4ca-c5390ff1794c None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:38.034758 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0de098-46fd-409e-a4ca-c5390ff1794c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:38.035068 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0de098-46fd-409e-a4ca-c5390ff1794c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:38.036472 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0de098-46fd-409e-a4ca-c5390ff1794c None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:38.052233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 488/986] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:38.058098 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54484909-1cb8-4a84-976a-8c72e8f3f943 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:38.185393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54484909-1cb8-4a84-976a-8c72e8f3f943 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:38.237332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008397dc-8ca8-46e8-a36e-16171a02bc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:38.238013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008397dc-8ca8-46e8-a36e-16171a02bc48 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:38.238294 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008397dc-8ca8-46e8-a36e-16171a02bc48 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:38.238569 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008397dc-8ca8-46e8-a36e-16171a02bc48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:38.247355 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008397dc-8ca8-46e8-a36e-16171a02bc48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:38.248824 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008397dc-8ca8-46e8-a36e-16171a02bc48 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:38.261219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-008397dc-8ca8-46e8-a36e-16171a02bc48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:38.261219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:38.261219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:38.261219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:38.261219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:38.261219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:38.261219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:38.261219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:38.261219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:38.261219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:38.261219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:38.261219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:38.261219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:38.261219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:38.261219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:38.262238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:38.262238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:38.262238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:38.262238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:38.262238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:38.262238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:38.262238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:38.262238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:38.262238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:38.262238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:38.262238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:38.262238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:38.262238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:38.262238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:38.262238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:38.262238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:38.262238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:38.263231 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:38.263231 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:38.263231 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:38.263231 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:38.263231 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:38.263231 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:38.263231 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:38.263231 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:38.263231 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 499/987] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:38.269241 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0de098-46fd-409e-a4ca-c5390ff1794c None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:38.412044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0de098-46fd-409e-a4ca-c5390ff1794c None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:38.444447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:38.455538 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130eaae-e746-402f-92fd-bbeafc849f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:38.456318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130eaae-e746-402f-92fd-bbeafc849f6e None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:38.456696 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130eaae-e746-402f-92fd-bbeafc849f6e None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:38.457066 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130eaae-e746-402f-92fd-bbeafc849f6e None admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:38.457927 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130eaae-e746-402f-92fd-bbeafc849f6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:38.458335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130eaae-e746-402f-92fd-bbeafc849f6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:38.459901 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130eaae-e746-402f-92fd-bbeafc849f6e None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:38.488672 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 489/988] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:38.494683 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008397dc-8ca8-46e8-a36e-16171a02bc48 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:38.506086 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:38.634242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008397dc-8ca8-46e8-a36e-16171a02bc48 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:38.684519 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5be59-66f1-49b9-9b69-efe4e536c8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:38.685084 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5be59-66f1-49b9-9b69-efe4e536c8a1 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:38.685373 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5be59-66f1-49b9-9b69-efe4e536c8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:38.685669 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5be59-66f1-49b9-9b69-efe4e536c8a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:38.687111 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5be59-66f1-49b9-9b69-efe4e536c8a1 None admin] RBAC: Adding query filter params (role.id=17fd0dec2fe84d3bb5e22753c3e1300e, scope.project.id=4416325d266642f3a786ff9f16c827aa, user.id=7caa973c63e64d639cc2fb55a4955542) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:38.687111 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5be59-66f1-49b9-9b69-efe4e536c8a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:38.688227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5be59-66f1-49b9-9b69-efe4e536c8a1 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:38.696469 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 500/989] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:36:38 2022] GET /identity/v3/role_assignments?user.id=7caa973c63e64d639cc2fb55a4955542&scope.project.id=4416325d266642f3a786ff9f16c827aa&role.id=17fd0dec2fe84d3bb5e22753c3e1300e => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:39.322367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac64c53-61bc-40d6-8adf-a75b5d075045 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:39.322961 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac64c53-61bc-40d6-8adf-a75b5d075045 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:39.322961 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac64c53-61bc-40d6-8adf-a75b5d075045 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:39.324277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 490/990] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:39.330200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b450c7-bfbb-4d77-9349-6fe74cbee9f9 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:39.330479 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b450c7-bfbb-4d77-9349-6fe74cbee9f9 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:39.330762 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b450c7-bfbb-4d77-9349-6fe74cbee9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:39.350809 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-d4b450c7-bfbb-4d77-9349-6fe74cbee9f9 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:39.352588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-d4b450c7-bfbb-4d77-9349-6fe74cbee9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:39.421371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:39.433576 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 501/991] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:39.711839 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac64c53-61bc-40d6-8adf-a75b5d075045 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:39.826527 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac64c53-61bc-40d6-8adf-a75b5d075045 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:39.862572 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca8382-afad-4bd9-9434-c0f4bac0126b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:39.863216 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca8382-afad-4bd9-9434-c0f4bac0126b None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:39.863494 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca8382-afad-4bd9-9434-c0f4bac0126b None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:39.863765 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca8382-afad-4bd9-9434-c0f4bac0126b None admin] PATH_INFO: `/v3/services/compute` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:39.864349 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca8382-afad-4bd9-9434-c0f4bac0126b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:39.865738 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca8382-afad-4bd9-9434-c0f4bac0126b None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:39.875855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-dfca8382-afad-4bd9-9434-c0f4bac0126b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:36:39.875855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:39.875855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:36:39.875855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:36:39.875855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:36:39.875855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:36:39.875855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:36:39.875855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:39.875855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:36:39.875855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:39.875855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:36:39.875855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:39.875855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:39.875855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:39.875855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:39.875855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:39.875855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:39.881841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:39.881841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:39.881841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:39.881841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:39.881841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:39.881841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:39.881841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:36:39.881841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:36:39.881841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:36:39.881841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:36:39.881841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:39.881841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:39.881841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:39.881841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:39.881841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:39.881841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:39.882962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:39.882962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:39.882962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:39.882962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:39.882962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:39.882962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:39.882962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:39.882962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:39.882962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:39.882962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:39.882962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:36:39.882962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:39.882962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:36:39.882962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:39.882962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 491/992] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:39.885638 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b450c7-bfbb-4d77-9349-6fe74cbee9f9 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:40.073041 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b450c7-bfbb-4d77-9349-6fe74cbee9f9 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:40.134733 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376a0ac-166f-4cd8-86bc-f45cac0dc5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:40.135786 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376a0ac-166f-4cd8-86bc-f45cac0dc5a7 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:40.136294 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376a0ac-166f-4cd8-86bc-f45cac0dc5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:40.136798 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376a0ac-166f-4cd8-86bc-f45cac0dc5a7 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:40.138032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376a0ac-166f-4cd8-86bc-f45cac0dc5a7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:40.138564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376a0ac-166f-4cd8-86bc-f45cac0dc5a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:40.141085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376a0ac-166f-4cd8-86bc-f45cac0dc5a7 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:40.154528 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 502/993] 10.222.0.94 () {56 vars in 1112 bytes} [Wed Aug 24 04:36:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:40.159474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca8382-afad-4bd9-9434-c0f4bac0126b None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:40.236063 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0999979-b671-4241-aa30-7148c00f3f16 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:40.236365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0999979-b671-4241-aa30-7148c00f3f16 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:40.236803 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0999979-b671-4241-aa30-7148c00f3f16 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:40.238730 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 503/994] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:40.247297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf27d7-fd5b-4de7-b079-4ea2767fdf88 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:40.247642 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf27d7-fd5b-4de7-b079-4ea2767fdf88 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:40.247926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf27d7-fd5b-4de7-b079-4ea2767fdf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:40.249813 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:40.269661 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-95cf27d7-fd5b-4de7-b079-4ea2767fdf88 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:40.270884 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-95cf27d7-fd5b-4de7-b079-4ea2767fdf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:40.344909 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca8382-afad-4bd9-9434-c0f4bac0126b None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:40.360515 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:40.377486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 504/995] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:36:40.407444 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333c3d1-46b7-4744-9636-ad4eb415aecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:40.408391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333c3d1-46b7-4744-9636-ad4eb415aecb None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:40.408880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333c3d1-46b7-4744-9636-ad4eb415aecb None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:40.409355 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333c3d1-46b7-4744-9636-ad4eb415aecb None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:40.410236 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5333c3d1-46b7-4744-9636-ad4eb415aecb None admin] RBAC: Adding query filter params (type=compute) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:40.410741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5333c3d1-46b7-4744-9636-ad4eb415aecb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:40.412387 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5333c3d1-46b7-4744-9636-ad4eb415aecb None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:40.419446 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 492/996] 10.222.0.94 () {56 vars in 1112 bytes} [Wed Aug 24 04:36:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:40.426187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf27d7-fd5b-4de7-b079-4ea2767fdf88 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:40.567229 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf27d7-fd5b-4de7-b079-4ea2767fdf88 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:40.607357 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc8871-21c5-4467-b9f9-949a26e2dc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:40.607897 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc8871-21c5-4467-b9f9-949a26e2dc0c None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:40.608174 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc8871-21c5-4467-b9f9-949a26e2dc0c None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:40.608519 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc8871-21c5-4467-b9f9-949a26e2dc0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:40.609231 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc8871-21c5-4467-b9f9-949a26e2dc0c None admin] RBAC: Adding query filter params (interface=public, service_id=bdb851afce6547eda443f906fbc4f014, region_id=RegionOne) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:40.609561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc8871-21c5-4467-b9f9-949a26e2dc0c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:40.610927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc8871-21c5-4467-b9f9-949a26e2dc0c None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:40.625466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 505/997] 10.222.0.94 () {56 vars in 1251 bytes} [Wed Aug 24 04:36:40 2022] GET /identity/v3/endpoints?service_id=bdb851afce6547eda443f906fbc4f014&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:40.627699 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333c3d1-46b7-4744-9636-ad4eb415aecb None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:40.668189 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc8871-21c5-4467-b9f9-949a26e2dc0c None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:40.747541 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:40.757344 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333c3d1-46b7-4744-9636-ad4eb415aecb None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:40.784599 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:40.805420 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc8871-21c5-4467-b9f9-949a26e2dc0c None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:40.808931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225016be-98e7-4c3f-a29c-e295d949840c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:40.809587 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225016be-98e7-4c3f-a29c-e295d949840c None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:40.809871 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225016be-98e7-4c3f-a29c-e295d949840c None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:40.810140 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225016be-98e7-4c3f-a29c-e295d949840c None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:40.810768 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225016be-98e7-4c3f-a29c-e295d949840c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:40.812154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225016be-98e7-4c3f-a29c-e295d949840c None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:40.819066 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 493/998] 10.222.0.94 () {56 vars in 1087 bytes} [Wed Aug 24 04:36:40 2022] GET /identity/v3/services => generated 1727 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:36:40.853814 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08cc8cd-ff90-4cb0-9ed7-ebd4d412dfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:40.854480 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cc8cd-ff90-4cb0-9ed7-ebd4d412dfe3 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:40.854827 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cc8cd-ff90-4cb0-9ed7-ebd4d412dfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:40.855104 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cc8cd-ff90-4cb0-9ed7-ebd4d412dfe3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:40.855846 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08cc8cd-ff90-4cb0-9ed7-ebd4d412dfe3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:40.857266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08cc8cd-ff90-4cb0-9ed7-ebd4d412dfe3 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:40.865033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9c827-55aa-4ecb-8e5f-d6ac17ffbe57 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:40.865237 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9c827-55aa-4ecb-8e5f-d6ac17ffbe57 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:40.865522 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9c827-55aa-4ecb-8e5f-d6ac17ffbe57 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:40.867769 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 494/999] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:36:40.868094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-a08cc8cd-ff90-4cb0-9ed7-ebd4d412dfe3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:36:40.868094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:40.868094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:36:40.868094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:36:40.868094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:36:40.868094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:36:40.868094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:36:40.868094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:40.868094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:36:40.868094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:40.868094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:36:40.868094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:40.868094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:40.868094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:40.868094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:40.868094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:40.868094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:40.869752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:40.869752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:40.869752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:40.869752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:40.869752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:40.869752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:40.869752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:36:40.869752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:36:40.869752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:36:40.869752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:36:40.869752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:40.869752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:40.869752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:40.869752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:40.869752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:40.869752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:40.871234 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:40.871234 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:40.871234 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:40.871234 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:40.871234 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:40.871234 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:40.871234 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:40.871234 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:40.871234 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:40.871234 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:40.871234 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:36:40.871234 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:40.871234 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:36:40.871234 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:40.873259 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 506/1000] 10.222.0.94 () {56 vars in 1126 bytes} [Wed Aug 24 04:36:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:40.874103 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acf9bb-943a-437e-8cd0-d6811eee2a85 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:40.874393 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acf9bb-943a-437e-8cd0-d6811eee2a85 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:40.874669 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acf9bb-943a-437e-8cd0-d6811eee2a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:40.878440 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08cc8cd-ff90-4cb0-9ed7-ebd4d412dfe3 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:40.896392 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-42acf9bb-943a-437e-8cd0-d6811eee2a85 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:40.898342 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-42acf9bb-943a-437e-8cd0-d6811eee2a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:41.009166 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 495/1001] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:36:41.017524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08cc8cd-ff90-4cb0-9ed7-ebd4d412dfe3 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:41.050643 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:41.066001 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182092f3-2eae-470c-a1ac-f46c4a7f06bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:41.066627 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182092f3-2eae-470c-a1ac-f46c4a7f06bf None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.066989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182092f3-2eae-470c-a1ac-f46c4a7f06bf None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.067267 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182092f3-2eae-470c-a1ac-f46c4a7f06bf None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.067981 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182092f3-2eae-470c-a1ac-f46c4a7f06bf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:41.068295 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182092f3-2eae-470c-a1ac-f46c4a7f06bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:41.070407 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182092f3-2eae-470c-a1ac-f46c4a7f06bf None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:41.080709 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 507/1002] 10.222.0.94 () {56 vars in 1122 bytes} [Wed Aug 24 04:36:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:41.082367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acf9bb-943a-437e-8cd0-d6811eee2a85 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:41.205918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acf9bb-943a-437e-8cd0-d6811eee2a85 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:41.222911 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:41.260459 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b12775-9cc2-4901-b094-69ddf9cfce6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:41.261490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b12775-9cc2-4901-b094-69ddf9cfce6f None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.261960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b12775-9cc2-4901-b094-69ddf9cfce6f None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.262420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b12775-9cc2-4901-b094-69ddf9cfce6f None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.263296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b12775-9cc2-4901-b094-69ddf9cfce6f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:41.263810 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b12775-9cc2-4901-b094-69ddf9cfce6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:41.265538 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b12775-9cc2-4901-b094-69ddf9cfce6f None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:41.277443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 496/1003] 10.222.0.94 () {56 vars in 1122 bytes} [Wed Aug 24 04:36:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:41.280299 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182092f3-2eae-470c-a1ac-f46c4a7f06bf None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:41.289897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b12775-9cc2-4901-b094-69ddf9cfce6f None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:41.445138 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182092f3-2eae-470c-a1ac-f46c4a7f06bf None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:41.458310 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b12775-9cc2-4901-b094-69ddf9cfce6f None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:41.505859 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790ee82-82aa-479b-b38f-e3de4f01d0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:41.506505 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790ee82-82aa-479b-b38f-e3de4f01d0c3 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.507715 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790ee82-82aa-479b-b38f-e3de4f01d0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.507715 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790ee82-82aa-479b-b38f-e3de4f01d0c3 None admin] PATH_INFO: `/v3/services/image` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.508351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790ee82-82aa-479b-b38f-e3de4f01d0c3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:41.509784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790ee82-82aa-479b-b38f-e3de4f01d0c3 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:41.519314 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b01f4-e51e-4408-975f-0802d46c2813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:41.520454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b01f4-e51e-4408-975f-0802d46c2813 None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.520656 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-9790ee82-82aa-479b-b38f-e3de4f01d0c3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:36:41.520656 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:41.520656 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:36:41.520656 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:36:41.520656 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:36:41.520656 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:36:41.520656 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:36:41.520656 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:41.520656 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:36:41.520656 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:41.520656 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:36:41.520656 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:41.520656 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:41.520656 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:41.520656 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:41.520656 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:41.520656 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:41.522723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:41.522723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:41.522723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:41.522723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:41.522723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:41.522723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:41.522723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:36:41.522723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:36:41.522723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:36:41.522723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:36:41.522723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:41.522723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:41.522723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:41.522723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:41.522723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:41.522723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:41.524756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:41.524756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:41.524756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:41.524756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:41.524756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:41.524756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:41.524756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:41.524756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:41.524756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:41.524756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:41.524756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:36:41.524756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:41.524756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:36:41.524756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:41.527473 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 497/1004] 10.222.0.94 () {56 vars in 1105 bytes} [Wed Aug 24 04:36:41 2022] GET /identity/v3/services/image => generated 86 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:41.527905 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b01f4-e51e-4408-975f-0802d46c2813 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.528482 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b01f4-e51e-4408-975f-0802d46c2813 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.528817 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790ee82-82aa-479b-b38f-e3de4f01d0c3 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:41.530172 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b01f4-e51e-4408-975f-0802d46c2813 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:41.533239 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b01f4-e51e-4408-975f-0802d46c2813 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:41.562902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 508/1005] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:36:41 2022] POST /identity/v3/endpoints => generated 325 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:41.625845 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:41.718008 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790ee82-82aa-479b-b38f-e3de4f01d0c3 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:41.783869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04be13-1fa0-4869-99bc-f45f1ea29256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:41.784850 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04be13-1fa0-4869-99bc-f45f1ea29256 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.785252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04be13-1fa0-4869-99bc-f45f1ea29256 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.785658 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04be13-1fa0-4869-99bc-f45f1ea29256 None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.786730 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04be13-1fa0-4869-99bc-f45f1ea29256 None admin] RBAC: Adding query filter params (name=image) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:41.787129 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04be13-1fa0-4869-99bc-f45f1ea29256 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:41.790051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04be13-1fa0-4869-99bc-f45f1ea29256 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:41.798725 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 498/1006] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:41.808051 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b01f4-e51e-4408-975f-0802d46c2813 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:41.905298 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:42.021474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b01f4-e51e-4408-975f-0802d46c2813 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:42.081876 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ddf06-d21a-4658-9bb9-e67480986328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:42.082523 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ddf06-d21a-4658-9bb9-e67480986328 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:42.082896 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ddf06-d21a-4658-9bb9-e67480986328 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:42.083201 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ddf06-d21a-4658-9bb9-e67480986328 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:42.083867 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ddf06-d21a-4658-9bb9-e67480986328 None admin] RBAC: Adding query filter params (type=image) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:42.084177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ddf06-d21a-4658-9bb9-e67480986328 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:42.085724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ddf06-d21a-4658-9bb9-e67480986328 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:42.097675 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 509/1007] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:41 2022] GET /identity/v3/services?type=image => generated 122 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:43.031973 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899a516-e106-4f22-a02e-4af23e759665 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:43.032512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899a516-e106-4f22-a02e-4af23e759665 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:43.032512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899a516-e106-4f22-a02e-4af23e759665 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:43.034049 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 499/1008] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:43.039728 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188df83-db02-4891-ac65-defc6fa2526b None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:43.040255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188df83-db02-4891-ac65-defc6fa2526b None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:43.040255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188df83-db02-4891-ac65-defc6fa2526b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:43.060765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-d188df83-db02-4891-ac65-defc6fa2526b None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:43.062012 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-d188df83-db02-4891-ac65-defc6fa2526b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:43.133461 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 510/1009] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:43 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:43.399023 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899a516-e106-4f22-a02e-4af23e759665 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:43.501167 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:43.508813 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899a516-e106-4f22-a02e-4af23e759665 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:43.547115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620a787-541d-430a-aa0d-070a5e12cbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:43.547745 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620a787-541d-430a-aa0d-070a5e12cbdf None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:43.548019 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620a787-541d-430a-aa0d-070a5e12cbdf None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:43.548287 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620a787-541d-430a-aa0d-070a5e12cbdf None admin] PATH_INFO: `/v3/services/compute` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:43.548869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620a787-541d-430a-aa0d-070a5e12cbdf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:43.550249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620a787-541d-430a-aa0d-070a5e12cbdf None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:43.560298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-4620a787-541d-430a-aa0d-070a5e12cbdf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:36:43.560298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:43.560298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:36:43.560298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:36:43.560298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:36:43.560298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:36:43.560298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:36:43.560298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:43.560298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:36:43.560298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:43.560298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:36:43.560298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:43.560298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:43.560298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:43.560298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:43.560298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:43.560298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:43.561358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:43.561358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:43.561358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:43.561358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:43.561358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:43.561358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:43.561358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:36:43.561358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:36:43.561358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:36:43.561358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:36:43.561358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:43.561358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:43.561358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:43.561358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:43.561358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:43.561358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:43.562252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:43.562252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:43.562252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:43.562252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:43.562252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:43.562252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:43.562252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:43.562252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:43.562252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:43.562252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:43.562252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:36:43.562252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:43.562252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:36:43.562252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:43.565588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 500/1010] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:43.567363 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188df83-db02-4891-ac65-defc6fa2526b None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:43.610484 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:43.672849 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188df83-db02-4891-ac65-defc6fa2526b None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:43.717755 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7084cee-1e0a-4356-9a2e-a017d7a75d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:43.718406 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7084cee-1e0a-4356-9a2e-a017d7a75d71 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:43.718693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7084cee-1e0a-4356-9a2e-a017d7a75d71 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:43.718971 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7084cee-1e0a-4356-9a2e-a017d7a75d71 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:43.719652 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7084cee-1e0a-4356-9a2e-a017d7a75d71 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:43.719959 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7084cee-1e0a-4356-9a2e-a017d7a75d71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:43.721371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7084cee-1e0a-4356-9a2e-a017d7a75d71 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:43.728086 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 511/1011] 10.222.0.94 () {56 vars in 1112 bytes} [Wed Aug 24 04:36:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:43.734342 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620a787-541d-430a-aa0d-070a5e12cbdf None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:43.851772 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620a787-541d-430a-aa0d-070a5e12cbdf None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:43.892261 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d0de3-964f-406a-a7b0-2f5b3c0f9a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:43.892870 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d0de3-964f-406a-a7b0-2f5b3c0f9a7a None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:43.893145 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d0de3-964f-406a-a7b0-2f5b3c0f9a7a None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:43.893444 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d0de3-964f-406a-a7b0-2f5b3c0f9a7a None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:43.894082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d0de3-964f-406a-a7b0-2f5b3c0f9a7a None admin] RBAC: Adding query filter params (type=compute) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:43.894377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d0de3-964f-406a-a7b0-2f5b3c0f9a7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:43.895749 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d0de3-964f-406a-a7b0-2f5b3c0f9a7a None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:43.911151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 501/1012] 10.222.0.94 () {56 vars in 1112 bytes} [Wed Aug 24 04:36:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:43.918341 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7084cee-1e0a-4356-9a2e-a017d7a75d71 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:44.035531 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7084cee-1e0a-4356-9a2e-a017d7a75d71 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:44.039425 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:44.074499 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d4c35-02b1-47be-a8e4-3cee97851a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:44.075189 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d4c35-02b1-47be-a8e4-3cee97851a62 None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:44.075415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d4c35-02b1-47be-a8e4-3cee97851a62 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:44.075663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d4c35-02b1-47be-a8e4-3cee97851a62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:44.076351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d4c35-02b1-47be-a8e4-3cee97851a62 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:44.077852 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d4c35-02b1-47be-a8e4-3cee97851a62 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:44.101894 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 512/1013] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:36:43 2022] POST /identity/v3/endpoints => generated 334 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:44.458328 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a1376-a701-4851-8015-bac0e7f5b1db None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:44.458957 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a1376-a701-4851-8015-bac0e7f5b1db None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:44.458957 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a1376-a701-4851-8015-bac0e7f5b1db None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:44.460173 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 502/1014] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:44.465850 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835031f-6ca9-42b3-a384-0ec95a30e038 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:44.466130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835031f-6ca9-42b3-a384-0ec95a30e038 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:44.466413 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835031f-6ca9-42b3-a384-0ec95a30e038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:44.485558 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-4835031f-6ca9-42b3-a384-0ec95a30e038 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:44.486780 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-4835031f-6ca9-42b3-a384-0ec95a30e038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:44.568800 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 513/1015] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:44 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:44.844452 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a1376-a701-4851-8015-bac0e7f5b1db None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:44.876100 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:44.880237 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c176c-bf1a-420c-907e-a43b15ef47bf None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:44.880780 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c176c-bf1a-420c-907e-a43b15ef47bf None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:44.881252 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c176c-bf1a-420c-907e-a43b15ef47bf None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:44.884069 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 514/1016] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:44.890391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314da485-a8a8-41b2-a72d-33033c1b6468 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:44.890931 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314da485-a8a8-41b2-a72d-33033c1b6468 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:44.891391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314da485-a8a8-41b2-a72d-33033c1b6468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:44.912853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-314da485-a8a8-41b2-a72d-33033c1b6468 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:44.914818 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-314da485-a8a8-41b2-a72d-33033c1b6468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:44.977239 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a1376-a701-4851-8015-bac0e7f5b1db None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:44.998707 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 515/1017] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:44 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:45.032630 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627495a1-36e8-4472-88c2-819854fd9575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:45.033612 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627495a1-36e8-4472-88c2-819854fd9575 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:45.033894 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627495a1-36e8-4472-88c2-819854fd9575 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:45.034168 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627495a1-36e8-4472-88c2-819854fd9575 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:45.035411 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627495a1-36e8-4472-88c2-819854fd9575 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:45.037168 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627495a1-36e8-4472-88c2-819854fd9575 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:45.041452 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 503/1018] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:45.048097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314da485-a8a8-41b2-a72d-33033c1b6468 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:45.070609 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:45.183693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314da485-a8a8-41b2-a72d-33033c1b6468 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:45.232529 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2da50-a08c-4386-bb1b-3380c148e1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:45.233537 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2da50-a08c-4386-bb1b-3380c148e1d3 None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:45.233829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2da50-a08c-4386-bb1b-3380c148e1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:45.234253 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2da50-a08c-4386-bb1b-3380c148e1d3 None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:45.236214 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2da50-a08c-4386-bb1b-3380c148e1d3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:45.238860 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2da50-a08c-4386-bb1b-3380c148e1d3 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:45.285473 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 516/1019] 10.222.0.94 () {60 vars in 1141 bytes} [Wed Aug 24 04:36:45 2022] POST /identity/v3/projects => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:45.344376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627495a1-36e8-4472-88c2-819854fd9575 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:45.476396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:45.484876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627495a1-36e8-4472-88c2-819854fd9575 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:45.525038 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31007001-8c83-4d73-b0f1-a30a69158ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:45.525688 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31007001-8c83-4d73-b0f1-a30a69158ece None admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:45.525964 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31007001-8c83-4d73-b0f1-a30a69158ece None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:45.526291 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31007001-8c83-4d73-b0f1-a30a69158ece None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:45.526968 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31007001-8c83-4d73-b0f1-a30a69158ece None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:45.528311 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31007001-8c83-4d73-b0f1-a30a69158ece None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:45.546595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 504/1020] 10.222.0.94 () {60 vars in 1141 bytes} [Wed Aug 24 04:36:45 2022] POST /identity/v3/services => generated 242 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:46.261129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b268315-bde2-4b66-ac96-5fe89ab06fcb None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:46.261815 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b268315-bde2-4b66-ac96-5fe89ab06fcb None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:46.261815 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b268315-bde2-4b66-ac96-5fe89ab06fcb None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:46.263477 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 517/1021] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:46.269303 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfbaa0-8fea-496f-8983-b8d6457d9427 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:46.269712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfbaa0-8fea-496f-8983-b8d6457d9427 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:46.270058 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfbaa0-8fea-496f-8983-b8d6457d9427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:46.294253 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-84cfbaa0-8fea-496f-8983-b8d6457d9427 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:46.295791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-84cfbaa0-8fea-496f-8983-b8d6457d9427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:46.381912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 505/1022] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:46.665292 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b268315-bde2-4b66-ac96-5fe89ab06fcb None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:46.745212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:46.786473 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b268315-bde2-4b66-ac96-5fe89ab06fcb None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:46.825382 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c7e3d-006c-4c24-83ab-afaf1dd056eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:46.826433 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c7e3d-006c-4c24-83ab-afaf1dd056eb None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:46.826915 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c7e3d-006c-4c24-83ab-afaf1dd056eb None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:46.827411 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c7e3d-006c-4c24-83ab-afaf1dd056eb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:46.839267 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c7e3d-006c-4c24-83ab-afaf1dd056eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:46.844506 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-818c7e3d-006c-4c24-83ab-afaf1dd056eb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:36:46.844506 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:46.844506 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:46.844506 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:46.844506 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:46.844506 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:46.844506 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:46.844506 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:46.844506 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:46.844506 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:46.844506 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:46.844506 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:46.844506 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:46.844506 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:46.844506 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:46.844506 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:46.845734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:46.845734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:46.845734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:46.845734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:46.845734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:46.845734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:46.845734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:46.845734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:46.845734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:46.845734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:46.845734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:46.845734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:46.845734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:46.845734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:46.845734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:46.845734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:46.846643 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:46.846643 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:46.846643 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:46.846643 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:46.846643 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:46.846643 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:46.846643 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:46.846643 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:46.846643 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:46.846643 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:46.846643 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:36:46.846643 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:46.849561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 518/1023] 10.222.0.94 () {56 vars in 1120 bytes} [Wed Aug 24 04:36:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:46.853513 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfbaa0-8fea-496f-8983-b8d6457d9427 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:46.950657 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:46.974584 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfbaa0-8fea-496f-8983-b8d6457d9427 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:47.019847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c36b9f-1378-4b79-9e75-789b574665ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:47.020479 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c36b9f-1378-4b79-9e75-789b574665ba None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:47.020853 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c36b9f-1378-4b79-9e75-789b574665ba None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:47.021027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c36b9f-1378-4b79-9e75-789b574665ba None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:47.021952 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c36b9f-1378-4b79-9e75-789b574665ba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:47.022205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c36b9f-1378-4b79-9e75-789b574665ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:47.023667 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c36b9f-1378-4b79-9e75-789b574665ba None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:47.032943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 506/1024] 10.222.0.94 () {56 vars in 1115 bytes} [Wed Aug 24 04:36:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:47.039475 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c7e3d-006c-4c24-83ab-afaf1dd056eb None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:47.148030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c7e3d-006c-4c24-83ab-afaf1dd056eb None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:47.177629 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:47.186547 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68f71d-1a57-4990-b5a0-5ad67ac33b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:47.187191 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68f71d-1a57-4990-b5a0-5ad67ac33b2e None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:47.187473 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68f71d-1a57-4990-b5a0-5ad67ac33b2e None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:47.187746 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68f71d-1a57-4990-b5a0-5ad67ac33b2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:47.199207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68f71d-1a57-4990-b5a0-5ad67ac33b2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:47.200727 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68f71d-1a57-4990-b5a0-5ad67ac33b2e None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:47.217230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-6c68f71d-1a57-4990-b5a0-5ad67ac33b2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:47.217230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:47.217230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:47.217230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:47.217230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:47.217230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:47.217230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:47.217230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:47.217230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:47.217230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:47.217230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:47.217230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:47.217230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:47.217230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:47.217230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:47.217230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:47.218354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:47.218354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:47.218354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:47.218354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:47.218354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:47.218354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:47.218354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:47.218354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:47.218354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:47.218354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:47.218354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:47.218354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:47.218354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:47.218354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:47.218354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:47.218354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:47.218354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:47.219275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:47.219275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:47.219275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:47.221735 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 519/1025] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:47.224403 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c36b9f-1378-4b79-9e75-789b574665ba None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:47.334480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c36b9f-1378-4b79-9e75-789b574665ba None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:47.378608 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c040a-8328-43bc-a14c-19759fd697e0 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:47.379430 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b427918-071a-4667-9076-c5ef37d2a474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:47.379560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c040a-8328-43bc-a14c-19759fd697e0 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:47.379560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c040a-8328-43bc-a14c-19759fd697e0 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:47.379864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b427918-071a-4667-9076-c5ef37d2a474 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:47.379864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b427918-071a-4667-9076-c5ef37d2a474 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:47.379864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b427918-071a-4667-9076-c5ef37d2a474 None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:47.380481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b427918-071a-4667-9076-c5ef37d2a474 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:47.380677 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 520/1026] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:36:47.380771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b427918-071a-4667-9076-c5ef37d2a474 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:47.385294 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b427918-071a-4667-9076-c5ef37d2a474 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:47.388566 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25490b-1b7c-4eda-a4f4-f7478ad75e7a None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:47.389137 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25490b-1b7c-4eda-a4f4-f7478ad75e7a None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:47.389739 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25490b-1b7c-4eda-a4f4-f7478ad75e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:47.409974 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 507/1027] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:47.417565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b427918-071a-4667-9076-c5ef37d2a474 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:47.421359 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-7b25490b-1b7c-4eda-a4f4-f7478ad75e7a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:47.421794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:47.423485 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-7b25490b-1b7c-4eda-a4f4-f7478ad75e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:47.539844 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 521/1028] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:47.541949 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2585e30-d474-4ebe-8dbe-6d04701bdb29 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:47.542329 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2585e30-d474-4ebe-8dbe-6d04701bdb29 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:47.542738 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2585e30-d474-4ebe-8dbe-6d04701bdb29 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:47.544269 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 522/1029] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:47.549573 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbf1a7-ce5b-48e0-ab7e-674f6a832dde None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:47.549865 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbf1a7-ce5b-48e0-ab7e-674f6a832dde None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:47.550145 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbf1a7-ce5b-48e0-ab7e-674f6a832dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:47.570113 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-50bbf1a7-ce5b-48e0-ab7e-674f6a832dde None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:47.571568 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-50bbf1a7-ce5b-48e0-ab7e-674f6a832dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:47.586179 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b427918-071a-4667-9076-c5ef37d2a474 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:47.637281 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a368d-f66e-4ba9-802d-07a9494036dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:47.638080 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a368d-f66e-4ba9-802d-07a9494036dd None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:47.638363 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a368d-f66e-4ba9-802d-07a9494036dd None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:47.638733 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a368d-f66e-4ba9-802d-07a9494036dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:47.648786 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a368d-f66e-4ba9-802d-07a9494036dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:47.650810 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a368d-f66e-4ba9-802d-07a9494036dd None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:47.668019 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 523/1030] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:36:47.681422 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-4c8a368d-f66e-4ba9-802d-07a9494036dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:36:47.681422 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:47.681422 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:47.681422 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:47.681422 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:47.681422 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:47.681422 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:47.681422 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:47.681422 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:47.681422 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:47.681422 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:47.681422 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:47.681422 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:47.681422 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:47.681422 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:47.681422 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:47.682561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:47.682561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:47.682561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:47.682561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:47.682561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:47.682561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:47.682561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:47.682561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:47.682561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:47.682561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:47.682561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:47.682561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:47.682561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:47.682561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:47.682561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:47.682561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:47.682561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:47.682561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:47.684323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:47.684323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:47.684323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:47.684323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:47.684323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:47.684323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:47.684323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:47.684323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:47.684323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:36:47.684323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:47.687535 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 508/1031] 10.222.0.94 () {56 vars in 1093 bytes} [Wed Aug 24 04:36:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:47.693192 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbf1a7-ce5b-48e0-ab7e-674f6a832dde None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:47.747913 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:47.822746 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbf1a7-ce5b-48e0-ab7e-674f6a832dde None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:47.828120 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a368d-f66e-4ba9-802d-07a9494036dd None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:47.864474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de2513-4a7b-431a-934d-b4c70d3476e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:47.865703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de2513-4a7b-431a-934d-b4c70d3476e8 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:47.866636 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de2513-4a7b-431a-934d-b4c70d3476e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:47.866897 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de2513-4a7b-431a-934d-b4c70d3476e8 None admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:47.867690 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de2513-4a7b-431a-934d-b4c70d3476e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:47.867957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de2513-4a7b-431a-934d-b4c70d3476e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:47.870463 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de2513-4a7b-431a-934d-b4c70d3476e8 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:47.897157 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 524/1032] 10.222.0.94 () {56 vars in 1133 bytes} [Wed Aug 24 04:36:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:47.901110 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de2513-4a7b-431a-934d-b4c70d3476e8 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:47.904532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:47.951128 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a368d-f66e-4ba9-802d-07a9494036dd None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:47.989430 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5a9d8-e03c-4dec-bec7-93169d847d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:47.990062 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5a9d8-e03c-4dec-bec7-93169d847d1a None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:47.990334 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5a9d8-e03c-4dec-bec7-93169d847d1a None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:47.990600 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5a9d8-e03c-4dec-bec7-93169d847d1a None admin] PATH_INFO: `/v3/domains/default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:47.992293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5a9d8-e03c-4dec-bec7-93169d847d1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:47.993756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5a9d8-e03c-4dec-bec7-93169d847d1a None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:47.995408 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 509/1033] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:47.996275 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5a9d8-e03c-4dec-bec7-93169d847d1a None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:48.025637 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:48.031851 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de2513-4a7b-431a-934d-b4c70d3476e8 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:48.070787 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b32464-7673-4779-9841-3035a85dd68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:48.071544 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b32464-7673-4779-9841-3035a85dd68a None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:48.071824 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b32464-7673-4779-9841-3035a85dd68a None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:48.072236 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b32464-7673-4779-9841-3035a85dd68a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:48.110788 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5a9d8-e03c-4dec-bec7-93169d847d1a None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:48.142284 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:48.150379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a75940-163b-4f38-a89d-ca0247404923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:48.151027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a75940-163b-4f38-a89d-ca0247404923 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:48.151307 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a75940-163b-4f38-a89d-ca0247404923 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:48.151665 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a75940-163b-4f38-a89d-ca0247404923 None admin] PATH_INFO: `/v3/services/image` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:48.152267 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a75940-163b-4f38-a89d-ca0247404923 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:48.153736 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a75940-163b-4f38-a89d-ca0247404923 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:48.159570 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b32464-7673-4779-9841-3035a85dd68a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:48.162261 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b32464-7673-4779-9841-3035a85dd68a None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:48.163787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-86a75940-163b-4f38-a89d-ca0247404923 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:36:48.163787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:48.163787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:36:48.163787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:36:48.163787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:36:48.163787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:36:48.163787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:36:48.163787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:48.163787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:36:48.163787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:48.163787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:36:48.163787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:48.163787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:48.163787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:48.163787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:48.163787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:48.163787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:48.164943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:48.164943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:48.164943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:48.164943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:48.164943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:48.164943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:48.164943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:36:48.164943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:36:48.164943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:36:48.164943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:36:48.164943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:48.164943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:48.164943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:48.164943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:48.164943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:48.164943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:48.165969 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:48.165969 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:48.165969 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:48.165969 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:48.165969 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:48.165969 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:48.165969 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:48.165969 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:48.165969 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:48.165969 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:48.165969 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:36:48.165969 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:48.165969 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:36:48.165969 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:48.165969 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 510/1034] 10.222.0.94 () {56 vars in 1105 bytes} [Wed Aug 24 04:36:47 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:48.166959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a75940-163b-4f38-a89d-ca0247404923 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:48.292671 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:48.298308 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 525/1035] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:47 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:36:48.299323 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b32464-7673-4779-9841-3035a85dd68a None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:48.322967 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a75940-163b-4f38-a89d-ca0247404923 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:48.367771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996aa1c6-1556-420e-ae52-893e3af9d02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:48.368862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996aa1c6-1556-420e-ae52-893e3af9d02c None admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:48.368862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996aa1c6-1556-420e-ae52-893e3af9d02c None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:48.369063 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996aa1c6-1556-420e-ae52-893e3af9d02c None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:48.369787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996aa1c6-1556-420e-ae52-893e3af9d02c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:48.371240 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996aa1c6-1556-420e-ae52-893e3af9d02c None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:48.400767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 511/1036] 10.222.0.94 () {60 vars in 1132 bytes} [Wed Aug 24 04:36:48 2022] POST /identity/v3/users => generated 285 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:48.400767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996aa1c6-1556-420e-ae52-893e3af9d02c None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:48.445253 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b32464-7673-4779-9841-3035a85dd68a None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:48.471649 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:48.502614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96523add-5f01-4e6c-aede-4d03e7acfd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:48.504204 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96523add-5f01-4e6c-aede-4d03e7acfd96 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:48.505023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96523add-5f01-4e6c-aede-4d03e7acfd96 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:48.505583 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96523add-5f01-4e6c-aede-4d03e7acfd96 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:48.507578 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96523add-5f01-4e6c-aede-4d03e7acfd96 None admin] RBAC: Adding query filter params (name=image) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:48.508052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96523add-5f01-4e6c-aede-4d03e7acfd96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:48.509826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96523add-5f01-4e6c-aede-4d03e7acfd96 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:48.518310 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 526/1037] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:48.526966 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96523add-5f01-4e6c-aede-4d03e7acfd96 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:48.583926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996aa1c6-1556-420e-ae52-893e3af9d02c None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:48.620616 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:48.633070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3423e58-09e4-4391-bd33-14ac05de8cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:48.633990 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3423e58-09e4-4391-bd33-14ac05de8cee None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:48.634340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3423e58-09e4-4391-bd33-14ac05de8cee None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:48.634613 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3423e58-09e4-4391-bd33-14ac05de8cee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:48.653258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3423e58-09e4-4391-bd33-14ac05de8cee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:48.655094 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3423e58-09e4-4391-bd33-14ac05de8cee None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:48.675359 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-b3423e58-09e4-4391-bd33-14ac05de8cee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:48.675359 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:48.675359 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:48.675359 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:48.675359 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:48.675359 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:48.675359 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:48.675359 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:48.675359 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:48.675359 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:48.675359 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:48.675359 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:48.675359 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:48.675359 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:48.675359 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:48.675359 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:48.677223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:48.677223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:48.677223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:48.677223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:48.677223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:48.677223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:48.677223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:48.677223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:48.677223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:48.677223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:48.677223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:48.677223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:48.677223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:48.677223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:48.677223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:48.677223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:48.677223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:48.680775 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:48.680775 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:48.680775 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:48.680775 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 512/1038] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:48.683617 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3423e58-09e4-4391-bd33-14ac05de8cee None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:48.695509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96523add-5f01-4e6c-aede-4d03e7acfd96 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:48.764071 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccb694-dffc-422c-98f0-859a761cce79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:48.765113 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccb694-dffc-422c-98f0-859a761cce79 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:48.765620 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccb694-dffc-422c-98f0-859a761cce79 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:48.766095 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccb694-dffc-422c-98f0-859a761cce79 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:48.767278 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ccb694-dffc-422c-98f0-859a761cce79 None admin] RBAC: Adding query filter params (type=image) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:48.767818 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ccb694-dffc-422c-98f0-859a761cce79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:48.770494 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ccb694-dffc-422c-98f0-859a761cce79 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:48.780247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 527/1039] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:48.790128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccb694-dffc-422c-98f0-859a761cce79 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:48.838518 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3423e58-09e4-4391-bd33-14ac05de8cee None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:48.841497 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:48.889735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b0ef6-5f43-4b4b-aaab-6ed39d19a543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:48.890687 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b0ef6-5f43-4b4b-aaab-6ed39d19a543 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:48.890966 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b0ef6-5f43-4b4b-aaab-6ed39d19a543 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:48.891271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b0ef6-5f43-4b4b-aaab-6ed39d19a543 None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:48.892037 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b0ef6-5f43-4b4b-aaab-6ed39d19a543 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:48.892295 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b0ef6-5f43-4b4b-aaab-6ed39d19a543 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:48.893639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b0ef6-5f43-4b4b-aaab-6ed39d19a543 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:48.910547 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 513/1040] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:48.917240 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b0ef6-5f43-4b4b-aaab-6ed39d19a543 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:48.971011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccb694-dffc-422c-98f0-859a761cce79 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:49.009092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:49.021295 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b9389-75bc-4574-9dbf-bf66873b17fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:49.023754 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b9389-75bc-4574-9dbf-bf66873b17fa None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:49.024173 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b9389-75bc-4574-9dbf-bf66873b17fa None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:49.024494 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b9389-75bc-4574-9dbf-bf66873b17fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:49.025340 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b9389-75bc-4574-9dbf-bf66873b17fa None admin] RBAC: Adding query filter params (interface=public, service_id=81ee6c52233a4fbf80b3dcb61ba02782, region_id=RegionOne) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:49.025685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b9389-75bc-4574-9dbf-bf66873b17fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:49.027562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b9389-75bc-4574-9dbf-bf66873b17fa None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:49.041427 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 528/1041] 10.222.0.94 () {56 vars in 1251 bytes} [Wed Aug 24 04:36:48 2022] GET /identity/v3/endpoints?service_id=81ee6c52233a4fbf80b3dcb61ba02782&interface=public®ion_id=RegionOne => generated 194 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:49.048909 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b9389-75bc-4574-9dbf-bf66873b17fa None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:49.075115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b0ef6-5f43-4b4b-aaab-6ed39d19a543 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:49.120991 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7cd78-0fd0-437a-b089-e913cd039b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:49.121623 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7cd78-0fd0-437a-b089-e913cd039b4a None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:49.121904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7cd78-0fd0-437a-b089-e913cd039b4a None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:49.122187 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7cd78-0fd0-437a-b089-e913cd039b4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:49.135807 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7cd78-0fd0-437a-b089-e913cd039b4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:49.138797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7cd78-0fd0-437a-b089-e913cd039b4a None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:49.157185 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-90a7cd78-0fd0-437a-b089-e913cd039b4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:49.157185 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:49.157185 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:49.157185 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:49.157185 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:49.157185 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:49.157185 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:49.157185 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:49.157185 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:49.157185 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:49.157185 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:49.157185 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:49.157185 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:49.157185 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:49.157185 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:49.158204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:49.158204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:49.158204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:49.158204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:49.158204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:49.158204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:49.158204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:49.158204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:49.158204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:49.158204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:49.158204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:49.158204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:49.158204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:49.158204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:49.158204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:49.158204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:49.158204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:49.159606 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:49.159606 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:49.159606 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:49.159606 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:49.159606 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:49.159606 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:49.159606 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:49.159606 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:49.159606 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 514/1042] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:49.166247 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7cd78-0fd0-437a-b089-e913cd039b4a None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:49.185824 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b9389-75bc-4574-9dbf-bf66873b17fa None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:49.201909 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:49.228419 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb84153-2ba2-4efa-8583-7716c56f643d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:49.229031 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb84153-2ba2-4efa-8583-7716c56f643d None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:49.229311 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb84153-2ba2-4efa-8583-7716c56f643d None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:49.229608 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb84153-2ba2-4efa-8583-7716c56f643d None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:49.230212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb84153-2ba2-4efa-8583-7716c56f643d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:49.231593 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb84153-2ba2-4efa-8583-7716c56f643d None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:49.239816 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 529/1043] 10.222.0.94 () {56 vars in 1087 bytes} [Wed Aug 24 04:36:49 2022] GET /identity/v3/services => generated 1957 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:36:49.325681 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7cd78-0fd0-437a-b089-e913cd039b4a None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:49.368830 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ac46a-559a-4f87-922a-ed5041423c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:49.369579 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ac46a-559a-4f87-922a-ed5041423c60 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:49.369862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ac46a-559a-4f87-922a-ed5041423c60 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:49.370133 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ac46a-559a-4f87-922a-ed5041423c60 None admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:49.370893 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ac46a-559a-4f87-922a-ed5041423c60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:49.371199 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ac46a-559a-4f87-922a-ed5041423c60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:49.372832 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ac46a-559a-4f87-922a-ed5041423c60 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:49.388610 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 515/1044] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:49.394649 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb84153-2ba2-4efa-8583-7716c56f643d None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:49.470651 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:49.544538 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb84153-2ba2-4efa-8583-7716c56f643d None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:49.606440 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db198455-b470-43c2-aa29-3ca48ea3560e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:49.607477 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db198455-b470-43c2-aa29-3ca48ea3560e None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:49.607970 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db198455-b470-43c2-aa29-3ca48ea3560e None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:49.608457 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db198455-b470-43c2-aa29-3ca48ea3560e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:49.609902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db198455-b470-43c2-aa29-3ca48ea3560e None admin] RBAC: Adding query filter params (role.id=17fd0dec2fe84d3bb5e22753c3e1300e, scope.project.id=4416325d266642f3a786ff9f16c827aa, user.id=5bdbda2b9c8f48338c5117585a229cb6) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:49.610323 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db198455-b470-43c2-aa29-3ca48ea3560e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:49.611770 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db198455-b470-43c2-aa29-3ca48ea3560e None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:49.618699 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 530/1045] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:36:49 2022] GET /identity/v3/role_assignments?user.id=5bdbda2b9c8f48338c5117585a229cb6&scope.project.id=4416325d266642f3a786ff9f16c827aa&role.id=17fd0dec2fe84d3bb5e22753c3e1300e => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:50.534162 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16556fde-3d46-4b04-8590-9eb860219ba6 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:50.534734 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16556fde-3d46-4b04-8590-9eb860219ba6 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:50.534734 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16556fde-3d46-4b04-8590-9eb860219ba6 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:50.536216 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 516/1046] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:50.542466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e38c15-7386-40cf-a032-0a21b6f18530 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:50.543078 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e38c15-7386-40cf-a032-0a21b6f18530 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:50.543078 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e38c15-7386-40cf-a032-0a21b6f18530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:50.562901 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-e4e38c15-7386-40cf-a032-0a21b6f18530 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:50.564136 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-e4e38c15-7386-40cf-a032-0a21b6f18530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:50.649454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 531/1047] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:50.928181 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16556fde-3d46-4b04-8590-9eb860219ba6 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:51.047166 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:51.075612 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16556fde-3d46-4b04-8590-9eb860219ba6 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:51.119740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41407634-5a45-4f57-bb56-24a935503699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:51.120394 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41407634-5a45-4f57-bb56-24a935503699 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.120790 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41407634-5a45-4f57-bb56-24a935503699 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.121023 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41407634-5a45-4f57-bb56-24a935503699 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:51.135348 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41407634-5a45-4f57-bb56-24a935503699 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:51.140930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-41407634-5a45-4f57-bb56-24a935503699 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:36:51.140930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:51.140930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:51.140930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:51.140930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:51.140930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:51.140930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:51.140930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:51.140930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:51.140930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:51.140930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:51.140930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:51.140930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:51.140930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:51.140930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:51.140930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:51.142702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:51.142702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:51.142702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:51.142702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:51.142702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:51.142702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:51.142702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:51.142702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:51.142702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:51.142702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:51.142702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:51.142702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:51.142702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:51.142702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:51.142702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:51.142702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:51.145212 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:51.145212 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:51.145212 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:51.145212 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:51.145212 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:51.145212 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:51.145212 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:51.145212 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:51.145212 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:51.145212 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:51.145212 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:36:51.145212 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:51.154652 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 517/1048] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:36:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:51.154873 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e38c15-7386-40cf-a032-0a21b6f18530 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:51.245255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:51.325784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813ebc3-c7dd-46d6-b250-af31cb6968be None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.326133 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813ebc3-c7dd-46d6-b250-af31cb6968be None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.326338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813ebc3-c7dd-46d6-b250-af31cb6968be None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:51.327333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e38c15-7386-40cf-a032-0a21b6f18530 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:51.328526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 518/1049] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:36:51.334872 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b52c2-716f-466e-9f08-918bf877c133 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.335686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b52c2-716f-466e-9f08-918bf877c133 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.335686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b52c2-716f-466e-9f08-918bf877c133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:51.357750 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-f08b52c2-716f-466e-9f08-918bf877c133 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:51.359424 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-f08b52c2-716f-466e-9f08-918bf877c133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:51.387825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541a81a-f33c-4408-907c-79388d2bbef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:51.388850 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541a81a-f33c-4408-907c-79388d2bbef9 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.389326 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541a81a-f33c-4408-907c-79388d2bbef9 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.389842 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541a81a-f33c-4408-907c-79388d2bbef9 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:51.391040 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541a81a-f33c-4408-907c-79388d2bbef9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:51.391561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541a81a-f33c-4408-907c-79388d2bbef9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:51.394158 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541a81a-f33c-4408-907c-79388d2bbef9 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:51.413941 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 532/1050] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:51.419059 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541a81a-f33c-4408-907c-79388d2bbef9 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:51.461569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 519/1051] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:36:51.619651 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541a81a-f33c-4408-907c-79388d2bbef9 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:51.640416 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:51.688672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16320a65-c293-4b24-a48d-ba1497745e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:51.689833 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16320a65-c293-4b24-a48d-ba1497745e2a None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.690334 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16320a65-c293-4b24-a48d-ba1497745e2a None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.690823 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16320a65-c293-4b24-a48d-ba1497745e2a None admin] PATH_INFO: `/v3/users/63fbe6ac2ef14a02b2376610d9aef1e0` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:51.727515 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16320a65-c293-4b24-a48d-ba1497745e2a None admin] RBAC: Authorizing `identity:get_user(user_id=63fbe6ac2ef14a02b2376610d9aef1e0)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:51.730427 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16320a65-c293-4b24-a48d-ba1497745e2a None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:51.741622 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 533/1052] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:36:51 2022] GET /identity/v3/users/63fbe6ac2ef14a02b2376610d9aef1e0 => generated 285 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:51.744687 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b52c2-716f-466e-9f08-918bf877c133 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:51.817697 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5a5a6-785a-44ee-a498-1332f7be9a66 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.817969 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5a5a6-785a-44ee-a498-1332f7be9a66 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.818250 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5a5a6-785a-44ee-a498-1332f7be9a66 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:51.820203 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 534/1053] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:36:51.828282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be9424-226e-422d-b41f-50c5135891ea None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.828615 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be9424-226e-422d-b41f-50c5135891ea None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.828921 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be9424-226e-422d-b41f-50c5135891ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:51.858790 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-b4be9424-226e-422d-b41f-50c5135891ea None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:51.860822 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-b4be9424-226e-422d-b41f-50c5135891ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:51.870222 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:51.926714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b52c2-716f-466e-9f08-918bf877c133 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:51.948875 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 535/1054] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:36:51.949798 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be9424-226e-422d-b41f-50c5135891ea None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:51.991212 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2e05d-d361-4cb6-a296-b99e63eae8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:51.992445 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2e05d-d361-4cb6-a296-b99e63eae8a1 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.992801 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2e05d-d361-4cb6-a296-b99e63eae8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.993121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2e05d-d361-4cb6-a296-b99e63eae8a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:52.092974 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:52.100788 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be9424-226e-422d-b41f-50c5135891ea None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:52.120065 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2e05d-d361-4cb6-a296-b99e63eae8a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:52.122800 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2e05d-d361-4cb6-a296-b99e63eae8a1 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:52.149748 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6406367-ee70-4f7e-b7b6-6f00b08ccab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:52.151213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6406367-ee70-4f7e-b7b6-6f00b08ccab6 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:52.151758 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6406367-ee70-4f7e-b7b6-6f00b08ccab6 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:52.152460 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6406367-ee70-4f7e-b7b6-6f00b08ccab6 None admin] PATH_INFO: `/v3/services/image` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:52.153232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6406367-ee70-4f7e-b7b6-6f00b08ccab6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:52.155317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6406367-ee70-4f7e-b7b6-6f00b08ccab6 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:52.168721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-c6406367-ee70-4f7e-b7b6-6f00b08ccab6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:36:52.168721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:52.168721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:36:52.168721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:36:52.168721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:36:52.168721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:36:52.168721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:36:52.168721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:52.168721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:36:52.168721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:52.168721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:36:52.168721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:52.168721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:52.168721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:52.168721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:52.168721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:52.168721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:52.170053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:52.170053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:52.170053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:52.170053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:52.170053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:52.170053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:52.170053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:36:52.170053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:36:52.170053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:36:52.170053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:36:52.170053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:52.170053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:52.170053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:52.170053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:52.170053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:52.170053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:52.170994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:52.170994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:52.170994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:52.170994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:52.170994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:52.170994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:52.170994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:52.170994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:52.170994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:52.170994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:52.170994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:36:52.170994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:36:52.170994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:36:52.170994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:52.171792 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 536/1055] 10.222.0.94 () {56 vars in 1105 bytes} [Wed Aug 24 04:36:51 2022] GET /identity/v3/services/image => generated 86 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:52.181084 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6406367-ee70-4f7e-b7b6-6f00b08ccab6 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:52.253770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:52.297434 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 520/1056] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:51 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 04:36:52.304088 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2e05d-d361-4cb6-a296-b99e63eae8a1 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:52.379423 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6406367-ee70-4f7e-b7b6-6f00b08ccab6 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:52.444282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac76afc-41b6-4d5b-a435-5dacf949c6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:52.445368 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac76afc-41b6-4d5b-a435-5dacf949c6d7 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:52.445928 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac76afc-41b6-4d5b-a435-5dacf949c6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:52.446424 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac76afc-41b6-4d5b-a435-5dacf949c6d7 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:52.447606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac76afc-41b6-4d5b-a435-5dacf949c6d7 None admin] RBAC: Adding query filter params (name=image) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:52.448167 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac76afc-41b6-4d5b-a435-5dacf949c6d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:52.450891 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac76afc-41b6-4d5b-a435-5dacf949c6d7 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:52.468577 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 537/1057] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:52.468577 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac76afc-41b6-4d5b-a435-5dacf949c6d7 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:52.475628 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2e05d-d361-4cb6-a296-b99e63eae8a1 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:52.516006 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:52.520683 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47deca68-1113-4742-816e-b9bcae82844c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:52.521849 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47deca68-1113-4742-816e-b9bcae82844c None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:52.522430 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47deca68-1113-4742-816e-b9bcae82844c None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:52.522911 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47deca68-1113-4742-816e-b9bcae82844c None admin] PATH_INFO: `/v3/projects/7baa36a3486b4ef1ab905d7e4381c15d` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:52.525062 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47deca68-1113-4742-816e-b9bcae82844c None admin] RBAC: Authorizing `identity:get_project(project_id=7baa36a3486b4ef1ab905d7e4381c15d)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:52.527890 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47deca68-1113-4742-816e-b9bcae82844c None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:52.531479 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 521/1058] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:52 2022] GET /identity/v3/projects/7baa36a3486b4ef1ab905d7e4381c15d => generated 311 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:52.532972 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47deca68-1113-4742-816e-b9bcae82844c None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:52.610834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:52.623412 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac76afc-41b6-4d5b-a435-5dacf949c6d7 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:52.681019 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2a52e-c664-4f35-af99-78e88e423bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:52.682023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2a52e-c664-4f35-af99-78e88e423bbb None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:52.682562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2a52e-c664-4f35-af99-78e88e423bbb None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:52.683053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2a52e-c664-4f35-af99-78e88e423bbb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:52.701331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2a52e-c664-4f35-af99-78e88e423bbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:52.706317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-79c2a52e-c664-4f35-af99-78e88e423bbb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:36:52.706317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:52.706317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:52.706317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:52.706317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:52.706317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:52.706317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:52.706317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:52.706317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:52.706317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:52.706317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:52.706317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:52.706317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:52.706317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:52.706317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:52.706317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:52.707452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:52.707452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:52.707452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:52.707452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:52.707452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:52.707452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:52.707452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:52.707452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:52.707452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:52.707452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:52.707452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:52.707452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:52.707452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:52.707452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:52.707452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:52.707452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:52.708333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:52.708333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:52.708333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:52.708333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:52.708333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:52.708333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:52.708333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:52.708333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:52.708333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:52.708333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:52.708333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:36:52.708333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:52.708333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 538/1059] 10.222.0.94 () {56 vars in 1120 bytes} [Wed Aug 24 04:36:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:52.708333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2a52e-c664-4f35-af99-78e88e423bbb None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:52.714285 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47deca68-1113-4742-816e-b9bcae82844c None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:52.756438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ae272-589d-4f67-bb94-473e26f3da48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:52.757361 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ae272-589d-4f67-bb94-473e26f3da48 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:52.757676 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ae272-589d-4f67-bb94-473e26f3da48 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:52.757954 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ae272-589d-4f67-bb94-473e26f3da48 None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:52.758606 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ae272-589d-4f67-bb94-473e26f3da48 None admin] RBAC: Adding query filter params (type=image) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:52.758917 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ae272-589d-4f67-bb94-473e26f3da48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:52.760856 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ae272-589d-4f67-bb94-473e26f3da48 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:52.768484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 522/1060] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:52.769939 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ae272-589d-4f67-bb94-473e26f3da48 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:52.837696 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:52.856974 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2a52e-c664-4f35-af99-78e88e423bbb None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:52.914522 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a7bfd-289c-47a0-ae2a-17f2a802401b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:52.915584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a7bfd-289c-47a0-ae2a-17f2a802401b None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:52.916073 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a7bfd-289c-47a0-ae2a-17f2a802401b None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:52.916564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a7bfd-289c-47a0-ae2a-17f2a802401b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:52.918024 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a7bfd-289c-47a0-ae2a-17f2a802401b None admin] RBAC: Adding query filter params (role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2, scope.project.id=7baa36a3486b4ef1ab905d7e4381c15d, user.id=63fbe6ac2ef14a02b2376610d9aef1e0) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:52.918583 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a7bfd-289c-47a0-ae2a-17f2a802401b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:52.921169 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a7bfd-289c-47a0-ae2a-17f2a802401b None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:52.932135 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 539/1061] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:36:52 2022] GET /identity/v3/role_assignments?user.id=63fbe6ac2ef14a02b2376610d9aef1e0&scope.project.id=7baa36a3486b4ef1ab905d7e4381c15d&role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:52.933522 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a7bfd-289c-47a0-ae2a-17f2a802401b None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:52.948933 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ae272-589d-4f67-bb94-473e26f3da48 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:52.953922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:53.022486 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518ab4b-1c20-41fe-bbbf-21832c073099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:53.023191 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518ab4b-1c20-41fe-bbbf-21832c073099 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:53.023612 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518ab4b-1c20-41fe-bbbf-21832c073099 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:53.024045 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518ab4b-1c20-41fe-bbbf-21832c073099 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:53.024934 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518ab4b-1c20-41fe-bbbf-21832c073099 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:53.025256 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518ab4b-1c20-41fe-bbbf-21832c073099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:53.026739 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518ab4b-1c20-41fe-bbbf-21832c073099 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:53.038022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 523/1062] 10.222.0.94 () {56 vars in 1115 bytes} [Wed Aug 24 04:36:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:53.044400 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518ab4b-1c20-41fe-bbbf-21832c073099 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:53.116777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a7bfd-289c-47a0-ae2a-17f2a802401b None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:53.163571 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0f2e3-ab10-4547-9e05-9bd3466cf9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:53.164413 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0f2e3-ab10-4547-9e05-9bd3466cf9d1 None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:53.164811 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0f2e3-ab10-4547-9e05-9bd3466cf9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:53.165261 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0f2e3-ab10-4547-9e05-9bd3466cf9d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:53.166259 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0f2e3-ab10-4547-9e05-9bd3466cf9d1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:53.169486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0f2e3-ab10-4547-9e05-9bd3466cf9d1 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:53.213245 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 540/1063] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:36:52 2022] POST /identity/v3/endpoints => generated 327 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:53.222481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518ab4b-1c20-41fe-bbbf-21832c073099 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:53.317584 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b1798-abf0-4ae3-b5d9-6cb99a1c35b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:53.318754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b1798-abf0-4ae3-b5d9-6cb99a1c35b2 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:53.319262 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b1798-abf0-4ae3-b5d9-6cb99a1c35b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:53.319759 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b1798-abf0-4ae3-b5d9-6cb99a1c35b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:53.342019 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b1798-abf0-4ae3-b5d9-6cb99a1c35b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:53.344906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b1798-abf0-4ae3-b5d9-6cb99a1c35b2 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:53.369741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-013b1798-abf0-4ae3-b5d9-6cb99a1c35b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:53.369741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:53.369741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:53.369741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:53.369741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:53.369741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:53.369741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:53.369741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:53.369741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:53.369741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:53.369741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:53.369741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:53.369741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:53.369741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:53.369741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:53.369741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:53.370802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:53.370802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:53.370802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:53.370802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:53.370802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:53.370802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:53.370802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:53.370802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:53.370802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:53.370802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:53.370802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:53.370802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:53.370802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:53.370802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:53.370802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:53.370802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:53.370802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:53.371751 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:53.371751 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:53.371751 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:53.371751 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 524/1064] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:53.376963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0f2e3-ab10-4547-9e05-9bd3466cf9d1 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:53.392902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:53.549716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0f2e3-ab10-4547-9e05-9bd3466cf9d1 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:53.617360 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c263c-146c-41b0-9927-2ea6594fcf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:53.618316 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c263c-146c-41b0-9927-2ea6594fcf3c None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:53.618893 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c263c-146c-41b0-9927-2ea6594fcf3c None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:53.619371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c263c-146c-41b0-9927-2ea6594fcf3c None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:53.620337 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c263c-146c-41b0-9927-2ea6594fcf3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:53.620863 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c263c-146c-41b0-9927-2ea6594fcf3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:53.623510 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c263c-146c-41b0-9927-2ea6594fcf3c None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:53.645519 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 541/1065] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:53.654509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b1798-abf0-4ae3-b5d9-6cb99a1c35b2 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:53.687897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:53.866229 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b1798-abf0-4ae3-b5d9-6cb99a1c35b2 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:53.932860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a0c53-2270-4eb9-a7a4-8ad5fe283d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:53.933967 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a0c53-2270-4eb9-a7a4-8ad5fe283d11 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:53.934494 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a0c53-2270-4eb9-a7a4-8ad5fe283d11 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:53.934928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a0c53-2270-4eb9-a7a4-8ad5fe283d11 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:53.950179 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a0c53-2270-4eb9-a7a4-8ad5fe283d11 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:53.952900 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a0c53-2270-4eb9-a7a4-8ad5fe283d11 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:53.976089 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-a76a0c53-2270-4eb9-a7a4-8ad5fe283d11 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:36:53.976089 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:53.976089 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:53.976089 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:53.976089 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:53.976089 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:53.976089 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:53.976089 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:53.976089 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:53.976089 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:53.976089 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:53.976089 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:53.976089 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:53.976089 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:53.976089 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:53.976089 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:53.977151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:53.977151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:53.977151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:53.977151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:53.977151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:53.977151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:53.977151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:53.977151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:53.977151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:53.977151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:53.977151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:53.977151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:53.977151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:53.977151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:53.977151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:53.977151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:53.977151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:53.977151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:53.978169 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:53.978169 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:53.978169 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:53.978169 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:53.978169 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:53.978169 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:53.978169 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:53.978169 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:53.978169 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:36:53.978169 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:53.982786 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 525/1066] 10.222.0.94 () {56 vars in 1093 bytes} [Wed Aug 24 04:36:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:53.986165 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c263c-146c-41b0-9927-2ea6594fcf3c None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:54.075988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:54.141172 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c263c-146c-41b0-9927-2ea6594fcf3c None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:54.206214 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4597f-1d72-41f8-be4b-9f44672c6115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:54.207213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4597f-1d72-41f8-be4b-9f44672c6115 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:54.207654 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4597f-1d72-41f8-be4b-9f44672c6115 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:54.208145 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4597f-1d72-41f8-be4b-9f44672c6115 None admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:54.210062 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4597f-1d72-41f8-be4b-9f44672c6115 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:54.210609 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4597f-1d72-41f8-be4b-9f44672c6115 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:54.213278 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4597f-1d72-41f8-be4b-9f44672c6115 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:54.247415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 542/1067] 10.222.0.94 () {56 vars in 1133 bytes} [Wed Aug 24 04:36:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:54.255741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a0c53-2270-4eb9-a7a4-8ad5fe283d11 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:54.398470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:54.445001 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a0c53-2270-4eb9-a7a4-8ad5fe283d11 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:54.496378 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b8942-277f-4d71-bfdb-38ef021d48d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:54.497227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b8942-277f-4d71-bfdb-38ef021d48d4 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:54.497554 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b8942-277f-4d71-bfdb-38ef021d48d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:54.497831 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b8942-277f-4d71-bfdb-38ef021d48d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:54.512830 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b8942-277f-4d71-bfdb-38ef021d48d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:54.514536 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b8942-277f-4d71-bfdb-38ef021d48d4 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:54.533550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-447b8942-277f-4d71-bfdb-38ef021d48d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:54.533550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:54.533550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:54.533550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:54.533550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:54.533550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:54.533550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:54.533550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:54.533550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:54.533550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:54.533550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:54.533550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:54.533550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:54.533550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:54.533550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:54.533550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:54.534898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:54.534898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:54.534898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:54.534898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:54.534898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:54.534898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:54.534898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:54.534898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:54.534898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:54.534898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:54.534898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:54.534898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:54.534898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:54.534898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:54.534898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:54.534898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:54.534898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:54.536569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:54.536569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:54.536569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:54.538096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 526/1068] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:54.542247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4597f-1d72-41f8-be4b-9f44672c6115 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:54.666635 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4597f-1d72-41f8-be4b-9f44672c6115 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:54.700934 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:54.716769 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a39c20-8bdd-44f0-a898-9a83967c628e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:54.717756 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a39c20-8bdd-44f0-a898-9a83967c628e None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:54.718066 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a39c20-8bdd-44f0-a898-9a83967c628e None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:54.718341 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a39c20-8bdd-44f0-a898-9a83967c628e None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:54.719301 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a39c20-8bdd-44f0-a898-9a83967c628e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:54.719693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a39c20-8bdd-44f0-a898-9a83967c628e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:54.721437 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a39c20-8bdd-44f0-a898-9a83967c628e None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:54.735080 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 543/1069] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:54.742079 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b8942-277f-4d71-bfdb-38ef021d48d4 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:54.933473 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b8942-277f-4d71-bfdb-38ef021d48d4 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:54.991461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:55.010212 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f8e2c-c944-48c5-b2d5-ae1a8fab3434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:55.011227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f8e2c-c944-48c5-b2d5-ae1a8fab3434 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:55.011707 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f8e2c-c944-48c5-b2d5-ae1a8fab3434 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:55.012177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f8e2c-c944-48c5-b2d5-ae1a8fab3434 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:55.026658 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f8e2c-c944-48c5-b2d5-ae1a8fab3434 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:55.030137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f8e2c-c944-48c5-b2d5-ae1a8fab3434 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:55.054383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-840f8e2c-c944-48c5-b2d5-ae1a8fab3434 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:55.054383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:55.054383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:55.054383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:55.054383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:55.054383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:55.054383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:55.054383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:55.054383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:55.054383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:55.054383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:55.054383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:55.054383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:55.054383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:55.054383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:55.056443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:55.056443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:55.056443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:55.056443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:55.056443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:55.056443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:55.056443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:55.056443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:55.056443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:55.056443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:55.056443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:55.056443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:55.056443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:55.056443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:55.056443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:55.056443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:55.056443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:55.059011 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:55.059011 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:55.059011 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:55.059011 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:55.059011 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:55.059011 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:55.059011 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:55.059011 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:55.060343 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 527/1070] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:55.066559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a39c20-8bdd-44f0-a898-9a83967c628e None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:55.283099 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a39c20-8bdd-44f0-a898-9a83967c628e None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:55.349574 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7f0dd-d340-46a0-bf92-27368ffb1b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:55.351556 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7f0dd-d340-46a0-bf92-27368ffb1b80 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:55.351987 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7f0dd-d340-46a0-bf92-27368ffb1b80 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:55.352420 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7f0dd-d340-46a0-bf92-27368ffb1b80 None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:55.353716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7f0dd-d340-46a0-bf92-27368ffb1b80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:55.354250 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7f0dd-d340-46a0-bf92-27368ffb1b80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:55.356947 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7f0dd-d340-46a0-bf92-27368ffb1b80 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:55.381649 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 544/1071] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:55.386418 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f8e2c-c944-48c5-b2d5-ae1a8fab3434 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:55.593351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f8e2c-c944-48c5-b2d5-ae1a8fab3434 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:55.594256 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aece2d3-500e-4b71-b2eb-64c3d71a6984 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:55.594703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aece2d3-500e-4b71-b2eb-64c3d71a6984 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:55.595144 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aece2d3-500e-4b71-b2eb-64c3d71a6984 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:55.597638 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 545/1072] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:36:55.606788 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b83375-ffd2-4559-a2fc-22470842c403 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:55.607305 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b83375-ffd2-4559-a2fc-22470842c403 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:55.607667 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b83375-ffd2-4559-a2fc-22470842c403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:55.636858 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-49b83375-ffd2-4559-a2fc-22470842c403 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:55.638702 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-49b83375-ffd2-4559-a2fc-22470842c403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:55.663108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59618bc5-d78e-42dd-810c-e2ebfcddf55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:55.664144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59618bc5-d78e-42dd-810c-e2ebfcddf55f None admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:55.664582 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59618bc5-d78e-42dd-810c-e2ebfcddf55f None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:55.665025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59618bc5-d78e-42dd-810c-e2ebfcddf55f None admin] PATH_INFO: `/v3/projects/4416325d266642f3a786ff9f16c827aa/users/5bdbda2b9c8f48338c5117585a229cb6/roles/17fd0dec2fe84d3bb5e22753c3e1300e` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:55.669391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59618bc5-d78e-42dd-810c-e2ebfcddf55f None admin] RBAC: Authorizing `identity:create_grant(project_id=4416325d266642f3a786ff9f16c827aa, user_id=5bdbda2b9c8f48338c5117585a229cb6, role_id=17fd0dec2fe84d3bb5e22753c3e1300e)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:55.671891 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59618bc5-d78e-42dd-810c-e2ebfcddf55f None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:55.696877 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 528/1073] 10.222.0.94 () {58 vars in 1439 bytes} [Wed Aug 24 04:36:55 2022] PUT /identity/v3/projects/4416325d266642f3a786ff9f16c827aa/users/5bdbda2b9c8f48338c5117585a229cb6/roles/17fd0dec2fe84d3bb5e22753c3e1300e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:55.719025 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:55.772509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 546/1074] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:55.807353 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082e44b-6a07-40e8-a4aa-d088bd7a1895 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:55.808043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082e44b-6a07-40e8-a4aa-d088bd7a1895 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:55.808665 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082e44b-6a07-40e8-a4aa-d088bd7a1895 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:55.811715 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 529/1075] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:55.821220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29142b6-b2bd-412b-a195-c13d0264bb3c None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:55.821570 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29142b6-b2bd-412b-a195-c13d0264bb3c None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:55.821887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29142b6-b2bd-412b-a195-c13d0264bb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:55.844494 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-e29142b6-b2bd-412b-a195-c13d0264bb3c None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:55.845748 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-e29142b6-b2bd-412b-a195-c13d0264bb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:55.965001 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 547/1076] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:36:56.136068 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082e44b-6a07-40e8-a4aa-d088bd7a1895 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:56.202322 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:56.301137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082e44b-6a07-40e8-a4aa-d088bd7a1895 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:56.301386 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29142b6-b2bd-412b-a195-c13d0264bb3c None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:56.358151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bdb5a-4432-4628-bef7-c5868091a551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:56.359185 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bdb5a-4432-4628-bef7-c5868091a551 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:56.359578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bdb5a-4432-4628-bef7-c5868091a551 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:56.359856 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bdb5a-4432-4628-bef7-c5868091a551 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:56.378425 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bdb5a-4432-4628-bef7-c5868091a551 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:56.384973 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-988bdb5a-4432-4628-bef7-c5868091a551 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:36:56.384973 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:56.384973 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:56.384973 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:56.384973 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:56.384973 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:56.384973 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:56.384973 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:56.384973 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:56.384973 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:56.384973 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:56.384973 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:56.384973 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:56.384973 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:56.384973 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:56.384973 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:56.386822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:56.386822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:56.386822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:56.386822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:56.386822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:56.386822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:56.386822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:56.386822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:56.386822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:56.386822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:56.386822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:56.386822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:56.386822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:56.386822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:56.386822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:56.386822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:56.388271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:56.388271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:56.388271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:56.388271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:56.388271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:56.388271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:56.388271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:56.388271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:56.388271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:56.388271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:56.388271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:36:56.388271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:36:56.388271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 530/1077] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:36:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:56.398462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bdb5a-4432-4628-bef7-c5868091a551 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:56.472523 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29142b6-b2bd-412b-a195-c13d0264bb3c None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:56.478851 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:56.543747 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1d25b-62df-4083-a198-61b0244d0d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:56.544839 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1d25b-62df-4083-a198-61b0244d0d2f None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:56.545360 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1d25b-62df-4083-a198-61b0244d0d2f None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:56.545887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1d25b-62df-4083-a198-61b0244d0d2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:56.565799 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bdb5a-4432-4628-bef7-c5868091a551 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:56.576307 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:56.613603 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba3181-d26f-4677-bece-53b93a04af15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:56.614404 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba3181-d26f-4677-bece-53b93a04af15 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:56.615540 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba3181-d26f-4677-bece-53b93a04af15 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:56.616887 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba3181-d26f-4677-bece-53b93a04af15 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:56.617953 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba3181-d26f-4677-bece-53b93a04af15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:56.618553 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba3181-d26f-4677-bece-53b93a04af15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:56.620759 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba3181-d26f-4677-bece-53b93a04af15 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:56.636784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 531/1078] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:56.645879 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba3181-d26f-4677-bece-53b93a04af15 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:56.654145 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1d25b-62df-4083-a198-61b0244d0d2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:56.655657 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1d25b-62df-4083-a198-61b0244d0d2f None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:56.832436 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba3181-d26f-4677-bece-53b93a04af15 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:56.833448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 548/1079] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 04:36:56.841455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1d25b-62df-4083-a198-61b0244d0d2f None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:56.845766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:56.895813 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417e5b3-035a-4dd5-9c55-10cdb9290fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:56.897318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417e5b3-035a-4dd5-9c55-10cdb9290fe2 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:56.897499 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417e5b3-035a-4dd5-9c55-10cdb9290fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:56.897770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417e5b3-035a-4dd5-9c55-10cdb9290fe2 None admin] PATH_INFO: `/v3/users/63fbe6ac2ef14a02b2376610d9aef1e0` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:56.899122 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417e5b3-035a-4dd5-9c55-10cdb9290fe2 None admin] RBAC: Authorizing `identity:get_user(user_id=63fbe6ac2ef14a02b2376610d9aef1e0)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:56.900601 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417e5b3-035a-4dd5-9c55-10cdb9290fe2 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:56.902346 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 532/1080] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:36:56 2022] GET /identity/v3/users/63fbe6ac2ef14a02b2376610d9aef1e0 => generated 285 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:56.909396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417e5b3-035a-4dd5-9c55-10cdb9290fe2 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:56.981223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:57.004944 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1d25b-62df-4083-a198-61b0244d0d2f None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:57.071023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebfdc7-5c5c-4009-8e78-45837260cf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:57.071716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebfdc7-5c5c-4009-8e78-45837260cf27 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:57.072066 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebfdc7-5c5c-4009-8e78-45837260cf27 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:57.072328 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebfdc7-5c5c-4009-8e78-45837260cf27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:57.086453 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eebfdc7-5c5c-4009-8e78-45837260cf27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:57.088030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eebfdc7-5c5c-4009-8e78-45837260cf27 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:57.098775 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417e5b3-035a-4dd5-9c55-10cdb9290fe2 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:57.107205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-8eebfdc7-5c5c-4009-8e78-45837260cf27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:57.107205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:57.107205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:57.107205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:57.107205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:57.107205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:57.107205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:57.107205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:57.107205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:57.107205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:57.107205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:57.107205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:57.107205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:57.107205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:57.107205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:57.107205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:57.109061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:57.109061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:57.109061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:57.109061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:57.109061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:57.109061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:57.109061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:57.109061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:57.109061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:57.109061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:57.109061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:57.109061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:57.109061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:57.109061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:57.109061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:57.109061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:57.109061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:57.110872 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:57.110872 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:57.110872 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:57.110872 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 549/1081] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:57.117206 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebfdc7-5c5c-4009-8e78-45837260cf27 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:57.157980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23e5c9-ecb5-453a-bd5f-d7d7d3a109e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:57.158987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23e5c9-ecb5-453a-bd5f-d7d7d3a109e5 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:57.159478 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23e5c9-ecb5-453a-bd5f-d7d7d3a109e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:57.159981 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23e5c9-ecb5-453a-bd5f-d7d7d3a109e5 None admin] PATH_INFO: `/v3/projects/7baa36a3486b4ef1ab905d7e4381c15d` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:57.162260 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23e5c9-ecb5-453a-bd5f-d7d7d3a109e5 None admin] RBAC: Authorizing `identity:get_project(project_id=7baa36a3486b4ef1ab905d7e4381c15d)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:57.165068 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23e5c9-ecb5-453a-bd5f-d7d7d3a109e5 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:57.168599 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 533/1082] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:56 2022] GET /identity/v3/projects/7baa36a3486b4ef1ab905d7e4381c15d => generated 311 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:57.176144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23e5c9-ecb5-453a-bd5f-d7d7d3a109e5 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:57.213395 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:57.285027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebfdc7-5c5c-4009-8e78-45837260cf27 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:57.355919 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a54a5-daa9-4fb8-bb23-e62bfb309055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:57.356953 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a54a5-daa9-4fb8-bb23-e62bfb309055 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:57.357536 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a54a5-daa9-4fb8-bb23-e62bfb309055 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:57.358017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a54a5-daa9-4fb8-bb23-e62bfb309055 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:57.359154 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a54a5-daa9-4fb8-bb23-e62bfb309055 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:57.359688 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a54a5-daa9-4fb8-bb23-e62bfb309055 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:57.362301 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a54a5-daa9-4fb8-bb23-e62bfb309055 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:57.375500 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23e5c9-ecb5-453a-bd5f-d7d7d3a109e5 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:57.380192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:57.389375 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 550/1083] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:57.452827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c042930-d628-4741-bc2a-46beff4c38f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:57.453715 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c042930-d628-4741-bc2a-46beff4c38f1 None admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:57.454204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c042930-d628-4741-bc2a-46beff4c38f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:57.454701 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c042930-d628-4741-bc2a-46beff4c38f1 None admin] PATH_INFO: `/v3/projects/7baa36a3486b4ef1ab905d7e4381c15d/users/63fbe6ac2ef14a02b2376610d9aef1e0/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:57.458725 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c042930-d628-4741-bc2a-46beff4c38f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=7baa36a3486b4ef1ab905d7e4381c15d, user_id=63fbe6ac2ef14a02b2376610d9aef1e0, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:57.460939 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c042930-d628-4741-bc2a-46beff4c38f1 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:57.488229 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 534/1084] 10.222.0.94 () {58 vars in 1439 bytes} [Wed Aug 24 04:36:57 2022] PUT /identity/v3/projects/7baa36a3486b4ef1ab905d7e4381c15d/users/63fbe6ac2ef14a02b2376610d9aef1e0/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:36:57.979229 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716473d-f26f-4593-bc53-02fdc61d412f None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:57.980064 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716473d-f26f-4593-bc53-02fdc61d412f None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:57.980215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716473d-f26f-4593-bc53-02fdc61d412f None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:57.982788 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 551/1085] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:57.992577 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6181119-6bda-4e94-aa28-f2a3a3d5ff6b None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:57.992930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6181119-6bda-4e94-aa28-f2a3a3d5ff6b None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:57.993274 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6181119-6bda-4e94-aa28-f2a3a3d5ff6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:58.015395 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-d6181119-6bda-4e94-aa28-f2a3a3d5ff6b None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:58.016811 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-d6181119-6bda-4e94-aa28-f2a3a3d5ff6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:58.108811 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 535/1086] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:36:58.393893 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716473d-f26f-4593-bc53-02fdc61d412f None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:58.585956 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716473d-f26f-4593-bc53-02fdc61d412f None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:58.622275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:58.650739 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bc38a-e4f2-4107-9d6a-711f3062c3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:58.651305 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bc38a-e4f2-4107-9d6a-711f3062c3a5 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:58.651583 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bc38a-e4f2-4107-9d6a-711f3062c3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:58.651854 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bc38a-e4f2-4107-9d6a-711f3062c3a5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:58.665659 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3bc38a-e4f2-4107-9d6a-711f3062c3a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:58.670929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-2e3bc38a-e4f2-4107-9d6a-711f3062c3a5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:36:58.670929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:58.670929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:58.670929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:58.670929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:58.670929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:58.670929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:58.670929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:58.670929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:58.670929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:58.670929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:58.670929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:58.670929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:58.670929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:58.670929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:58.670929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:58.672853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:58.672853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:58.672853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:58.672853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:58.672853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:58.672853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:58.672853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:58.672853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:58.672853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:58.672853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:58.672853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:58.672853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:58.672853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:58.672853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:58.672853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:58.672853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:58.674646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:58.674646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:58.674646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:58.674646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:58.674646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:58.674646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:58.674646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:58.674646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:58.674646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:58.674646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:58.674646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:36:58.674646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:58.674646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 552/1087] 10.222.0.94 () {56 vars in 1120 bytes} [Wed Aug 24 04:36:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:58.680916 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6181119-6bda-4e94-aa28-f2a3a3d5ff6b None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:58.848718 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:58.860440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6181119-6bda-4e94-aa28-f2a3a3d5ff6b None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:58.931965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bf527-23f9-4547-ab85-8daac9a2206c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:58.932925 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bf527-23f9-4547-ab85-8daac9a2206c None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:58.933456 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bf527-23f9-4547-ab85-8daac9a2206c None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:58.933949 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bf527-23f9-4547-ab85-8daac9a2206c None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:58.935228 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bf527-23f9-4547-ab85-8daac9a2206c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:58.935794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bf527-23f9-4547-ab85-8daac9a2206c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:58.938490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bf527-23f9-4547-ab85-8daac9a2206c None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:58.953021 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 536/1088] 10.222.0.94 () {56 vars in 1115 bytes} [Wed Aug 24 04:36:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:58.959468 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bc38a-e4f2-4107-9d6a-711f3062c3a5 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:59.157875 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bc38a-e4f2-4107-9d6a-711f3062c3a5 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:59.212896 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6289c0-a76d-4264-a7cc-46f296b3a450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:59.213481 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6289c0-a76d-4264-a7cc-46f296b3a450 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:59.213781 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6289c0-a76d-4264-a7cc-46f296b3a450 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:59.214060 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6289c0-a76d-4264-a7cc-46f296b3a450 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:59.229254 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6289c0-a76d-4264-a7cc-46f296b3a450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:59.230925 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6289c0-a76d-4264-a7cc-46f296b3a450 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:59.251321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-8a6289c0-a76d-4264-a7cc-46f296b3a450 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:59.251321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:59.251321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:59.251321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:59.251321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:59.251321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:59.251321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:59.251321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:59.251321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:59.251321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:59.251321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:59.251321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:59.251321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:59.251321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:59.251321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:59.251321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:59.253186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:59.253186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:59.253186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:59.253186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:59.253186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:59.253186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:59.253186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:59.253186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:59.253186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:59.253186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:59.253186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:59.253186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:59.253186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:59.253186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:59.253186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:59.253186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:59.253186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:59.254918 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:59.254918 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:59.254918 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:59.254918 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 553/1089] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:59.259734 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bf527-23f9-4547-ab85-8daac9a2206c None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:59.394947 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bf527-23f9-4547-ab85-8daac9a2206c None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:59.442073 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8989be-df32-475f-b93b-ce9fb2e111aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:59.442694 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8989be-df32-475f-b93b-ce9fb2e111aa None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:59.443050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8989be-df32-475f-b93b-ce9fb2e111aa None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:59.443812 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8989be-df32-475f-b93b-ce9fb2e111aa None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:59.444498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8989be-df32-475f-b93b-ce9fb2e111aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:59.444804 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8989be-df32-475f-b93b-ce9fb2e111aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:59.446324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8989be-df32-475f-b93b-ce9fb2e111aa None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:59.462352 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 537/1090] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:59.468758 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6289c0-a76d-4264-a7cc-46f296b3a450 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:59.521701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:59.660285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6289c0-a76d-4264-a7cc-46f296b3a450 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:59.716534 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75448f54-30ef-47c8-bc99-961b040983b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:59.717520 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75448f54-30ef-47c8-bc99-961b040983b0 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:59.717840 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75448f54-30ef-47c8-bc99-961b040983b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:59.719151 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75448f54-30ef-47c8-bc99-961b040983b0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:59.732136 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75448f54-30ef-47c8-bc99-961b040983b0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:59.734287 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75448f54-30ef-47c8-bc99-961b040983b0 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:59.751765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-75448f54-30ef-47c8-bc99-961b040983b0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:36:59.751765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:59.751765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:59.751765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:59.751765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:59.751765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:59.751765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:59.751765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:59.751765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:59.751765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:59.751765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:59.751765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:59.751765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:59.751765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:59.751765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:59.751765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:59.753058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:59.753058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:59.753058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:59.753058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:59.753058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:59.753058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:59.753058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:59.753058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:59.753058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:59.753058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:59.753058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:59.753058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:59.753058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:59.753058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:59.753058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:59.753058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:59.753058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:59.753058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:59.754064 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:59.754064 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:59.754064 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:59.754064 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:59.754064 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:59.754064 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:59.754064 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:59.754064 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:59.754064 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:36:59.754064 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:36:59.754064 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 554/1091] 10.222.0.94 () {56 vars in 1093 bytes} [Wed Aug 24 04:36:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:59.761216 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8989be-df32-475f-b93b-ce9fb2e111aa None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:59.792684 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:59.822905 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebef49-546a-49d9-ba51-7a1d491b8eab None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:59.823322 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebef49-546a-49d9-ba51-7a1d491b8eab None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:59.823702 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebef49-546a-49d9-ba51-7a1d491b8eab None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:59.825466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 555/1092] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:36:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:36:59.831559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e552a-3e0e-4f27-be62-819a9bf2e75d None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:59.831850 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e552a-3e0e-4f27-be62-819a9bf2e75d None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:59.832148 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e552a-3e0e-4f27-be62-819a9bf2e75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:59.853804 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-735e552a-3e0e-4f27-be62-819a9bf2e75d None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:59.855081 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-735e552a-3e0e-4f27-be62-819a9bf2e75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:59.934554 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8989be-df32-475f-b93b-ce9fb2e111aa None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:59.958278 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 556/1093] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:36:59.999103 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ede9b1-b184-4322-af48-20917e86580c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:59.999987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ede9b1-b184-4322-af48-20917e86580c None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:00.000448 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ede9b1-b184-4322-af48-20917e86580c None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:00.000901 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ede9b1-b184-4322-af48-20917e86580c None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:00.002228 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ede9b1-b184-4322-af48-20917e86580c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:00.002711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ede9b1-b184-4322-af48-20917e86580c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:00.005119 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ede9b1-b184-4322-af48-20917e86580c None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:00.044682 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 538/1094] 10.222.0.94 () {56 vars in 1133 bytes} [Wed Aug 24 04:36:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:00.046155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e552a-3e0e-4f27-be62-819a9bf2e75d None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:00.072569 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:00.206157 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e552a-3e0e-4f27-be62-819a9bf2e75d None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:00.252516 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ede9b1-b184-4322-af48-20917e86580c None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:00.277109 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d2718-4855-4c70-a7c3-7421718689c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:00.277917 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d2718-4855-4c70-a7c3-7421718689c4 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:00.278588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d2718-4855-4c70-a7c3-7421718689c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:00.278998 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d2718-4855-4c70-a7c3-7421718689c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:00.361918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:00.405377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ede9b1-b184-4322-af48-20917e86580c None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:00.408486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d2718-4855-4c70-a7c3-7421718689c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:00.411227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d2718-4855-4c70-a7c3-7421718689c4 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:00.448288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:00.455849 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d9b9e-999a-41ef-85a3-dc46dd6644dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:00.456504 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d9b9e-999a-41ef-85a3-dc46dd6644dc None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:00.456779 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d9b9e-999a-41ef-85a3-dc46dd6644dc None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:00.457049 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d9b9e-999a-41ef-85a3-dc46dd6644dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:00.470360 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d9b9e-999a-41ef-85a3-dc46dd6644dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:37:00.477367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-f40d9b9e-999a-41ef-85a3-dc46dd6644dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:00.477367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:00.477367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:00.477367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:00.477367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:00.477367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:00.477367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:00.477367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:00.477367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:00.477367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:00.477367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:00.477367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:00.477367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:37:00.477367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:37:00.477367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:37:00.477367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:37:00.479462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:37:00.479462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:37:00.479462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:37:00.479462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:37:00.479462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:00.479462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:00.479462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:00.479462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:00.479462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:00.479462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:00.479462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:00.479462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:00.479462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:00.479462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:00.479462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:00.479462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:00.481137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:00.481137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:00.481137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:00.481137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:00.481137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:37:00.481137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:37:00.481137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:37:00.481137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:37:00.481137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:37:00.481137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:37:00.481137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:00.481137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:37:00.481137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 539/1095] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:37:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:00.488951 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d9b9e-999a-41ef-85a3-dc46dd6644dc None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:00.577254 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 557/1096] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:37:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:37:00.583384 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d2718-4855-4c70-a7c3-7421718689c4 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:00.650271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d9b9e-999a-41ef-85a3-dc46dd6644dc None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:00.702363 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97e8f9-ff94-4429-ba28-d049b4cdde2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:00.703008 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97e8f9-ff94-4429-ba28-d049b4cdde2c None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:00.703289 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97e8f9-ff94-4429-ba28-d049b4cdde2c None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:00.703553 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97e8f9-ff94-4429-ba28-d049b4cdde2c None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:00.704291 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97e8f9-ff94-4429-ba28-d049b4cdde2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:00.704593 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97e8f9-ff94-4429-ba28-d049b4cdde2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:00.705039 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d2718-4855-4c70-a7c3-7421718689c4 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:00.706139 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97e8f9-ff94-4429-ba28-d049b4cdde2c None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:00.709287 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:00.726606 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 540/1097] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:37:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:00.727835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:00.728074 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97e8f9-ff94-4429-ba28-d049b4cdde2c None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:00.749322 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b87478-a716-40a6-8e36-bb3f1049b3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:00.750007 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b87478-a716-40a6-8e36-bb3f1049b3de None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:00.750284 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b87478-a716-40a6-8e36-bb3f1049b3de None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:00.750594 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b87478-a716-40a6-8e36-bb3f1049b3de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:00.762154 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b87478-a716-40a6-8e36-bb3f1049b3de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:00.763669 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b87478-a716-40a6-8e36-bb3f1049b3de None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:00.781332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-44b87478-a716-40a6-8e36-bb3f1049b3de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:00.781332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:00.781332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:00.781332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:00.781332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:00.781332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:00.781332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:00.781332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:00.781332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:00.781332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:00.781332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:00.781332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:00.781332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:00.781332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:00.781332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:00.781332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:00.782611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:00.782611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:00.782611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:00.782611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:00.782611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:00.782611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:00.782611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:00.782611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:00.782611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:00.782611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:00.782611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:00.782611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:00.782611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:00.782611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:00.782611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:00.782611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:00.782611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:00.783828 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:00.783828 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:00.783828 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:37:00.783828 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 558/1098] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:00.789342 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b87478-a716-40a6-8e36-bb3f1049b3de None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:00.889026 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97e8f9-ff94-4429-ba28-d049b4cdde2c None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:00.930490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c91fcd-6f1c-4ac9-a09e-bd46102da939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:00.931171 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c91fcd-6f1c-4ac9-a09e-bd46102da939 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:00.931445 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c91fcd-6f1c-4ac9-a09e-bd46102da939 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:00.931714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c91fcd-6f1c-4ac9-a09e-bd46102da939 None admin] PATH_INFO: `/v3/users/63fbe6ac2ef14a02b2376610d9aef1e0` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:00.932876 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b87478-a716-40a6-8e36-bb3f1049b3de None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:00.933060 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c91fcd-6f1c-4ac9-a09e-bd46102da939 None admin] RBAC: Authorizing `identity:get_user(user_id=63fbe6ac2ef14a02b2376610d9aef1e0)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:00.934405 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c91fcd-6f1c-4ac9-a09e-bd46102da939 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:00.936068 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 541/1099] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:37:00 2022] GET /identity/v3/users/63fbe6ac2ef14a02b2376610d9aef1e0 => generated 285 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:00.942230 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c91fcd-6f1c-4ac9-a09e-bd46102da939 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:00.993919 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f449ff9-810d-4236-a866-ea65b32cceca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:00.994537 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f449ff9-810d-4236-a866-ea65b32cceca None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:00.994901 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f449ff9-810d-4236-a866-ea65b32cceca None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:00.995292 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f449ff9-810d-4236-a866-ea65b32cceca None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:00.996082 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f449ff9-810d-4236-a866-ea65b32cceca None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:00.996388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f449ff9-810d-4236-a866-ea65b32cceca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:00.998671 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f449ff9-810d-4236-a866-ea65b32cceca None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:01.013042 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 559/1100] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:01.018889 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f449ff9-810d-4236-a866-ea65b32cceca None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:01.029545 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:01.060838 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:01.094738 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c91fcd-6f1c-4ac9-a09e-bd46102da939 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:01.156274 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f7877-8f70-4461-b561-dfb460378c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:01.157142 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f7877-8f70-4461-b561-dfb460378c6a None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:01.157631 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f7877-8f70-4461-b561-dfb460378c6a None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:01.158077 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f7877-8f70-4461-b561-dfb460378c6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:01.165214 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f449ff9-810d-4236-a866-ea65b32cceca None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:01.229244 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8460a-54eb-430f-8929-7230d581fcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:01.230328 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8460a-54eb-430f-8929-7230d581fcc8 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:01.230704 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8460a-54eb-430f-8929-7230d581fcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:01.231064 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8460a-54eb-430f-8929-7230d581fcc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:01.244467 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8460a-54eb-430f-8929-7230d581fcc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:01.246982 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8460a-54eb-430f-8929-7230d581fcc8 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:01.266603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-3aa8460a-54eb-430f-8929-7230d581fcc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:01.266603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:01.266603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:01.266603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:01.266603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:01.266603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:01.266603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:01.266603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:01.266603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:01.266603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:01.266603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:01.266603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:01.266603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:37:01.266603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:37:01.266603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:37:01.268393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:37:01.268393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:01.268393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:01.268393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:01.268393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:01.268393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:01.268393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:01.268393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:01.268393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:01.268393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:01.268393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:01.268393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:01.268393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:01.268393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:01.268393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:01.268393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:01.268393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:01.270177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:37:01.270177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:37:01.270177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:37:01.270177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:37:01.270177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:37:01.270177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:37:01.270177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:01.270177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:37:01.270177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 560/1101] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:37:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:01.278857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8460a-54eb-430f-8929-7230d581fcc8 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:01.284205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f7877-8f70-4461-b561-dfb460378c6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:01.286086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f7877-8f70-4461-b561-dfb460378c6a None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:01.363059 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:01.409742 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 542/1102] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:37:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 04:37:01.418407 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f7877-8f70-4461-b561-dfb460378c6a None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:01.436028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:01.456729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8460a-54eb-430f-8929-7230d581fcc8 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:01.508647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bebed8-6c91-4ea8-91c2-d602e5fb0fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:01.509119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bebed8-6c91-4ea8-91c2-d602e5fb0fc0 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:01.509577 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bebed8-6c91-4ea8-91c2-d602e5fb0fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:01.509978 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bebed8-6c91-4ea8-91c2-d602e5fb0fc0 None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:01.511126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bebed8-6c91-4ea8-91c2-d602e5fb0fc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:01.511641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bebed8-6c91-4ea8-91c2-d602e5fb0fc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:01.513167 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bebed8-6c91-4ea8-91c2-d602e5fb0fc0 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:01.528121 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 561/1103] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:37:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:01.536142 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bebed8-6c91-4ea8-91c2-d602e5fb0fc0 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:01.560532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f7877-8f70-4461-b561-dfb460378c6a None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:01.603295 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbea73-fade-49b2-acb3-313ae077c6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:01.603943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbea73-fade-49b2-acb3-313ae077c6f1 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:01.604275 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbea73-fade-49b2-acb3-313ae077c6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:01.604554 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbea73-fade-49b2-acb3-313ae077c6f1 None admin] PATH_INFO: `/v3/projects/7baa36a3486b4ef1ab905d7e4381c15d` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:01.605807 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbea73-fade-49b2-acb3-313ae077c6f1 None admin] RBAC: Authorizing `identity:get_project(project_id=7baa36a3486b4ef1ab905d7e4381c15d)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:01.607285 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbea73-fade-49b2-acb3-313ae077c6f1 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:01.608997 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 543/1104] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:37:01 2022] GET /identity/v3/projects/7baa36a3486b4ef1ab905d7e4381c15d => generated 311 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:01.615693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbea73-fade-49b2-acb3-313ae077c6f1 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:01.651816 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:01.687317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bebed8-6c91-4ea8-91c2-d602e5fb0fc0 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:01.740107 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6881d6-a2f8-429c-8e84-8a6cebb03a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:01.741174 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6881d6-a2f8-429c-8e84-8a6cebb03a63 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:01.741715 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6881d6-a2f8-429c-8e84-8a6cebb03a63 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:01.742202 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6881d6-a2f8-429c-8e84-8a6cebb03a63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:01.743643 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6881d6-a2f8-429c-8e84-8a6cebb03a63 None admin] RBAC: Adding query filter params (role.id=17fd0dec2fe84d3bb5e22753c3e1300e, scope.project.id=4416325d266642f3a786ff9f16c827aa, user.id=5bdbda2b9c8f48338c5117585a229cb6) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:01.744216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6881d6-a2f8-429c-8e84-8a6cebb03a63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:01.747022 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6881d6-a2f8-429c-8e84-8a6cebb03a63 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:01.773490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 562/1105] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:37:01 2022] GET /identity/v3/role_assignments?user.id=5bdbda2b9c8f48338c5117585a229cb6&scope.project.id=4416325d266642f3a786ff9f16c827aa&role.id=17fd0dec2fe84d3bb5e22753c3e1300e => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:01.773797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbea73-fade-49b2-acb3-313ae077c6f1 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:01.822559 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db24a62-c5e0-406b-a2c0-275aee289698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:01.823619 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db24a62-c5e0-406b-a2c0-275aee289698 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:01.824098 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db24a62-c5e0-406b-a2c0-275aee289698 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:01.824546 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db24a62-c5e0-406b-a2c0-275aee289698 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:01.825915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db24a62-c5e0-406b-a2c0-275aee289698 None admin] RBAC: Adding query filter params (role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2, scope.project.id=7baa36a3486b4ef1ab905d7e4381c15d, user.id=63fbe6ac2ef14a02b2376610d9aef1e0) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:01.826470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db24a62-c5e0-406b-a2c0-275aee289698 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:01.829227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db24a62-c5e0-406b-a2c0-275aee289698 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:01.839937 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 544/1106] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:37:01 2022] GET /identity/v3/role_assignments?user.id=63fbe6ac2ef14a02b2376610d9aef1e0&scope.project.id=7baa36a3486b4ef1ab905d7e4381c15d&role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:04.050630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b889f8-4932-4d37-a58a-269a655a4dfc None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:04.051224 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b889f8-4932-4d37-a58a-269a655a4dfc None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:04.051626 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b889f8-4932-4d37-a58a-269a655a4dfc None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:04.055144 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 563/1107] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:37:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:04.061268 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3f28b-b973-422f-85aa-c1bbfef441c7 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:04.061899 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3f28b-b973-422f-85aa-c1bbfef441c7 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:04.061899 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3f28b-b973-422f-85aa-c1bbfef441c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:04.085782 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-d5a3f28b-b973-422f-85aa-c1bbfef441c7 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:04.087731 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-d5a3f28b-b973-422f-85aa-c1bbfef441c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:04.188261 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 545/1108] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:04.503899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b889f8-4932-4d37-a58a-269a655a4dfc None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:04.526428 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:04.659399 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b889f8-4932-4d37-a58a-269a655a4dfc None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:04.707822 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec64d4-3f18-42e2-a36b-f069ee3ae0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:04.709244 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec64d4-3f18-42e2-a36b-f069ee3ae0e8 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:04.709817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec64d4-3f18-42e2-a36b-f069ee3ae0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:04.710151 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec64d4-3f18-42e2-a36b-f069ee3ae0e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:04.711769 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec64d4-3f18-42e2-a36b-f069ee3ae0e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:04.714125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec64d4-3f18-42e2-a36b-f069ee3ae0e8 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:04.716986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 564/1109] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:04.725251 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a3f28b-b973-422f-85aa-c1bbfef441c7 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:04.759050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:04.870816 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a3f28b-b973-422f-85aa-c1bbfef441c7 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:04.922168 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66001d08-a772-41fb-8f9a-4219330a6009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:04.922788 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66001d08-a772-41fb-8f9a-4219330a6009 None admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:04.923060 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66001d08-a772-41fb-8f9a-4219330a6009 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:04.923326 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66001d08-a772-41fb-8f9a-4219330a6009 None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:04.924000 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66001d08-a772-41fb-8f9a-4219330a6009 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:04.925496 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66001d08-a772-41fb-8f9a-4219330a6009 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:04.956752 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 546/1110] 10.222.0.94 () {60 vars in 1132 bytes} [Wed Aug 24 04:37:04 2022] POST /identity/v3/users => generated 286 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:37:07.531083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0debe-e826-448f-b881-2888aa4c8462 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:07.531993 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0debe-e826-448f-b881-2888aa4c8462 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:07.531993 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0debe-e826-448f-b881-2888aa4c8462 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:07.534554 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 565/1111] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:37:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:07.542628 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee9129-ddef-4c2f-ad3f-e44e626dc26a None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:07.543454 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee9129-ddef-4c2f-ad3f-e44e626dc26a None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:07.543454 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee9129-ddef-4c2f-ad3f-e44e626dc26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:07.563958 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-f2ee9129-ddef-4c2f-ad3f-e44e626dc26a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:07.565212 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-f2ee9129-ddef-4c2f-ad3f-e44e626dc26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:07.658503 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 547/1112] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:07.965850 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0debe-e826-448f-b881-2888aa4c8462 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:08.115863 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:08.152424 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0debe-e826-448f-b881-2888aa4c8462 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:08.220928 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007684d9-35e2-49c5-829b-fe43627b477a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:08.221609 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007684d9-35e2-49c5-829b-fe43627b477a None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:08.222048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007684d9-35e2-49c5-829b-fe43627b477a None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:08.222396 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007684d9-35e2-49c5-829b-fe43627b477a None admin] PATH_INFO: `/v3/roles/f08394a5dbcf4506a17b78b4416f1680` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:08.225026 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007684d9-35e2-49c5-829b-fe43627b477a None admin] RBAC: Authorizing `identity:get_role(role_id=f08394a5dbcf4506a17b78b4416f1680)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:08.226955 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007684d9-35e2-49c5-829b-fe43627b477a None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:08.228562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 566/1113] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:37:07 2022] GET /identity/v3/roles/f08394a5dbcf4506a17b78b4416f1680 => generated 223 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:08.236224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee9129-ddef-4c2f-ad3f-e44e626dc26a None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:08.261439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:08.389445 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee9129-ddef-4c2f-ad3f-e44e626dc26a None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:08.451635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5988c29-d49a-4bfe-be0d-223ce85c0a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:08.452700 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5988c29-d49a-4bfe-be0d-223ce85c0a30 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:08.453184 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5988c29-d49a-4bfe-be0d-223ce85c0a30 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:08.453700 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5988c29-d49a-4bfe-be0d-223ce85c0a30 None admin] PATH_INFO: `/v3/users/7874e31d490a4742a9345b9f7d076ad5` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:08.482189 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5988c29-d49a-4bfe-be0d-223ce85c0a30 None admin] RBAC: Authorizing `identity:get_user(user_id=7874e31d490a4742a9345b9f7d076ad5)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:08.483816 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5988c29-d49a-4bfe-be0d-223ce85c0a30 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:08.485673 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 548/1114] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:37:08 2022] GET /identity/v3/users/7874e31d490a4742a9345b9f7d076ad5 => generated 286 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:08.492841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007684d9-35e2-49c5-829b-fe43627b477a None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:08.674661 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007684d9-35e2-49c5-829b-fe43627b477a None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:08.727391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d5d99-9ece-42cd-be16-a4b5ae19c42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:08.728070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d5d99-9ece-42cd-be16-a4b5ae19c42d None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:08.728391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d5d99-9ece-42cd-be16-a4b5ae19c42d None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:08.728684 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d5d99-9ece-42cd-be16-a4b5ae19c42d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:08.765246 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:08.830064 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d5d99-9ece-42cd-be16-a4b5ae19c42d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:08.831733 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d5d99-9ece-42cd-be16-a4b5ae19c42d None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:08.996480 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 567/1115] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:37:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:37:09.006710 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5988c29-d49a-4bfe-be0d-223ce85c0a30 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:09.118673 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:09.186074 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5988c29-d49a-4bfe-be0d-223ce85c0a30 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:09.249899 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303fa2e-8f0a-4cf8-ab44-42efdd8c3b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:09.251136 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303fa2e-8f0a-4cf8-ab44-42efdd8c3b07 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:09.251708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303fa2e-8f0a-4cf8-ab44-42efdd8c3b07 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:09.252237 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303fa2e-8f0a-4cf8-ab44-42efdd8c3b07 None admin] PATH_INFO: `/v3/projects/7baa36a3486b4ef1ab905d7e4381c15d` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:09.254793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303fa2e-8f0a-4cf8-ab44-42efdd8c3b07 None admin] RBAC: Authorizing `identity:get_project(project_id=7baa36a3486b4ef1ab905d7e4381c15d)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:09.258346 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303fa2e-8f0a-4cf8-ab44-42efdd8c3b07 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:09.262021 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 549/1116] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:37:09 2022] GET /identity/v3/projects/7baa36a3486b4ef1ab905d7e4381c15d => generated 311 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:09.272077 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d5d99-9ece-42cd-be16-a4b5ae19c42d None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:09.360982 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:09.453539 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d5d99-9ece-42cd-be16-a4b5ae19c42d None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:09.518486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16dd15-97fd-487c-96f0-c4ce1cfa9134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:09.519111 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16dd15-97fd-487c-96f0-c4ce1cfa9134 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:09.519391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16dd15-97fd-487c-96f0-c4ce1cfa9134 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:09.519666 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16dd15-97fd-487c-96f0-c4ce1cfa9134 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:09.520528 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16dd15-97fd-487c-96f0-c4ce1cfa9134 None admin] RBAC: Adding query filter params (role.id=f08394a5dbcf4506a17b78b4416f1680, scope.project.id=7baa36a3486b4ef1ab905d7e4381c15d, user.id=7874e31d490a4742a9345b9f7d076ad5) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:09.520840 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16dd15-97fd-487c-96f0-c4ce1cfa9134 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:09.522523 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16dd15-97fd-487c-96f0-c4ce1cfa9134 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:09.530150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 568/1117] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:37:09 2022] GET /identity/v3/role_assignments?user.id=7874e31d490a4742a9345b9f7d076ad5&scope.project.id=7baa36a3486b4ef1ab905d7e4381c15d&role.id=f08394a5dbcf4506a17b78b4416f1680 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:11.800243 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09fcde-ff25-49fb-b61c-75040d92bda9 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:11.800793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09fcde-ff25-49fb-b61c-75040d92bda9 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:11.800912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09fcde-ff25-49fb-b61c-75040d92bda9 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:11.802661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 550/1118] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:37:11.808955 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ab713-eba2-4d43-ae51-0bd8cda08674 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:11.809579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ab713-eba2-4d43-ae51-0bd8cda08674 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:11.809579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ab713-eba2-4d43-ae51-0bd8cda08674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:11.829995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-8e8ab713-eba2-4d43-ae51-0bd8cda08674 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:11.831327 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-8e8ab713-eba2-4d43-ae51-0bd8cda08674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:11.948663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 569/1119] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:37:12.226532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09fcde-ff25-49fb-b61c-75040d92bda9 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:12.419499 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09fcde-ff25-49fb-b61c-75040d92bda9 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:12.464620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc1919-123b-4265-a76b-0dc35b86a60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:12.465316 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc1919-123b-4265-a76b-0dc35b86a60b None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:12.465681 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc1919-123b-4265-a76b-0dc35b86a60b None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:12.466011 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc1919-123b-4265-a76b-0dc35b86a60b None admin] PATH_INFO: `/v3/roles/f08394a5dbcf4506a17b78b4416f1680` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:12.467598 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc1919-123b-4265-a76b-0dc35b86a60b None admin] RBAC: Authorizing `identity:get_role(role_id=f08394a5dbcf4506a17b78b4416f1680)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:12.469088 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc1919-123b-4265-a76b-0dc35b86a60b None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:12.470930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 551/1120] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:37:12 2022] GET /identity/v3/roles/f08394a5dbcf4506a17b78b4416f1680 => generated 223 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:12.478868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ab713-eba2-4d43-ae51-0bd8cda08674 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:12.574771 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:12.670994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ab713-eba2-4d43-ae51-0bd8cda08674 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:12.737923 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcdca9d-82c9-49e6-979f-4e949f8cd1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:12.739508 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdca9d-82c9-49e6-979f-4e949f8cd1d7 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:12.740014 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdca9d-82c9-49e6-979f-4e949f8cd1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:12.740502 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdca9d-82c9-49e6-979f-4e949f8cd1d7 None admin] PATH_INFO: `/v3/users/7874e31d490a4742a9345b9f7d076ad5` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:12.742780 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcdca9d-82c9-49e6-979f-4e949f8cd1d7 None admin] RBAC: Authorizing `identity:get_user(user_id=7874e31d490a4742a9345b9f7d076ad5)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:12.745318 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcdca9d-82c9-49e6-979f-4e949f8cd1d7 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:12.748436 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 570/1121] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:37:12 2022] GET /identity/v3/users/7874e31d490a4742a9345b9f7d076ad5 => generated 286 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:12.758188 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc1919-123b-4265-a76b-0dc35b86a60b None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:12.770869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:12.901742 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc1919-123b-4265-a76b-0dc35b86a60b None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:12.946820 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6649a26-a499-4d7a-8dbd-f8158b09a7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:12.947546 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6649a26-a499-4d7a-8dbd-f8158b09a7d7 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:12.947874 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6649a26-a499-4d7a-8dbd-f8158b09a7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:12.948199 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6649a26-a499-4d7a-8dbd-f8158b09a7d7 None admin] PATH_INFO: `/v3/projects/7baa36a3486b4ef1ab905d7e4381c15d` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:12.949570 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6649a26-a499-4d7a-8dbd-f8158b09a7d7 None admin] RBAC: Authorizing `identity:get_project(project_id=7baa36a3486b4ef1ab905d7e4381c15d)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:12.951131 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6649a26-a499-4d7a-8dbd-f8158b09a7d7 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:12.953009 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 552/1122] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:37:12 2022] GET /identity/v3/projects/7baa36a3486b4ef1ab905d7e4381c15d => generated 311 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:12.963203 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcdca9d-82c9-49e6-979f-4e949f8cd1d7 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:13.097273 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcdca9d-82c9-49e6-979f-4e949f8cd1d7 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:13.114371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:13.139439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4f38c-f5cd-4d3e-94bf-5859e27ef9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:13.140163 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4f38c-f5cd-4d3e-94bf-5859e27ef9cc None admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:13.140480 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4f38c-f5cd-4d3e-94bf-5859e27ef9cc None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:13.140787 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4f38c-f5cd-4d3e-94bf-5859e27ef9cc None admin] PATH_INFO: `/v3/projects/7baa36a3486b4ef1ab905d7e4381c15d/users/7874e31d490a4742a9345b9f7d076ad5/roles/f08394a5dbcf4506a17b78b4416f1680` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:13.143262 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4f38c-f5cd-4d3e-94bf-5859e27ef9cc None admin] RBAC: Authorizing `identity:create_grant(project_id=7baa36a3486b4ef1ab905d7e4381c15d, user_id=7874e31d490a4742a9345b9f7d076ad5, role_id=f08394a5dbcf4506a17b78b4416f1680)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:13.145394 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4f38c-f5cd-4d3e-94bf-5859e27ef9cc None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:13.163679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 571/1123] 10.222.0.94 () {58 vars in 1439 bytes} [Wed Aug 24 04:37:12 2022] PUT /identity/v3/projects/7baa36a3486b4ef1ab905d7e4381c15d/users/7874e31d490a4742a9345b9f7d076ad5/roles/f08394a5dbcf4506a17b78b4416f1680 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:37:15.546860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97c559-2bfe-42d8-9246-119b66bd1297 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:15.547590 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97c559-2bfe-42d8-9246-119b66bd1297 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:15.547590 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97c559-2bfe-42d8-9246-119b66bd1297 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:15.548977 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 553/1124] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:37:15 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:15.556070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2907a69-d59b-4f5c-a193-c9ad040e48b7 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:15.556687 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2907a69-d59b-4f5c-a193-c9ad040e48b7 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:15.556687 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2907a69-d59b-4f5c-a193-c9ad040e48b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:15.577977 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-a2907a69-d59b-4f5c-a193-c9ad040e48b7 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:15.579192 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-a2907a69-d59b-4f5c-a193-c9ad040e48b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:15.669616 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 572/1125] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:15.978872 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97c559-2bfe-42d8-9246-119b66bd1297 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:16.088957 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:16.128313 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97c559-2bfe-42d8-9246-119b66bd1297 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:16.178708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6cb6e-c679-4c2b-8c49-0f3eb893405b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:16.179496 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6cb6e-c679-4c2b-8c49-0f3eb893405b None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:16.179827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6cb6e-c679-4c2b-8c49-0f3eb893405b None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:16.180155 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6cb6e-c679-4c2b-8c49-0f3eb893405b None admin] PATH_INFO: `/v3/roles/f08394a5dbcf4506a17b78b4416f1680` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:16.181989 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6cb6e-c679-4c2b-8c49-0f3eb893405b None admin] RBAC: Authorizing `identity:get_role(role_id=f08394a5dbcf4506a17b78b4416f1680)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:16.183514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6cb6e-c679-4c2b-8c49-0f3eb893405b None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:16.185030 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 554/1126] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:37:15 2022] GET /identity/v3/roles/f08394a5dbcf4506a17b78b4416f1680 => generated 223 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:16.191967 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2907a69-d59b-4f5c-a193-c9ad040e48b7 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:16.329304 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2907a69-d59b-4f5c-a193-c9ad040e48b7 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:16.331060 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:16.371410 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6532e1a-3fe2-43c2-8c3b-559b8881f7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:16.372081 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6532e1a-3fe2-43c2-8c3b-559b8881f7a8 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:16.372364 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6532e1a-3fe2-43c2-8c3b-559b8881f7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:16.372693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6532e1a-3fe2-43c2-8c3b-559b8881f7a8 None admin] PATH_INFO: `/v3/users/7874e31d490a4742a9345b9f7d076ad5` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:16.374012 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6532e1a-3fe2-43c2-8c3b-559b8881f7a8 None admin] RBAC: Authorizing `identity:get_user(user_id=7874e31d490a4742a9345b9f7d076ad5)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:16.375580 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6532e1a-3fe2-43c2-8c3b-559b8881f7a8 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:16.377400 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 573/1127] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:37:16 2022] GET /identity/v3/users/7874e31d490a4742a9345b9f7d076ad5 => generated 286 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:16.386012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6cb6e-c679-4c2b-8c49-0f3eb893405b None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:16.518688 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6cb6e-c679-4c2b-8c49-0f3eb893405b None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:16.573644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b3333-d52e-41e4-b9a0-0fab7f2745dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:16.574928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b3333-d52e-41e4-b9a0-0fab7f2745dc None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:16.575100 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b3333-d52e-41e4-b9a0-0fab7f2745dc None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:16.575562 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b3333-d52e-41e4-b9a0-0fab7f2745dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:16.605179 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:16.723751 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b3333-d52e-41e4-b9a0-0fab7f2745dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:16.726607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b3333-d52e-41e4-b9a0-0fab7f2745dc None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:16.901114 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 555/1128] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:37:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:37:16.908695 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6532e1a-3fe2-43c2-8c3b-559b8881f7a8 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:17.061802 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6532e1a-3fe2-43c2-8c3b-559b8881f7a8 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:17.103037 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54273dc4-67ee-4503-a6f4-f7000490d57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:17.103698 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54273dc4-67ee-4503-a6f4-f7000490d57c None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:17.103976 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54273dc4-67ee-4503-a6f4-f7000490d57c None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:17.104251 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54273dc4-67ee-4503-a6f4-f7000490d57c None admin] PATH_INFO: `/v3/projects/7baa36a3486b4ef1ab905d7e4381c15d` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:17.105437 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54273dc4-67ee-4503-a6f4-f7000490d57c None admin] RBAC: Authorizing `identity:get_project(project_id=7baa36a3486b4ef1ab905d7e4381c15d)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:17.106872 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54273dc4-67ee-4503-a6f4-f7000490d57c None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:17.108531 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 574/1129] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:37:16 2022] GET /identity/v3/projects/7baa36a3486b4ef1ab905d7e4381c15d => generated 311 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:17.115759 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b3333-d52e-41e4-b9a0-0fab7f2745dc None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:17.164631 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:17.254607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b3333-d52e-41e4-b9a0-0fab7f2745dc None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:17.297433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61959b4f-8211-45f9-a4ac-97b6b90807b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:17.298300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61959b4f-8211-45f9-a4ac-97b6b90807b9 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:17.298784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61959b4f-8211-45f9-a4ac-97b6b90807b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:17.299269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61959b4f-8211-45f9-a4ac-97b6b90807b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:17.300484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61959b4f-8211-45f9-a4ac-97b6b90807b9 None admin] RBAC: Adding query filter params (role.id=f08394a5dbcf4506a17b78b4416f1680, scope.project.id=7baa36a3486b4ef1ab905d7e4381c15d, user.id=7874e31d490a4742a9345b9f7d076ad5) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:17.301568 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61959b4f-8211-45f9-a4ac-97b6b90807b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:17.304201 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61959b4f-8211-45f9-a4ac-97b6b90807b9 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:17.314931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 556/1130] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:37:17 2022] GET /identity/v3/role_assignments?user.id=7874e31d490a4742a9345b9f7d076ad5&scope.project.id=7baa36a3486b4ef1ab905d7e4381c15d&role.id=f08394a5dbcf4506a17b78b4416f1680 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:19.350938 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7472d7-34e6-4dd4-a0b4-ba08d169a2d9 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:19.351504 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7472d7-34e6-4dd4-a0b4-ba08d169a2d9 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:19.351504 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7472d7-34e6-4dd4-a0b4-ba08d169a2d9 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:19.352814 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 575/1131] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:19.358288 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc945aa4-c4da-42cc-a2d5-8aed82e05f99 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:19.358712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc945aa4-c4da-42cc-a2d5-8aed82e05f99 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:19.358834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc945aa4-c4da-42cc-a2d5-8aed82e05f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:19.376725 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-cc945aa4-c4da-42cc-a2d5-8aed82e05f99 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:19.377960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-cc945aa4-c4da-42cc-a2d5-8aed82e05f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:19.449761 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 557/1132] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:19.736955 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7472d7-34e6-4dd4-a0b4-ba08d169a2d9 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:19.793206 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:19.857850 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7472d7-34e6-4dd4-a0b4-ba08d169a2d9 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:19.892537 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7c63b-912f-4ba4-993a-4efb072811b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:19.893169 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7c63b-912f-4ba4-993a-4efb072811b7 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:19.893473 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7c63b-912f-4ba4-993a-4efb072811b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:19.893741 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7c63b-912f-4ba4-993a-4efb072811b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:19.895477 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7c63b-912f-4ba4-993a-4efb072811b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:19.896885 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7c63b-912f-4ba4-993a-4efb072811b7 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:19.898502 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 576/1133] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:19.904861 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc945aa4-c4da-42cc-a2d5-8aed82e05f99 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:19.940051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:20.009695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc945aa4-c4da-42cc-a2d5-8aed82e05f99 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:20.047217 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65138e-e9a3-4f31-8fb0-7a4d77a4629e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:20.047834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65138e-e9a3-4f31-8fb0-7a4d77a4629e None admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:20.048112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65138e-e9a3-4f31-8fb0-7a4d77a4629e None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:20.048390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65138e-e9a3-4f31-8fb0-7a4d77a4629e None admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:20.049055 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65138e-e9a3-4f31-8fb0-7a4d77a4629e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:20.050639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65138e-e9a3-4f31-8fb0-7a4d77a4629e None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:20.079934 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 558/1134] 10.222.0.94 () {60 vars in 1141 bytes} [Wed Aug 24 04:37:19 2022] POST /identity/v3/projects => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:37:22.089531 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d5604-4dde-4450-9ff1-8f70d1c63a2b None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:22.090096 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d5604-4dde-4450-9ff1-8f70d1c63a2b None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:22.090096 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d5604-4dde-4450-9ff1-8f70d1c63a2b None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:22.091435 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 577/1135] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:22.096941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a84fe4-6f1d-495d-bd6b-195a18018069 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:22.097455 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a84fe4-6f1d-495d-bd6b-195a18018069 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:22.097603 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a84fe4-6f1d-495d-bd6b-195a18018069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:22.115877 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-c0a84fe4-6f1d-495d-bd6b-195a18018069 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:22.117074 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-c0a84fe4-6f1d-495d-bd6b-195a18018069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:22.192257 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 559/1136] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:22.462507 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d5604-4dde-4450-9ff1-8f70d1c63a2b None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:22.571398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d5604-4dde-4450-9ff1-8f70d1c63a2b None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:22.579168 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:22.608308 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e690420-4f02-4064-a939-799f78515503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:22.608945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e690420-4f02-4064-a939-799f78515503 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:22.609219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e690420-4f02-4064-a939-799f78515503 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:22.609514 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e690420-4f02-4064-a939-799f78515503 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:22.610620 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e690420-4f02-4064-a939-799f78515503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:22.612030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e690420-4f02-4064-a939-799f78515503 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:22.614483 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 578/1137] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:22.622093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a84fe4-6f1d-495d-bd6b-195a18018069 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:22.642809 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:22.741690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a84fe4-6f1d-495d-bd6b-195a18018069 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:22.794594 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc1149-92b9-4015-855e-bee720d766b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:22.795302 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc1149-92b9-4015-855e-bee720d766b5 None admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:22.795634 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc1149-92b9-4015-855e-bee720d766b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:22.795912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc1149-92b9-4015-855e-bee720d766b5 None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:22.796600 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc1149-92b9-4015-855e-bee720d766b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:22.798240 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc1149-92b9-4015-855e-bee720d766b5 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:22.821295 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 560/1138] 10.222.0.94 () {60 vars in 1132 bytes} [Wed Aug 24 04:37:22 2022] POST /identity/v3/users => generated 286 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:37:24.930802 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47258776-5fc8-43cc-b255-ec2d095232a6 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:24.931394 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47258776-5fc8-43cc-b255-ec2d095232a6 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:24.931726 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47258776-5fc8-43cc-b255-ec2d095232a6 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:24.934277 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 579/1139] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:37:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:24.941810 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867e9ec-d8ff-4451-9ec3-68116f88ab84 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:24.942631 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867e9ec-d8ff-4451-9ec3-68116f88ab84 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:24.942631 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867e9ec-d8ff-4451-9ec3-68116f88ab84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:24.965421 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-5867e9ec-d8ff-4451-9ec3-68116f88ab84 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:24.966730 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-5867e9ec-d8ff-4451-9ec3-68116f88ab84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:25.076440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 561/1140] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:25.357978 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47258776-5fc8-43cc-b255-ec2d095232a6 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:25.505288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47258776-5fc8-43cc-b255-ec2d095232a6 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:25.551582 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064495b-392f-41eb-8e06-2042e35eaf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:25.552367 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064495b-392f-41eb-8e06-2042e35eaf51 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:25.552729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064495b-392f-41eb-8e06-2042e35eaf51 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:25.553093 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064495b-392f-41eb-8e06-2042e35eaf51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:25.566348 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3064495b-392f-41eb-8e06-2042e35eaf51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:37:25.575701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-3064495b-392f-41eb-8e06-2042e35eaf51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:25.575701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:25.575701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:25.575701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:25.575701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:25.575701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:25.575701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:25.575701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:25.575701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:25.575701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:25.575701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:25.575701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:25.575701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:37:25.575701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:37:25.575701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:37:25.575701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:37:25.577766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:37:25.577766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:37:25.577766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:37:25.577766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:37:25.577766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:25.577766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:25.577766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:25.577766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:25.577766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:25.577766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:25.577766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:25.577766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:25.577766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:25.577766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:25.577766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:25.577766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:25.579249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:25.579249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:25.579249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:25.579249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:25.579249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:37:25.579249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:37:25.579249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:37:25.579249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:37:25.579249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:37:25.579249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:37:25.579249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:25.579249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:37:25.579249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 580/1141] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:37:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:25.588749 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867e9ec-d8ff-4451-9ec3-68116f88ab84 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:25.594388 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:25.785584 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867e9ec-d8ff-4451-9ec3-68116f88ab84 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:25.832329 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589255b5-9a66-4011-9912-8e90bb7f109a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:25.832976 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589255b5-9a66-4011-9912-8e90bb7f109a None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:25.833255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589255b5-9a66-4011-9912-8e90bb7f109a None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:25.833559 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589255b5-9a66-4011-9912-8e90bb7f109a None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:25.834318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589255b5-9a66-4011-9912-8e90bb7f109a None admin] RBAC: Adding query filter params (name=admin) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:25.834713 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589255b5-9a66-4011-9912-8e90bb7f109a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:25.836377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589255b5-9a66-4011-9912-8e90bb7f109a None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:25.846660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 562/1142] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:37:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:25.854117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064495b-392f-41eb-8e06-2042e35eaf51 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:25.902363 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:25.981884 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064495b-392f-41eb-8e06-2042e35eaf51 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:26.022099 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cb0e9-cf29-49d4-9ff9-6097df528381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:26.022767 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cb0e9-cf29-49d4-9ff9-6097df528381 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:26.023049 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cb0e9-cf29-49d4-9ff9-6097df528381 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:26.023322 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cb0e9-cf29-49d4-9ff9-6097df528381 None admin] PATH_INFO: `/v3/users/86075393ecbe40d1a4dd79ed883fd51f` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:26.040631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cb0e9-cf29-49d4-9ff9-6097df528381 None admin] RBAC: Authorizing `identity:get_user(user_id=86075393ecbe40d1a4dd79ed883fd51f)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:26.042293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cb0e9-cf29-49d4-9ff9-6097df528381 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:26.044231 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 581/1143] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:37:25 2022] GET /identity/v3/users/86075393ecbe40d1a4dd79ed883fd51f => generated 286 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:26.051389 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589255b5-9a66-4011-9912-8e90bb7f109a None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:26.187259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:26.266380 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589255b5-9a66-4011-9912-8e90bb7f109a None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:26.311920 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817cf30-2b33-4233-a8a9-6cd01c94f79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:26.312532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817cf30-2b33-4233-a8a9-6cd01c94f79a None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:26.312809 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817cf30-2b33-4233-a8a9-6cd01c94f79a None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:26.313152 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817cf30-2b33-4233-a8a9-6cd01c94f79a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:26.402038 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817cf30-2b33-4233-a8a9-6cd01c94f79a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:26.403679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817cf30-2b33-4233-a8a9-6cd01c94f79a None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:26.489474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:26.536201 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 563/1144] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:37:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:37:26.546672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cb0e9-cf29-49d4-9ff9-6097df528381 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:26.717830 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:26.734983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cb0e9-cf29-49d4-9ff9-6097df528381 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:26.782413 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef25e5a-6162-40e5-8584-706bd2d73742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:26.783124 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef25e5a-6162-40e5-8584-706bd2d73742 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:26.783451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef25e5a-6162-40e5-8584-706bd2d73742 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:26.783791 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef25e5a-6162-40e5-8584-706bd2d73742 None admin] PATH_INFO: `/v3/projects/6d8d3df6422247528c41e7866bda1a6e` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:26.785884 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef25e5a-6162-40e5-8584-706bd2d73742 None admin] RBAC: Authorizing `identity:get_project(project_id=6d8d3df6422247528c41e7866bda1a6e)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:26.787515 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef25e5a-6162-40e5-8584-706bd2d73742 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:26.789277 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 582/1145] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:37:26 2022] GET /identity/v3/projects/6d8d3df6422247528c41e7866bda1a6e => generated 311 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:26.795906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817cf30-2b33-4233-a8a9-6cd01c94f79a None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:26.919552 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817cf30-2b33-4233-a8a9-6cd01c94f79a None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:26.963767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee866b-96e0-46ed-9f3a-12117bf8fc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:26.964445 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee866b-96e0-46ed-9f3a-12117bf8fc85 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:26.964770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee866b-96e0-46ed-9f3a-12117bf8fc85 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:26.965090 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee866b-96e0-46ed-9f3a-12117bf8fc85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:26.965933 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee866b-96e0-46ed-9f3a-12117bf8fc85 None admin] RBAC: Adding query filter params (role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2, scope.project.id=6d8d3df6422247528c41e7866bda1a6e, user.id=86075393ecbe40d1a4dd79ed883fd51f) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:26.966297 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee866b-96e0-46ed-9f3a-12117bf8fc85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:26.967869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee866b-96e0-46ed-9f3a-12117bf8fc85 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:26.975373 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 564/1146] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:37:26 2022] GET /identity/v3/role_assignments?user.id=86075393ecbe40d1a4dd79ed883fd51f&scope.project.id=6d8d3df6422247528c41e7866bda1a6e&role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:29.150109 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c9909-3b61-405f-96a2-861d6f2bd6a1 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:29.150693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c9909-3b61-405f-96a2-861d6f2bd6a1 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:29.150841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c9909-3b61-405f-96a2-861d6f2bd6a1 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:29.152798 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 583/1147] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:37:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:29.161575 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee7340-cd9b-4009-9137-fdd5411038d7 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:29.162148 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee7340-cd9b-4009-9137-fdd5411038d7 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:29.162148 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee7340-cd9b-4009-9137-fdd5411038d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:29.188127 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-eeee7340-cd9b-4009-9137-fdd5411038d7 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:29.189455 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-eeee7340-cd9b-4009-9137-fdd5411038d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:29.218338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:29.269581 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 565/1148] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:37:29.550585 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c9909-3b61-405f-96a2-861d6f2bd6a1 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:29.657225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c9909-3b61-405f-96a2-861d6f2bd6a1 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:29.694479 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a7a33-d4b2-49de-a1fd-a1164c4ff1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:29.695137 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a7a33-d4b2-49de-a1fd-a1164c4ff1c0 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:29.695414 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a7a33-d4b2-49de-a1fd-a1164c4ff1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:29.695685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a7a33-d4b2-49de-a1fd-a1164c4ff1c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:29.708466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a7a33-d4b2-49de-a1fd-a1164c4ff1c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:37:29.713378 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-650a7a33-d4b2-49de-a1fd-a1164c4ff1c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:29.713378 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:29.713378 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:29.713378 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:29.713378 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:29.713378 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:29.713378 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:29.713378 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:29.713378 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:29.713378 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:29.713378 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:29.713378 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:29.713378 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:37:29.713378 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:37:29.713378 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:37:29.713378 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:37:29.715233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:37:29.715233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:37:29.715233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:37:29.715233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:37:29.715233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:29.715233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:29.715233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:29.715233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:29.715233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:29.715233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:29.715233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:29.715233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:29.715233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:29.715233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:29.715233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:29.715233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:29.716735 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:29.716735 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:29.716735 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:29.716735 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:29.716735 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:37:29.716735 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:37:29.716735 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:37:29.716735 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:37:29.716735 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:37:29.716735 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:37:29.716735 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:29.716735 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:37:29.716735 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 584/1149] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:37:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:29.721105 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee7340-cd9b-4009-9137-fdd5411038d7 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:29.837325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee7340-cd9b-4009-9137-fdd5411038d7 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:29.876549 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12576f5-9742-4c2f-9d05-3389b6dfcc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:29.877178 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12576f5-9742-4c2f-9d05-3389b6dfcc21 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:29.877485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12576f5-9742-4c2f-9d05-3389b6dfcc21 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:29.878291 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12576f5-9742-4c2f-9d05-3389b6dfcc21 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:29.878995 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12576f5-9742-4c2f-9d05-3389b6dfcc21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:29.879313 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12576f5-9742-4c2f-9d05-3389b6dfcc21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:29.880817 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12576f5-9742-4c2f-9d05-3389b6dfcc21 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:29.890299 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 566/1150] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:37:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:29.897392 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a7a33-d4b2-49de-a1fd-a1164c4ff1c0 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:29.923283 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:30.012992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a7a33-d4b2-49de-a1fd-a1164c4ff1c0 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:30.060760 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fff1eb-f169-4949-b17d-584078b640f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:30.061883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fff1eb-f169-4949-b17d-584078b640f4 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:30.062393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fff1eb-f169-4949-b17d-584078b640f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:30.062894 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fff1eb-f169-4949-b17d-584078b640f4 None admin] PATH_INFO: `/v3/users/86075393ecbe40d1a4dd79ed883fd51f` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:30.064883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fff1eb-f169-4949-b17d-584078b640f4 None admin] RBAC: Authorizing `identity:get_user(user_id=86075393ecbe40d1a4dd79ed883fd51f)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:30.067834 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fff1eb-f169-4949-b17d-584078b640f4 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:30.070830 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 585/1151] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:37:29 2022] GET /identity/v3/users/86075393ecbe40d1a4dd79ed883fd51f => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:30.079411 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12576f5-9742-4c2f-9d05-3389b6dfcc21 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:30.116674 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:30.214331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12576f5-9742-4c2f-9d05-3389b6dfcc21 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:30.256193 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe14d3-f096-4151-90ed-dd974c5d0c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:30.256845 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe14d3-f096-4151-90ed-dd974c5d0c86 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:30.257126 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe14d3-f096-4151-90ed-dd974c5d0c86 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:30.257459 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe14d3-f096-4151-90ed-dd974c5d0c86 None admin] PATH_INFO: `/v3/projects/6d8d3df6422247528c41e7866bda1a6e` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:30.258654 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe14d3-f096-4151-90ed-dd974c5d0c86 None admin] RBAC: Authorizing `identity:get_project(project_id=6d8d3df6422247528c41e7866bda1a6e)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:30.260171 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe14d3-f096-4151-90ed-dd974c5d0c86 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:30.262320 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 567/1152] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:37:30 2022] GET /identity/v3/projects/6d8d3df6422247528c41e7866bda1a6e => generated 311 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:30.272362 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fff1eb-f169-4949-b17d-584078b640f4 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:30.376013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:30.391708 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fff1eb-f169-4949-b17d-584078b640f4 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:30.429959 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777345a-ea85-49f8-b8f9-836ec5f2172b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:30.430628 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777345a-ea85-49f8-b8f9-836ec5f2172b None admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:30.430919 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777345a-ea85-49f8-b8f9-836ec5f2172b None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:30.431174 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777345a-ea85-49f8-b8f9-836ec5f2172b None admin] PATH_INFO: `/v3/projects/6d8d3df6422247528c41e7866bda1a6e/users/86075393ecbe40d1a4dd79ed883fd51f/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:30.433069 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777345a-ea85-49f8-b8f9-836ec5f2172b None admin] RBAC: Authorizing `identity:create_grant(project_id=6d8d3df6422247528c41e7866bda1a6e, user_id=86075393ecbe40d1a4dd79ed883fd51f, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:30.434519 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777345a-ea85-49f8-b8f9-836ec5f2172b None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:30.448862 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 586/1153] 10.222.0.94 () {58 vars in 1439 bytes} [Wed Aug 24 04:37:30 2022] PUT /identity/v3/projects/6d8d3df6422247528c41e7866bda1a6e/users/86075393ecbe40d1a4dd79ed883fd51f/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:37:32.519514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3eb12a-4885-4ee3-8250-05aff1166f47 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:32.520070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3eb12a-4885-4ee3-8250-05aff1166f47 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:32.520070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3eb12a-4885-4ee3-8250-05aff1166f47 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:32.521388 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 568/1154] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:32.527527 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bbdfb-16dc-4ac0-9d50-a212961f48d0 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:32.528070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bbdfb-16dc-4ac0-9d50-a212961f48d0 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:32.528070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bbdfb-16dc-4ac0-9d50-a212961f48d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:32.547691 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-4f4bbdfb-16dc-4ac0-9d50-a212961f48d0 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:32.548984 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-4f4bbdfb-16dc-4ac0-9d50-a212961f48d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:32.620437 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 587/1155] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:32.896240 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3eb12a-4885-4ee3-8250-05aff1166f47 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:33.011309 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:33.025457 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3eb12a-4885-4ee3-8250-05aff1166f47 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:33.064527 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c0e65-1d88-4292-9624-822fc6abd296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:33.066037 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c0e65-1d88-4292-9624-822fc6abd296 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:33.066446 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c0e65-1d88-4292-9624-822fc6abd296 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:33.066709 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c0e65-1d88-4292-9624-822fc6abd296 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:33.079976 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c0e65-1d88-4292-9624-822fc6abd296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:37:33.085604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-eb0c0e65-1d88-4292-9624-822fc6abd296 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:33.085604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:33.085604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:33.085604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:33.085604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:33.085604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:33.085604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:33.085604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:33.085604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:33.085604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:33.085604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:33.085604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:33.085604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:37:33.085604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:37:33.085604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:37:33.085604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:37:33.087580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:37:33.087580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:37:33.087580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:37:33.087580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:37:33.087580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:33.087580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:33.087580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:33.087580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:33.087580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:33.087580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:33.087580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:33.087580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:33.087580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:33.087580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:33.087580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:33.087580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:33.089397 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:33.089397 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:33.089397 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:33.089397 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:33.089397 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:37:33.089397 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:37:33.089397 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:37:33.089397 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:37:33.089397 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:37:33.089397 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:37:33.089397 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:33.089397 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:37:33.089397 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 569/1156] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:37:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:33.097632 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bbdfb-16dc-4ac0-9d50-a212961f48d0 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:33.211481 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:33.250350 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bbdfb-16dc-4ac0-9d50-a212961f48d0 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:33.287232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea5c1d-99d3-44b6-acdd-f2027fc61951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:33.287850 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea5c1d-99d3-44b6-acdd-f2027fc61951 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:33.288130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea5c1d-99d3-44b6-acdd-f2027fc61951 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:33.288399 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea5c1d-99d3-44b6-acdd-f2027fc61951 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:33.289071 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea5c1d-99d3-44b6-acdd-f2027fc61951 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:33.289380 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea5c1d-99d3-44b6-acdd-f2027fc61951 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:33.290788 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea5c1d-99d3-44b6-acdd-f2027fc61951 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:33.300872 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 588/1157] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:37:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:33.312453 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c0e65-1d88-4292-9624-822fc6abd296 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:33.444266 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c0e65-1d88-4292-9624-822fc6abd296 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:33.493361 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952f816-4af5-4301-b68f-77e449bd7db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:33.494438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952f816-4af5-4301-b68f-77e449bd7db6 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:33.494942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952f816-4af5-4301-b68f-77e449bd7db6 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:33.495438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952f816-4af5-4301-b68f-77e449bd7db6 None admin] PATH_INFO: `/v3/users/86075393ecbe40d1a4dd79ed883fd51f` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:33.497795 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952f816-4af5-4301-b68f-77e449bd7db6 None admin] RBAC: Authorizing `identity:get_user(user_id=86075393ecbe40d1a4dd79ed883fd51f)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:33.500697 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952f816-4af5-4301-b68f-77e449bd7db6 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:33.505243 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 570/1158] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:37:33 2022] GET /identity/v3/users/86075393ecbe40d1a4dd79ed883fd51f => generated 286 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:33.511867 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea5c1d-99d3-44b6-acdd-f2027fc61951 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:33.644278 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea5c1d-99d3-44b6-acdd-f2027fc61951 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:33.681935 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60c3e9-d05a-490f-8dd3-093d0112dad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:33.682561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60c3e9-d05a-490f-8dd3-093d0112dad0 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:33.682840 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60c3e9-d05a-490f-8dd3-093d0112dad0 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:33.683115 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60c3e9-d05a-490f-8dd3-093d0112dad0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:33.694768 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:33.756432 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60c3e9-d05a-490f-8dd3-093d0112dad0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:33.757824 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60c3e9-d05a-490f-8dd3-093d0112dad0 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:33.867363 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 589/1159] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:37:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:37:33.874055 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952f816-4af5-4301-b68f-77e449bd7db6 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:33.899677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:33.990782 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952f816-4af5-4301-b68f-77e449bd7db6 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:34.027670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77938f-0c3b-4b7c-97c2-98ec126219be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:34.028302 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77938f-0c3b-4b7c-97c2-98ec126219be None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:34.028584 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77938f-0c3b-4b7c-97c2-98ec126219be None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:34.028857 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77938f-0c3b-4b7c-97c2-98ec126219be None admin] PATH_INFO: `/v3/projects/6d8d3df6422247528c41e7866bda1a6e` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:34.030007 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77938f-0c3b-4b7c-97c2-98ec126219be None admin] RBAC: Authorizing `identity:get_project(project_id=6d8d3df6422247528c41e7866bda1a6e)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:34.031441 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77938f-0c3b-4b7c-97c2-98ec126219be None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:34.033090 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 571/1160] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:37:33 2022] GET /identity/v3/projects/6d8d3df6422247528c41e7866bda1a6e => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:34.040472 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60c3e9-d05a-490f-8dd3-093d0112dad0 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:34.087956 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:34.162860 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60c3e9-d05a-490f-8dd3-093d0112dad0 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:34.200474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597dca6c-0ef8-4f34-8930-24b5b5d257fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:34.201087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dca6c-0ef8-4f34-8930-24b5b5d257fa None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:34.201365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dca6c-0ef8-4f34-8930-24b5b5d257fa None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:34.201670 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dca6c-0ef8-4f34-8930-24b5b5d257fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:34.202409 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597dca6c-0ef8-4f34-8930-24b5b5d257fa None admin] RBAC: Adding query filter params (role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2, scope.project.id=6d8d3df6422247528c41e7866bda1a6e, user.id=86075393ecbe40d1a4dd79ed883fd51f) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:34.202717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597dca6c-0ef8-4f34-8930-24b5b5d257fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:34.204142 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597dca6c-0ef8-4f34-8930-24b5b5d257fa None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:34.211382 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 590/1161] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:37:34 2022] GET /identity/v3/role_assignments?user.id=86075393ecbe40d1a4dd79ed883fd51f&scope.project.id=6d8d3df6422247528c41e7866bda1a6e&role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:36.334936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417443ab-37d9-42cc-a13a-67c48b6f9677 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:36.335474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417443ab-37d9-42cc-a13a-67c48b6f9677 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:36.335474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417443ab-37d9-42cc-a13a-67c48b6f9677 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:36.336789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 572/1162] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:36.342233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d100968-2b6e-4b7c-a211-cca36b654243 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:36.342671 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d100968-2b6e-4b7c-a211-cca36b654243 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:36.342797 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d100968-2b6e-4b7c-a211-cca36b654243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:36.361283 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-1d100968-2b6e-4b7c-a211-cca36b654243 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:36.362817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-1d100968-2b6e-4b7c-a211-cca36b654243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:36.439365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 591/1163] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:36.712317 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417443ab-37d9-42cc-a13a-67c48b6f9677 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:36.811064 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:36.829904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417443ab-37d9-42cc-a13a-67c48b6f9677 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:36.867793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2edb1b-afc0-492a-b778-a2111cb2d001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:36.868408 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2edb1b-afc0-492a-b778-a2111cb2d001 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:36.868714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2edb1b-afc0-492a-b778-a2111cb2d001 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:36.868986 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2edb1b-afc0-492a-b778-a2111cb2d001 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:36.954311 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2edb1b-afc0-492a-b778-a2111cb2d001 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:36.956189 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2edb1b-afc0-492a-b778-a2111cb2d001 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:37.051249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:37.069215 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 573/1164] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:37:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:37:37.079270 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d100968-2b6e-4b7c-a211-cca36b654243 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:37.117007 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:37.188626 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d100968-2b6e-4b7c-a211-cca36b654243 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:37.230337 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d188c-586e-43b2-97ca-7e0c0c7da28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:37.230916 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d188c-586e-43b2-97ca-7e0c0c7da28d None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:37.231188 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d188c-586e-43b2-97ca-7e0c0c7da28d None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:37.231455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d188c-586e-43b2-97ca-7e0c0c7da28d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:37.239282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d188c-586e-43b2-97ca-7e0c0c7da28d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:37.240704 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d188c-586e-43b2-97ca-7e0c0c7da28d None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:37.252631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-2c1d188c-586e-43b2-97ca-7e0c0c7da28d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 04:37:37.252631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:37.252631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 04:37:37.252631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 04:37:37.252631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:37:37.252631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:37:37.252631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:37:37.252631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:37:37.252631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 04:37:37.252631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:37:37.252631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:37.252631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:37:37.252631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:37.252631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:37.252631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:37.252631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:37.252631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:37.258017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:37.258017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:37.258017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:37.258017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:37.258017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:37.258017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:37.258017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:37.258017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:37.258017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:37.258017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:37.258017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:37.258017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:37.258017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:37.258017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:37.258017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:37.258017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:37.260200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:37.260200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:37.260200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:37.260200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:37.260200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:37.260200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:37.260200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:37.260200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:37.260200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:37.260200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:37.260200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 04:37:37.260200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:37.260200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 04:37:37.260200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:37:37.260200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 592/1165] 10.222.0.94 () {56 vars in 1117 bytes} [Wed Aug 24 04:37:37 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:37.262124 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2edb1b-afc0-492a-b778-a2111cb2d001 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:37.423026 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2edb1b-afc0-492a-b778-a2111cb2d001 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:37.460230 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe47be-e03d-4db1-bbe1-c907eb0fe74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:37.460855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe47be-e03d-4db1-bbe1-c907eb0fe74c None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:37.461132 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe47be-e03d-4db1-bbe1-c907eb0fe74c None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:37.461435 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe47be-e03d-4db1-bbe1-c907eb0fe74c None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:37.462169 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe47be-e03d-4db1-bbe1-c907eb0fe74c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:37.462468 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe47be-e03d-4db1-bbe1-c907eb0fe74c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:37.463918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe47be-e03d-4db1-bbe1-c907eb0fe74c None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:37.472944 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 574/1166] 10.222.0.94 () {56 vars in 1115 bytes} [Wed Aug 24 04:37:37 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:39.447859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e7957-02e1-483f-9c57-a69c3cf3fa3f None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:39.448469 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e7957-02e1-483f-9c57-a69c3cf3fa3f None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:39.448469 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e7957-02e1-483f-9c57-a69c3cf3fa3f None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:39.450513 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 593/1167] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:37:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:39.461878 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06359d49-0dfd-423d-8934-cb3afb0d0642 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:39.462548 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06359d49-0dfd-423d-8934-cb3afb0d0642 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:39.462548 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06359d49-0dfd-423d-8934-cb3afb0d0642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:39.488001 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-06359d49-0dfd-423d-8934-cb3afb0d0642 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:39.489277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-06359d49-0dfd-423d-8934-cb3afb0d0642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:39.554676 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:39.582921 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 575/1168] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:39.863876 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e7957-02e1-483f-9c57-a69c3cf3fa3f None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:39.997670 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:40.011498 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e7957-02e1-483f-9c57-a69c3cf3fa3f None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:40.067427 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b52b7-e195-438d-9750-17a4dc569e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:40.068479 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b52b7-e195-438d-9750-17a4dc569e64 None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:40.069128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b52b7-e195-438d-9750-17a4dc569e64 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:40.069663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b52b7-e195-438d-9750-17a4dc569e64 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:40.070857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b52b7-e195-438d-9750-17a4dc569e64 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:40.073553 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b52b7-e195-438d-9750-17a4dc569e64 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:40.093320 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 594/1169] 10.222.0.94 () {60 vars in 1138 bytes} [Wed Aug 24 04:37:39 2022] POST /identity/v3/domains => generated 267 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:37:42.098081 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7706049-7b61-48d8-8d0c-e8573a843606 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:42.098659 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7706049-7b61-48d8-8d0c-e8573a843606 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:42.098659 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7706049-7b61-48d8-8d0c-e8573a843606 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:42.099973 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 576/1170] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:42.105453 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f9b37-a89a-49fd-b023-8108ace1857b None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:42.105918 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f9b37-a89a-49fd-b023-8108ace1857b None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:42.106033 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f9b37-a89a-49fd-b023-8108ace1857b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:42.123807 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-4c8f9b37-a89a-49fd-b023-8108ace1857b None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:42.124986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-4c8f9b37-a89a-49fd-b023-8108ace1857b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:42.193390 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 595/1171] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:42.466243 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7706049-7b61-48d8-8d0c-e8573a843606 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:42.569934 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7706049-7b61-48d8-8d0c-e8573a843606 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:42.606321 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b21738-7164-4357-9d5c-e531d49ec6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:42.606951 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b21738-7164-4357-9d5c-e531d49ec6ed None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:42.607226 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b21738-7164-4357-9d5c-e531d49ec6ed None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:42.607491 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b21738-7164-4357-9d5c-e531d49ec6ed None admin] PATH_INFO: `/v3/domains/0f4a59415f49465d964f4f9c13fd0459` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:42.620201 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b21738-7164-4357-9d5c-e531d49ec6ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=0f4a59415f49465d964f4f9c13fd0459)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:42.621768 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b21738-7164-4357-9d5c-e531d49ec6ed None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:42.623535 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 577/1172] 10.222.0.94 () {56 vars in 1183 bytes} [Wed Aug 24 04:37:42 2022] GET /identity/v3/domains/0f4a59415f49465d964f4f9c13fd0459 => generated 267 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:42.630336 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f9b37-a89a-49fd-b023-8108ace1857b None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:42.729169 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:42.750505 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f9b37-a89a-49fd-b023-8108ace1857b None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:42.789662 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db172d-6e2c-4cb5-b049-22f9ae661142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:42.790299 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db172d-6e2c-4cb5-b049-22f9ae661142 None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:42.790582 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db172d-6e2c-4cb5-b049-22f9ae661142 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:42.790854 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db172d-6e2c-4cb5-b049-22f9ae661142 None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:42.791523 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db172d-6e2c-4cb5-b049-22f9ae661142 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:42.793011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db172d-6e2c-4cb5-b049-22f9ae661142 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:42.823356 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 596/1173] 10.222.0.94 () {60 vars in 1141 bytes} [Wed Aug 24 04:37:42 2022] POST /identity/v3/projects => generated 361 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:37:44.862260 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03988d-cd31-4f55-94e3-b0cbd026de50 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:44.862892 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03988d-cd31-4f55-94e3-b0cbd026de50 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:44.862892 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03988d-cd31-4f55-94e3-b0cbd026de50 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:44.864259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 578/1174] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:44.872920 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67649d-75da-43c9-9250-6826ce0d2a3b None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:44.873681 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67649d-75da-43c9-9250-6826ce0d2a3b None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:44.873915 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67649d-75da-43c9-9250-6826ce0d2a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:44.895577 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-ca67649d-75da-43c9-9250-6826ce0d2a3b None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:44.896877 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ca67649d-75da-43c9-9250-6826ce0d2a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:45.009488 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 597/1175] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:45.313076 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03988d-cd31-4f55-94e3-b0cbd026de50 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:45.389993 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:45.477048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03988d-cd31-4f55-94e3-b0cbd026de50 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:45.531858 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55708141-386f-45ac-a22f-c904902a2ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:45.533325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55708141-386f-45ac-a22f-c904902a2ff2 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:45.533812 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55708141-386f-45ac-a22f-c904902a2ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:45.534088 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55708141-386f-45ac-a22f-c904902a2ff2 None admin] PATH_INFO: `/v3/domains/0f4a59415f49465d964f4f9c13fd0459` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:45.535830 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55708141-386f-45ac-a22f-c904902a2ff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0f4a59415f49465d964f4f9c13fd0459)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:45.537788 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55708141-386f-45ac-a22f-c904902a2ff2 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:45.540527 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 579/1176] 10.222.0.94 () {56 vars in 1183 bytes} [Wed Aug 24 04:37:45 2022] GET /identity/v3/domains/0f4a59415f49465d964f4f9c13fd0459 => generated 267 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:45.550395 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67649d-75da-43c9-9250-6826ce0d2a3b None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:45.657767 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:45.705994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67649d-75da-43c9-9250-6826ce0d2a3b None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:45.747434 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec9d5d-38b5-411c-8061-f962fed0e304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:45.748080 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec9d5d-38b5-411c-8061-f962fed0e304 None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:45.748359 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec9d5d-38b5-411c-8061-f962fed0e304 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:45.748635 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec9d5d-38b5-411c-8061-f962fed0e304 None admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:45.749366 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec9d5d-38b5-411c-8061-f962fed0e304 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:45.751070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec9d5d-38b5-411c-8061-f962fed0e304 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:45.780216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 598/1177] 10.222.0.94 () {60 vars in 1132 bytes} [Wed Aug 24 04:37:45 2022] POST /identity/v3/users => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:37:47.856865 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1e508-56bb-4ea4-879d-455f27df60d9 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:47.857476 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1e508-56bb-4ea4-879d-455f27df60d9 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:47.857662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1e508-56bb-4ea4-879d-455f27df60d9 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:47.860369 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 580/1178] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:37:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:47.868176 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9367763-c4b1-45ed-ba3c-734139485d88 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:47.868753 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9367763-c4b1-45ed-ba3c-734139485d88 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:47.869181 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9367763-c4b1-45ed-ba3c-734139485d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:47.901623 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-d9367763-c4b1-45ed-ba3c-734139485d88 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:47.903636 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-d9367763-c4b1-45ed-ba3c-734139485d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:48.010547 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 599/1179] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:48.331647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1e508-56bb-4ea4-879d-455f27df60d9 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:48.448576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1e508-56bb-4ea4-879d-455f27df60d9 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:48.461659 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:48.497234 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74238ded-48fd-4f4d-81e2-92205af9c4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:48.497923 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74238ded-48fd-4f4d-81e2-92205af9c4ca None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:48.498202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74238ded-48fd-4f4d-81e2-92205af9c4ca None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:48.498466 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74238ded-48fd-4f4d-81e2-92205af9c4ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:48.512769 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74238ded-48fd-4f4d-81e2-92205af9c4ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:37:48.517970 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-74238ded-48fd-4f4d-81e2-92205af9c4ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:48.517970 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:48.517970 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:48.517970 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:48.517970 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:48.517970 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:48.517970 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:48.517970 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:48.517970 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:48.517970 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:48.517970 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:48.517970 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:48.517970 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:37:48.517970 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:37:48.517970 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:37:48.517970 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:37:48.520109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:37:48.520109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:37:48.520109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:37:48.520109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:37:48.520109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:48.520109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:48.520109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:48.520109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:48.520109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:48.520109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:48.520109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:48.520109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:48.520109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:48.520109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:48.520109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:48.520109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:48.522151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:48.522151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:48.522151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:48.522151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:48.522151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:37:48.522151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:37:48.522151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:37:48.522151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:37:48.522151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:37:48.522151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:37:48.522151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:48.522151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:37:48.522151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 581/1180] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:37:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:48.527867 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9367763-c4b1-45ed-ba3c-734139485d88 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:48.594347 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:48.665121 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9367763-c4b1-45ed-ba3c-734139485d88 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:48.708938 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf03729-9dab-409b-b1fb-2a6420968381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:48.709630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf03729-9dab-409b-b1fb-2a6420968381 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:48.709993 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf03729-9dab-409b-b1fb-2a6420968381 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:48.710267 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf03729-9dab-409b-b1fb-2a6420968381 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:48.710946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf03729-9dab-409b-b1fb-2a6420968381 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:48.711247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf03729-9dab-409b-b1fb-2a6420968381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:48.712624 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf03729-9dab-409b-b1fb-2a6420968381 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:48.722626 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 600/1181] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:37:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:48.729448 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74238ded-48fd-4f4d-81e2-92205af9c4ca None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:48.893614 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74238ded-48fd-4f4d-81e2-92205af9c4ca None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:48.933770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988b189-173a-407b-acaa-6dba1a165058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:48.934413 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988b189-173a-407b-acaa-6dba1a165058 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:48.934687 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988b189-173a-407b-acaa-6dba1a165058 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:48.934953 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988b189-173a-407b-acaa-6dba1a165058 None admin] PATH_INFO: `/v3/users/ca34522204064603af5acade76bf565d` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:48.952092 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988b189-173a-407b-acaa-6dba1a165058 None admin] RBAC: Authorizing `identity:get_user(user_id=ca34522204064603af5acade76bf565d)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:48.953685 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988b189-173a-407b-acaa-6dba1a165058 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:48.956309 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 582/1182] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:37:48 2022] GET /identity/v3/users/ca34522204064603af5acade76bf565d => generated 311 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:48.963483 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf03729-9dab-409b-b1fb-2a6420968381 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:49.086417 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf03729-9dab-409b-b1fb-2a6420968381 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:49.101846 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:49.125155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a349e5-22af-40e7-b159-bb3b296ffd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:49.125972 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a349e5-22af-40e7-b159-bb3b296ffd84 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:49.126856 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a349e5-22af-40e7-b159-bb3b296ffd84 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:49.127205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a349e5-22af-40e7-b159-bb3b296ffd84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:49.227617 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a349e5-22af-40e7-b159-bb3b296ffd84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:49.229160 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a349e5-22af-40e7-b159-bb3b296ffd84 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:49.339852 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 601/1183] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:37:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:37:49.346251 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988b189-173a-407b-acaa-6dba1a165058 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:49.377550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:49.457835 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988b189-173a-407b-acaa-6dba1a165058 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:49.503247 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f898c-610b-4e05-ba0e-2f8aaa6674f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:49.503796 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f898c-610b-4e05-ba0e-2f8aaa6674f8 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:49.504073 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f898c-610b-4e05-ba0e-2f8aaa6674f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:49.504341 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f898c-610b-4e05-ba0e-2f8aaa6674f8 None admin] PATH_INFO: `/v3/projects/15b801ac7eac44ac8bac7fb9d49938e6` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:49.505541 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f898c-610b-4e05-ba0e-2f8aaa6674f8 None admin] RBAC: Authorizing `identity:get_project(project_id=15b801ac7eac44ac8bac7fb9d49938e6)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:49.506982 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f898c-610b-4e05-ba0e-2f8aaa6674f8 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:49.508634 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 583/1184] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:37:49 2022] GET /identity/v3/projects/15b801ac7eac44ac8bac7fb9d49938e6 => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:49.516082 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a349e5-22af-40e7-b159-bb3b296ffd84 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:49.535188 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:49.633168 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a349e5-22af-40e7-b159-bb3b296ffd84 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:49.668573 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c173cb-8162-494b-8243-82668fd7c24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:49.669179 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c173cb-8162-494b-8243-82668fd7c24b None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:49.669480 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c173cb-8162-494b-8243-82668fd7c24b None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:49.669764 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c173cb-8162-494b-8243-82668fd7c24b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:49.670495 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c173cb-8162-494b-8243-82668fd7c24b None admin] RBAC: Adding query filter params (role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2, scope.project.id=15b801ac7eac44ac8bac7fb9d49938e6, user.id=ca34522204064603af5acade76bf565d) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:49.670800 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c173cb-8162-494b-8243-82668fd7c24b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:49.672215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c173cb-8162-494b-8243-82668fd7c24b None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:49.678501 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 602/1185] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:37:49 2022] GET /identity/v3/role_assignments?user.id=ca34522204064603af5acade76bf565d&scope.project.id=15b801ac7eac44ac8bac7fb9d49938e6&role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:51.649306 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50bec2-2213-4812-93fe-eab7020fdf1b None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:51.650237 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50bec2-2213-4812-93fe-eab7020fdf1b None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:51.650237 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50bec2-2213-4812-93fe-eab7020fdf1b None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:51.651540 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 584/1186] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:37:51.658130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610e960-0c02-4383-a626-9d19c13f1c6d None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:51.658700 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610e960-0c02-4383-a626-9d19c13f1c6d None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:51.658700 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610e960-0c02-4383-a626-9d19c13f1c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:51.678330 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-c610e960-0c02-4383-a626-9d19c13f1c6d None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:51.679582 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-c610e960-0c02-4383-a626-9d19c13f1c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:51.772775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 603/1187] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:52.048285 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50bec2-2213-4812-93fe-eab7020fdf1b None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:52.177493 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:52.186976 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50bec2-2213-4812-93fe-eab7020fdf1b None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:52.236546 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f97675-bf3d-47ab-9710-72f18ee305e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:52.237310 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f97675-bf3d-47ab-9710-72f18ee305e9 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:52.237721 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f97675-bf3d-47ab-9710-72f18ee305e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:52.238089 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f97675-bf3d-47ab-9710-72f18ee305e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:52.252612 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f97675-bf3d-47ab-9710-72f18ee305e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:37:52.259436 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-18f97675-bf3d-47ab-9710-72f18ee305e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:52.259436 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:52.259436 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:52.259436 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:52.259436 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:52.259436 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:52.259436 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:52.259436 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:52.259436 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:52.259436 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:52.259436 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:52.259436 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:52.259436 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:37:52.259436 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:37:52.259436 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:37:52.259436 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:37:52.260880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:37:52.260880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:37:52.260880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:37:52.260880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:37:52.260880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:52.260880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:52.260880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:52.260880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:52.260880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:52.260880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:52.260880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:52.260880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:52.260880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:52.260880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:52.260880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:52.260880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:52.262301 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:52.262301 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:52.262301 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:52.262301 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:52.262301 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:37:52.262301 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:37:52.262301 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:37:52.262301 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:37:52.262301 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:37:52.262301 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:37:52.262301 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:52.262301 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:37:52.262301 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 585/1188] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:37:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:52.269336 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610e960-0c02-4383-a626-9d19c13f1c6d None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:52.281054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:52.396432 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610e960-0c02-4383-a626-9d19c13f1c6d None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:52.438888 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56e785-bbcf-4645-b598-a9951cf64141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:52.439529 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56e785-bbcf-4645-b598-a9951cf64141 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:52.439811 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56e785-bbcf-4645-b598-a9951cf64141 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:52.440083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56e785-bbcf-4645-b598-a9951cf64141 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:52.440775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56e785-bbcf-4645-b598-a9951cf64141 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:52.441078 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56e785-bbcf-4645-b598-a9951cf64141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:52.442552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56e785-bbcf-4645-b598-a9951cf64141 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:52.451978 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 604/1189] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:37:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:52.459723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f97675-bf3d-47ab-9710-72f18ee305e9 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:52.592803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f97675-bf3d-47ab-9710-72f18ee305e9 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:52.637359 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd109c5b-3459-4cb7-b622-70d649735583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:52.638040 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd109c5b-3459-4cb7-b622-70d649735583 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:52.638315 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd109c5b-3459-4cb7-b622-70d649735583 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:52.638587 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd109c5b-3459-4cb7-b622-70d649735583 None admin] PATH_INFO: `/v3/users/ca34522204064603af5acade76bf565d` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:52.639810 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd109c5b-3459-4cb7-b622-70d649735583 None admin] RBAC: Authorizing `identity:get_user(user_id=ca34522204064603af5acade76bf565d)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:52.641824 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd109c5b-3459-4cb7-b622-70d649735583 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:52.643530 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 586/1190] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:37:52 2022] GET /identity/v3/users/ca34522204064603af5acade76bf565d => generated 311 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:52.650679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56e785-bbcf-4645-b598-a9951cf64141 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:52.740826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:52.777140 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56e785-bbcf-4645-b598-a9951cf64141 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:52.814954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da6831-e82a-49ff-ab35-f2e0185b8b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:52.815611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da6831-e82a-49ff-ab35-f2e0185b8b82 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:52.815894 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da6831-e82a-49ff-ab35-f2e0185b8b82 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:52.816171 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da6831-e82a-49ff-ab35-f2e0185b8b82 None admin] PATH_INFO: `/v3/projects/15b801ac7eac44ac8bac7fb9d49938e6` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:52.817343 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da6831-e82a-49ff-ab35-f2e0185b8b82 None admin] RBAC: Authorizing `identity:get_project(project_id=15b801ac7eac44ac8bac7fb9d49938e6)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:52.818804 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da6831-e82a-49ff-ab35-f2e0185b8b82 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:52.820467 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 605/1191] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:37:52 2022] GET /identity/v3/projects/15b801ac7eac44ac8bac7fb9d49938e6 => generated 361 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:52.826747 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd109c5b-3459-4cb7-b622-70d649735583 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:52.854185 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:52.944109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd109c5b-3459-4cb7-b622-70d649735583 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:52.980833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0ff3f-15d2-4b41-b180-9713e59889b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:52.981517 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0ff3f-15d2-4b41-b180-9713e59889b0 None admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:52.981796 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0ff3f-15d2-4b41-b180-9713e59889b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:52.982072 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0ff3f-15d2-4b41-b180-9713e59889b0 None admin] PATH_INFO: `/v3/projects/15b801ac7eac44ac8bac7fb9d49938e6/users/ca34522204064603af5acade76bf565d/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:52.984015 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0ff3f-15d2-4b41-b180-9713e59889b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=15b801ac7eac44ac8bac7fb9d49938e6, user_id=ca34522204064603af5acade76bf565d, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:52.985652 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0ff3f-15d2-4b41-b180-9713e59889b0 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:52.999345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 587/1192] 10.222.0.94 () {58 vars in 1439 bytes} [Wed Aug 24 04:37:52 2022] PUT /identity/v3/projects/15b801ac7eac44ac8bac7fb9d49938e6/users/ca34522204064603af5acade76bf565d/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:37:54.977899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93239ee6-baa8-4999-b72e-c670c12bbbb3 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:54.978428 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93239ee6-baa8-4999-b72e-c670c12bbbb3 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:54.978428 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93239ee6-baa8-4999-b72e-c670c12bbbb3 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:54.979709 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 606/1193] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:54.985850 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbf19c-ab4a-42a9-84b3-82bb1479b8a8 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:54.986441 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbf19c-ab4a-42a9-84b3-82bb1479b8a8 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:54.986441 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbf19c-ab4a-42a9-84b3-82bb1479b8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:55.014351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-c9cbf19c-ab4a-42a9-84b3-82bb1479b8a8 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:55.015571 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-c9cbf19c-ab4a-42a9-84b3-82bb1479b8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:55.089153 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 588/1194] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:55.369972 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93239ee6-baa8-4999-b72e-c670c12bbbb3 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:55.517043 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93239ee6-baa8-4999-b72e-c670c12bbbb3 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:55.557759 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42f23f-71d5-4d20-9c8a-674e5a394aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:55.558571 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42f23f-71d5-4d20-9c8a-674e5a394aea None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:55.558751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42f23f-71d5-4d20-9c8a-674e5a394aea None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:55.558944 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42f23f-71d5-4d20-9c8a-674e5a394aea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:55.571113 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:55.576760 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42f23f-71d5-4d20-9c8a-674e5a394aea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:37:55.582789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-aa42f23f-71d5-4d20-9c8a-674e5a394aea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:55.582789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:55.582789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:55.582789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:55.582789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:55.582789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:55.582789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:55.582789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:55.582789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:55.582789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:55.582789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:55.582789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:55.582789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:37:55.582789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:37:55.582789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:37:55.582789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:37:55.584448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:37:55.584448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:37:55.584448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:37:55.584448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:37:55.584448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:55.584448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:55.584448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:55.584448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:55.584448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:55.584448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:55.584448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:55.584448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:55.584448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:55.584448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:55.584448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:55.584448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:55.586152 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:55.586152 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:55.586152 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:55.586152 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:55.586152 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:37:55.586152 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:37:55.586152 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:37:55.586152 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:37:55.586152 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:37:55.586152 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:37:55.586152 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:55.586152 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:37:55.586152 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 607/1195] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:37:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:55.590533 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbf19c-ab4a-42a9-84b3-82bb1479b8a8 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:55.606331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:55.718594 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbf19c-ab4a-42a9-84b3-82bb1479b8a8 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:55.763278 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ff9ee-0816-406f-9d32-deffd3630e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:55.763924 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ff9ee-0816-406f-9d32-deffd3630e2c None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:55.764188 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ff9ee-0816-406f-9d32-deffd3630e2c None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:55.764461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ff9ee-0816-406f-9d32-deffd3630e2c None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:55.765151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ff9ee-0816-406f-9d32-deffd3630e2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:55.765487 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ff9ee-0816-406f-9d32-deffd3630e2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:55.767737 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ff9ee-0816-406f-9d32-deffd3630e2c None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:55.778020 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 589/1196] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:37:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:55.788496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42f23f-71d5-4d20-9c8a-674e5a394aea None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:55.928454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42f23f-71d5-4d20-9c8a-674e5a394aea None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:55.983437 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feef73f-89c5-4428-9ece-30e71d1ae6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:55.984135 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feef73f-89c5-4428-9ece-30e71d1ae6b7 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:55.984290 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feef73f-89c5-4428-9ece-30e71d1ae6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:55.984528 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feef73f-89c5-4428-9ece-30e71d1ae6b7 None admin] PATH_INFO: `/v3/users/ca34522204064603af5acade76bf565d` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:55.986319 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feef73f-89c5-4428-9ece-30e71d1ae6b7 None admin] RBAC: Authorizing `identity:get_user(user_id=ca34522204064603af5acade76bf565d)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:55.987751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feef73f-89c5-4428-9ece-30e71d1ae6b7 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:55.989420 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 608/1197] 10.222.0.94 () {56 vars in 1177 bytes} [Wed Aug 24 04:37:55 2022] GET /identity/v3/users/ca34522204064603af5acade76bf565d => generated 311 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:55.995856 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ff9ee-0816-406f-9d32-deffd3630e2c None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:56.086688 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:56.115735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ff9ee-0816-406f-9d32-deffd3630e2c None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:56.152663 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd578311-c943-477a-bae5-5599eb5aa555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:56.153278 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd578311-c943-477a-bae5-5599eb5aa555 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:56.153585 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd578311-c943-477a-bae5-5599eb5aa555 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:56.153858 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd578311-c943-477a-bae5-5599eb5aa555 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:56.225015 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd578311-c943-477a-bae5-5599eb5aa555 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:56.226492 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd578311-c943-477a-bae5-5599eb5aa555 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:56.303784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:56.330317 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 590/1198] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:37:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:37:56.336810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feef73f-89c5-4428-9ece-30e71d1ae6b7 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:56.411050 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:56.448453 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feef73f-89c5-4428-9ece-30e71d1ae6b7 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:56.486910 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f183c-3e01-4f20-9f70-b6315ab16df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:56.487546 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f183c-3e01-4f20-9f70-b6315ab16df6 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:56.487828 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f183c-3e01-4f20-9f70-b6315ab16df6 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:56.488103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f183c-3e01-4f20-9f70-b6315ab16df6 None admin] PATH_INFO: `/v3/projects/15b801ac7eac44ac8bac7fb9d49938e6` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:56.489222 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f183c-3e01-4f20-9f70-b6315ab16df6 None admin] RBAC: Authorizing `identity:get_project(project_id=15b801ac7eac44ac8bac7fb9d49938e6)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:56.490699 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f183c-3e01-4f20-9f70-b6315ab16df6 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:56.492350 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 609/1199] 10.222.0.94 () {56 vars in 1186 bytes} [Wed Aug 24 04:37:56 2022] GET /identity/v3/projects/15b801ac7eac44ac8bac7fb9d49938e6 => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:56.498693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd578311-c943-477a-bae5-5599eb5aa555 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:56.599259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd578311-c943-477a-bae5-5599eb5aa555 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:56.631502 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3e536-14da-4c99-9d60-db1d30bbf4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:56.632087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3e536-14da-4c99-9d60-db1d30bbf4f8 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:56.632363 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3e536-14da-4c99-9d60-db1d30bbf4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:56.632630 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3e536-14da-4c99-9d60-db1d30bbf4f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:56.633341 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3e536-14da-4c99-9d60-db1d30bbf4f8 None admin] RBAC: Adding query filter params (role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2, scope.project.id=15b801ac7eac44ac8bac7fb9d49938e6, user.id=ca34522204064603af5acade76bf565d) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:56.633672 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3e536-14da-4c99-9d60-db1d30bbf4f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:56.635072 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3e536-14da-4c99-9d60-db1d30bbf4f8 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:56.640722 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 591/1200] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:37:56 2022] GET /identity/v3/role_assignments?user.id=ca34522204064603af5acade76bf565d&scope.project.id=15b801ac7eac44ac8bac7fb9d49938e6&role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:06.482304 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=33 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:06.638709 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=81 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:03.893374 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef339400-446b-46da-9cce-e23c808b664d None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:03.894520 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef339400-446b-46da-9cce-e23c808b664d None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:03.894669 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef339400-446b-46da-9cce-e23c808b664d None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:03.898159 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 610/1201] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:39:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:03.906519 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c5995-2502-4506-aa26-4e9566b83d9e None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:03.907579 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c5995-2502-4506-aa26-4e9566b83d9e None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:03.907579 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c5995-2502-4506-aa26-4e9566b83d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:03.945447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-679c5995-2502-4506-aa26-4e9566b83d9e None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:03.947529 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-679c5995-2502-4506-aa26-4e9566b83d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:04.117514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 592/1202] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:39:04.492772 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef339400-446b-46da-9cce-e23c808b664d None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:04.708635 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef339400-446b-46da-9cce-e23c808b664d None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:04.783550 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100551a5-c9ba-4f9b-b751-66198146e6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:04.784371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100551a5-c9ba-4f9b-b751-66198146e6c4 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:04.784673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100551a5-c9ba-4f9b-b751-66198146e6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:04.785090 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100551a5-c9ba-4f9b-b751-66198146e6c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:04.806788 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100551a5-c9ba-4f9b-b751-66198146e6c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:04.809381 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100551a5-c9ba-4f9b-b751-66198146e6c4 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:04.836517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-100551a5-c9ba-4f9b-b751-66198146e6c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:04.836517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:04.836517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:04.836517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:04.836517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:04.836517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:04.836517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:04.836517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:04.836517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:04.836517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:04.836517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:04.836517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:04.836517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:39:04.836517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:39:04.836517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:39:04.836517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:39:04.838820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:04.838820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:04.838820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:04.838820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:04.838820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:04.838820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:04.838820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:04.838820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:04.838820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:04.838820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:04.838820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:04.838820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:04.838820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:04.838820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:04.838820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:04.838820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:04.838820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:39:04.841235 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:39:04.841235 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:04.841235 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:39:04.841235 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 611/1203] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:04.849315 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c5995-2502-4506-aa26-4e9566b83d9e None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:05.101512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c5995-2502-4506-aa26-4e9566b83d9e None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:05.178474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:05.199408 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148be81-adbc-46ae-92ce-52e921c389d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:05.200517 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148be81-adbc-46ae-92ce-52e921c389d6 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:05.200873 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148be81-adbc-46ae-92ce-52e921c389d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:05.202034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148be81-adbc-46ae-92ce-52e921c389d6 None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:05.203949 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148be81-adbc-46ae-92ce-52e921c389d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:05.203949 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148be81-adbc-46ae-92ce-52e921c389d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:05.204573 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148be81-adbc-46ae-92ce-52e921c389d6 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:05.229268 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 593/1204] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:05.239643 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100551a5-c9ba-4f9b-b751-66198146e6c4 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:05.358040 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:05.486536 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100551a5-c9ba-4f9b-b751-66198146e6c4 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:05.577124 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c286a3-a7a6-40b1-85b8-291693329213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:05.578219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c286a3-a7a6-40b1-85b8-291693329213 None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:05.578754 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c286a3-a7a6-40b1-85b8-291693329213 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:05.579209 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c286a3-a7a6-40b1-85b8-291693329213 None admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:05.580418 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c286a3-a7a6-40b1-85b8-291693329213 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:05.585464 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c286a3-a7a6-40b1-85b8-291693329213 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:05.625014 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 612/1205] 10.222.0.94 () {60 vars in 1132 bytes} [Wed Aug 24 04:39:05 2022] POST /identity/v3/users => generated 251 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:39:09.084305 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7491c-77d1-4330-8cc4-98c9d5d21ea1 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:09.084887 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7491c-77d1-4330-8cc4-98c9d5d21ea1 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:09.085311 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7491c-77d1-4330-8cc4-98c9d5d21ea1 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:09.088372 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 594/1206] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:39:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:09.099156 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4725c7-3032-4ce0-beea-dcdf100bbf1d None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:09.099988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4725c7-3032-4ce0-beea-dcdf100bbf1d None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:09.100470 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4725c7-3032-4ce0-beea-dcdf100bbf1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:09.136776 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-dd4725c7-3032-4ce0-beea-dcdf100bbf1d None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:09.138822 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-dd4725c7-3032-4ce0-beea-dcdf100bbf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:09.312881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 613/1207] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:39:09.793516 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7491c-77d1-4330-8cc4-98c9d5d21ea1 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:10.025368 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7491c-77d1-4330-8cc4-98c9d5d21ea1 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:10.098854 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f0204-b9f2-429d-b6df-6e3e1641778a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:10.101324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f0204-b9f2-429d-b6df-6e3e1641778a None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:10.101700 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f0204-b9f2-429d-b6df-6e3e1641778a None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:10.102172 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f0204-b9f2-429d-b6df-6e3e1641778a None admin] PATH_INFO: `/v3/roles/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:10.128361 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f0204-b9f2-429d-b6df-6e3e1641778a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:10.138417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-e81f0204-b9f2-429d-b6df-6e3e1641778a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:39:10.138417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:10.138417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:10.138417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:10.138417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:10.138417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:10.138417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:10.138417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:10.138417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:10.138417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:10.138417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:10.138417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:10.138417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:10.138417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:10.138417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:10.138417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:10.139770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:10.139770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:10.139770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:10.139770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:10.139770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:10.139770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:10.139770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:10.139770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:10.139770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:10.139770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:10.139770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:10.139770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:10.139770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:10.139770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:10.139770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:10.139770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:10.140876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:10.140876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:10.140876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:10.140876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:10.140876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:10.140876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:10.140876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:10.140876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:10.140876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:10.140876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:10.140876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:39:10.140876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:39:10.149612 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 595/1208] 10.222.0.94 () {56 vars in 1102 bytes} [Wed Aug 24 04:39:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:10.149871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4725c7-3032-4ce0-beea-dcdf100bbf1d None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:10.224746 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:10.333502 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4725c7-3032-4ce0-beea-dcdf100bbf1d None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:10.393520 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e94b68-2f54-41fc-af26-9e59425e3e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:10.394701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e94b68-2f54-41fc-af26-9e59425e3e62 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:10.395088 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e94b68-2f54-41fc-af26-9e59425e3e62 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:10.395480 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e94b68-2f54-41fc-af26-9e59425e3e62 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:10.396699 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e94b68-2f54-41fc-af26-9e59425e3e62 None admin] RBAC: Adding query filter params (name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:10.397277 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e94b68-2f54-41fc-af26-9e59425e3e62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:10.403042 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e94b68-2f54-41fc-af26-9e59425e3e62 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:10.412659 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 614/1209] 10.222.0.94 () {56 vars in 1103 bytes} [Wed Aug 24 04:39:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:10.420877 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f0204-b9f2-429d-b6df-6e3e1641778a None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:10.501592 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:10.615424 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f0204-b9f2-429d-b6df-6e3e1641778a None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:10.673721 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176701c-6fad-4ccb-8557-1ab75f601714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:10.675384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176701c-6fad-4ccb-8557-1ab75f601714 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:10.676383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176701c-6fad-4ccb-8557-1ab75f601714 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:10.677039 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176701c-6fad-4ccb-8557-1ab75f601714 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:10.694508 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176701c-6fad-4ccb-8557-1ab75f601714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:10.695957 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176701c-6fad-4ccb-8557-1ab75f601714 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:10.715854 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-1176701c-6fad-4ccb-8557-1ab75f601714 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:10.715854 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:10.715854 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:10.715854 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:10.715854 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:10.715854 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:10.715854 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:10.715854 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:10.715854 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:10.715854 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:10.715854 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:10.715854 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:10.715854 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:39:10.715854 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:39:10.715854 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:39:10.715854 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:39:10.717771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:10.717771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:10.717771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:10.717771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:10.717771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:10.717771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:10.717771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:10.717771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:10.717771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:10.717771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:10.717771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:10.717771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:10.717771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:10.717771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:10.717771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:10.717771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:10.717771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:39:10.720096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:39:10.720096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:10.720096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:39:10.724213 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 596/1210] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:10.724539 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e94b68-2f54-41fc-af26-9e59425e3e62 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:10.910177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:10.919193 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e94b68-2f54-41fc-af26-9e59425e3e62 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:10.986493 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d95d4-05a4-403e-9b6a-a923311ae5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:10.987775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d95d4-05a4-403e-9b6a-a923311ae5ea None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:10.988353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d95d4-05a4-403e-9b6a-a923311ae5ea None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:10.988631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d95d4-05a4-403e-9b6a-a923311ae5ea None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:10.989987 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d95d4-05a4-403e-9b6a-a923311ae5ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:10.990510 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d95d4-05a4-403e-9b6a-a923311ae5ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:10.993510 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d95d4-05a4-403e-9b6a-a923311ae5ea None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:11.023976 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 615/1211] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:11.035127 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176701c-6fad-4ccb-8557-1ab75f601714 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:11.210444 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176701c-6fad-4ccb-8557-1ab75f601714 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:11.214953 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:11.290192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ff6e2-fd36-4734-b060-ac8e3ab06f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:11.291017 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ff6e2-fd36-4734-b060-ac8e3ab06f8a None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:11.291571 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ff6e2-fd36-4734-b060-ac8e3ab06f8a None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:11.291945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ff6e2-fd36-4734-b060-ac8e3ab06f8a None admin] PATH_INFO: `/v3/users/placement` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:11.302530 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ff6e2-fd36-4734-b060-ac8e3ab06f8a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:11.304199 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ff6e2-fd36-4734-b060-ac8e3ab06f8a None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:11.319219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-a23ff6e2-fd36-4734-b060-ac8e3ab06f8a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:39:11.319219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:11.319219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:11.319219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:11.319219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:11.319219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:11.319219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:11.319219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:11.319219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:11.319219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:11.319219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:11.319219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:11.319219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:39:11.319219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:39:11.319219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:39:11.319219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:39:11.321480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:11.321480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:11.321480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:39:11.321480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:39:11.321480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:39:11.321480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:39:11.321480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:11.321480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:11.321480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:11.321480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:11.321480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:11.321480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:11.321480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:11.321480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:11.321480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:11.321480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:11.321480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:11.321480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:11.324172 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:11.324172 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:11.324172 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:39:11.324172 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:39:11.324172 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:39:11.324172 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:39:11.324172 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:39:11.324172 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:39:11.324172 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:39:11.324172 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:39:11.324172 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 597/1212] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:11.328797 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d95d4-05a4-403e-9b6a-a923311ae5ea None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:11.521871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d95d4-05a4-403e-9b6a-a923311ae5ea None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:11.589785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3573b-3916-4f9e-88c5-6c81edd8b23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:11.591023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3573b-3916-4f9e-88c5-6c81edd8b23e None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:11.591645 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3573b-3916-4f9e-88c5-6c81edd8b23e None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:11.592432 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3573b-3916-4f9e-88c5-6c81edd8b23e None admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:11.593361 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3573b-3916-4f9e-88c5-6c81edd8b23e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:11.593858 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3573b-3916-4f9e-88c5-6c81edd8b23e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:11.595534 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3573b-3916-4f9e-88c5-6c81edd8b23e None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:11.618254 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 616/1213] 10.222.0.94 () {56 vars in 1143 bytes} [Wed Aug 24 04:39:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:11.626427 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ff6e2-fd36-4734-b060-ac8e3ab06f8a None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:11.800590 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ff6e2-fd36-4734-b060-ac8e3ab06f8a None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:11.853513 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9963a6b-b81b-4c18-b23b-f6c3d7f90238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:11.854163 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9963a6b-b81b-4c18-b23b-f6c3d7f90238 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:11.854434 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9963a6b-b81b-4c18-b23b-f6c3d7f90238 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:11.854697 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9963a6b-b81b-4c18-b23b-f6c3d7f90238 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:11.917695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:12.007451 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9963a6b-b81b-4c18-b23b-f6c3d7f90238 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:12.012090 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9963a6b-b81b-4c18-b23b-f6c3d7f90238 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:12.260669 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 598/1214] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:39:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:39:12.265627 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3573b-3916-4f9e-88c5-6c81edd8b23e None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:12.328340 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:12.574790 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3573b-3916-4f9e-88c5-6c81edd8b23e None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:12.674656 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628dafb9-9445-49b8-b7fb-75cbf4e7d21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:12.675888 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628dafb9-9445-49b8-b7fb-75cbf4e7d21b None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:12.676354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628dafb9-9445-49b8-b7fb-75cbf4e7d21b None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:12.676848 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628dafb9-9445-49b8-b7fb-75cbf4e7d21b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:12.701986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628dafb9-9445-49b8-b7fb-75cbf4e7d21b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:12.703988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628dafb9-9445-49b8-b7fb-75cbf4e7d21b None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:12.732503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-628dafb9-9445-49b8-b7fb-75cbf4e7d21b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:12.732503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:12.732503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:12.732503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:12.732503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:12.732503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:12.732503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:12.732503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:12.732503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:12.732503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:12.732503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:12.732503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:12.732503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:39:12.732503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:39:12.732503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:39:12.732503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:39:12.734631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:12.734631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:12.734631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:12.734631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:12.734631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:12.734631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:12.734631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:12.734631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:12.734631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:12.734631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:12.734631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:12.734631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:12.734631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:12.734631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:12.734631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:12.734631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:12.734631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:39:12.735662 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:39:12.735662 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:12.735662 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:39:12.735662 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 617/1215] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 470 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:12.744891 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9963a6b-b81b-4c18-b23b-f6c3d7f90238 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:12.862266 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:12.934708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9963a6b-b81b-4c18-b23b-f6c3d7f90238 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:13.004108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef04fd-dc6b-480b-8a82-8b0c592e3bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:13.004859 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef04fd-dc6b-480b-8a82-8b0c592e3bc8 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:13.005380 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef04fd-dc6b-480b-8a82-8b0c592e3bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:13.005920 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef04fd-dc6b-480b-8a82-8b0c592e3bc8 None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:13.008011 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef04fd-dc6b-480b-8a82-8b0c592e3bc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:13.008636 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef04fd-dc6b-480b-8a82-8b0c592e3bc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:13.010508 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef04fd-dc6b-480b-8a82-8b0c592e3bc8 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:13.036173 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 599/1216] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:13.039945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628dafb9-9445-49b8-b7fb-75cbf4e7d21b None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:13.156163 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:13.227994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628dafb9-9445-49b8-b7fb-75cbf4e7d21b None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:13.292376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d2664-0cfa-41ca-b0d5-f45f5064c505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:13.293512 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d2664-0cfa-41ca-b0d5-f45f5064c505 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:13.293512 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d2664-0cfa-41ca-b0d5-f45f5064c505 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:13.293838 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d2664-0cfa-41ca-b0d5-f45f5064c505 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:13.305536 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d2664-0cfa-41ca-b0d5-f45f5064c505 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:13.307438 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d2664-0cfa-41ca-b0d5-f45f5064c505 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:13.328223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-287d2664-0cfa-41ca-b0d5-f45f5064c505 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:39:13.328223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:13.328223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:13.328223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:13.328223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:13.328223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:13.328223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:13.328223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:13.328223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:13.328223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:13.328223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:13.328223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:13.328223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:39:13.328223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:39:13.328223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:39:13.336137 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:39:13.336137 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:13.336137 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:13.336137 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:13.336137 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:13.336137 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:13.336137 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:13.336137 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:13.336137 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:13.336137 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:13.336137 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:13.336137 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:13.336137 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:13.336137 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:13.336137 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:13.336137 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:13.336137 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:13.337094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:39:13.337094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:39:13.337094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:39:13.337094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:39:13.337094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:39:13.337094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:39:13.337094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:39:13.337094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:39:13.337094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 618/1217] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:39:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:13.338431 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef04fd-dc6b-480b-8a82-8b0c592e3bc8 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:13.524389 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef04fd-dc6b-480b-8a82-8b0c592e3bc8 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:13.571294 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:13.595338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2f5ff-eae6-4a76-885e-0c822ef26a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:13.596332 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2f5ff-eae6-4a76-885e-0c822ef26a61 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:13.596819 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2f5ff-eae6-4a76-885e-0c822ef26a61 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:13.597269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2f5ff-eae6-4a76-885e-0c822ef26a61 None admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:13.598545 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2f5ff-eae6-4a76-885e-0c822ef26a61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:13.599076 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2f5ff-eae6-4a76-885e-0c822ef26a61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:13.601735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2f5ff-eae6-4a76-885e-0c822ef26a61 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:13.635694 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 600/1218] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:39:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:13.637718 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d2664-0cfa-41ca-b0d5-f45f5064c505 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:13.827265 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d2664-0cfa-41ca-b0d5-f45f5064c505 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:13.873247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:13.882132 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b555e-ddac-4c1f-84ac-98c1ace8c4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:13.882876 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b555e-ddac-4c1f-84ac-98c1ace8c4c9 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:13.883225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b555e-ddac-4c1f-84ac-98c1ace8c4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:13.883510 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b555e-ddac-4c1f-84ac-98c1ace8c4c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:13.884597 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b555e-ddac-4c1f-84ac-98c1ace8c4c9 None admin] RBAC: Adding query filter params (role.id=5e5c4aa158a845b981b0e847f8bd47a6, scope.project.id=4416325d266642f3a786ff9f16c827aa, user.id=3a3274d404cb403bbf272ce023aa5e0c) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:13.884975 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b555e-ddac-4c1f-84ac-98c1ace8c4c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:13.886404 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b555e-ddac-4c1f-84ac-98c1ace8c4c9 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:13.897596 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 619/1219] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:39:13 2022] GET /identity/v3/role_assignments?user.id=3a3274d404cb403bbf272ce023aa5e0c&scope.project.id=4416325d266642f3a786ff9f16c827aa&role.id=5e5c4aa158a845b981b0e847f8bd47a6 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:16.074385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284531c-e0d5-4bfd-b311-96a7f7a17064 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:16.075240 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284531c-e0d5-4bfd-b311-96a7f7a17064 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:16.075424 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284531c-e0d5-4bfd-b311-96a7f7a17064 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:16.077682 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 601/1220] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:39:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:16.084409 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfb5fa-cd87-41b4-9477-acd81b544df7 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:16.084959 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfb5fa-cd87-41b4-9477-acd81b544df7 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:16.085062 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfb5fa-cd87-41b4-9477-acd81b544df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:16.112343 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-18dfb5fa-cd87-41b4-9477-acd81b544df7 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:16.113652 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-18dfb5fa-cd87-41b4-9477-acd81b544df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:16.232320 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 620/1221] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:39:16.531124 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284531c-e0d5-4bfd-b311-96a7f7a17064 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:16.676085 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284531c-e0d5-4bfd-b311-96a7f7a17064 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:16.723186 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158a676-cb5f-4c49-9914-5a458342eb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:16.723825 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158a676-cb5f-4c49-9914-5a458342eb51 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:16.724099 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158a676-cb5f-4c49-9914-5a458342eb51 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:16.724367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158a676-cb5f-4c49-9914-5a458342eb51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:16.742615 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158a676-cb5f-4c49-9914-5a458342eb51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:16.749714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-6158a676-cb5f-4c49-9914-5a458342eb51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:39:16.749714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:16.749714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:16.749714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:16.749714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:16.749714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:16.749714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:16.749714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:16.749714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:16.749714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:16.749714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:16.749714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:16.749714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:16.749714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:16.749714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:16.749714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:16.753915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:16.753915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:16.753915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:16.753915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:16.753915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:16.753915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:16.753915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:16.753915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:16.753915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:16.753915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:16.753915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:16.753915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:16.753915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:16.753915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:16.753915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:16.753915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:16.756326 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:16.756326 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:16.756326 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:16.756326 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:16.756326 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:16.756326 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:16.756326 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:16.756326 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:16.756326 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:16.756326 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:16.756326 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:39:16.756326 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:39:16.756326 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 602/1222] 10.222.0.94 () {56 vars in 1102 bytes} [Wed Aug 24 04:39:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:16.762170 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dfb5fa-cd87-41b4-9477-acd81b544df7 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:16.916689 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dfb5fa-cd87-41b4-9477-acd81b544df7 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:16.947172 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:16.966117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc90e7-9fca-4141-8aea-0a76686be341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:16.966922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc90e7-9fca-4141-8aea-0a76686be341 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:16.967275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc90e7-9fca-4141-8aea-0a76686be341 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:16.967653 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc90e7-9fca-4141-8aea-0a76686be341 None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:16.968684 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc90e7-9fca-4141-8aea-0a76686be341 None admin] RBAC: Adding query filter params (name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:16.969194 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc90e7-9fca-4141-8aea-0a76686be341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:16.971879 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc90e7-9fca-4141-8aea-0a76686be341 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:16.988392 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 621/1223] 10.222.0.94 () {56 vars in 1103 bytes} [Wed Aug 24 04:39:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:16.997023 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158a676-cb5f-4c49-9914-5a458342eb51 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:17.076465 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:17.185854 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158a676-cb5f-4c49-9914-5a458342eb51 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:17.234845 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43f37e-405d-4bd1-a493-b06ca3d02a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:17.235745 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43f37e-405d-4bd1-a493-b06ca3d02a04 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:17.236016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43f37e-405d-4bd1-a493-b06ca3d02a04 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:17.236436 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43f37e-405d-4bd1-a493-b06ca3d02a04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:17.250968 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43f37e-405d-4bd1-a493-b06ca3d02a04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:17.252416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43f37e-405d-4bd1-a493-b06ca3d02a04 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:17.268862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-2b43f37e-405d-4bd1-a493-b06ca3d02a04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:17.268862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:17.268862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:17.268862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:17.268862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:17.268862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:17.268862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:17.268862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:17.268862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:17.268862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:17.268862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:17.268862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:17.268862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:39:17.268862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:39:17.268862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:39:17.268862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:39:17.270325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:17.270325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:17.270325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:17.270325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:17.270325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:17.270325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:17.270325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:17.270325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:17.270325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:17.270325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:17.270325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:17.270325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:17.270325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:17.270325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:17.270325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:17.270325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:17.270325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:39:17.271556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:39:17.271556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:17.271556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:39:17.271556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 603/1224] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:17.280240 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc90e7-9fca-4141-8aea-0a76686be341 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:17.448414 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc90e7-9fca-4141-8aea-0a76686be341 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:17.499437 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2e784-bd46-4c52-aa6d-2b216a5f1183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:17.500297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2e784-bd46-4c52-aa6d-2b216a5f1183 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:17.500722 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2e784-bd46-4c52-aa6d-2b216a5f1183 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:17.501128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2e784-bd46-4c52-aa6d-2b216a5f1183 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:17.501959 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2e784-bd46-4c52-aa6d-2b216a5f1183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:17.502407 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2e784-bd46-4c52-aa6d-2b216a5f1183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:17.504669 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2e784-bd46-4c52-aa6d-2b216a5f1183 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:17.528925 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 622/1225] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:17.536416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43f37e-405d-4bd1-a493-b06ca3d02a04 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:17.687340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:17.696137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43f37e-405d-4bd1-a493-b06ca3d02a04 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:17.747408 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8bb07c-4a81-4c91-b498-5f51d7c43a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:17.747993 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bb07c-4a81-4c91-b498-5f51d7c43a6b None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:17.748248 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bb07c-4a81-4c91-b498-5f51d7c43a6b None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:17.748520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bb07c-4a81-4c91-b498-5f51d7c43a6b None admin] PATH_INFO: `/v3/users/placement` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:17.760090 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8bb07c-4a81-4c91-b498-5f51d7c43a6b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:17.761829 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8bb07c-4a81-4c91-b498-5f51d7c43a6b None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:17.777553 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-ca8bb07c-4a81-4c91-b498-5f51d7c43a6b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:39:17.777553 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:17.777553 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:17.777553 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:17.777553 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:17.777553 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:17.777553 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:17.777553 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:17.777553 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:17.777553 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:17.777553 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:17.777553 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:17.777553 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:39:17.777553 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:39:17.777553 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:39:17.777553 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:39:17.778862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:17.778862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:17.778862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:39:17.778862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:39:17.778862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:39:17.778862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:39:17.778862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:17.778862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:17.778862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:17.778862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:17.778862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:17.778862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:17.778862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:17.778862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:17.778862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:17.778862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:17.778862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:17.778862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:17.780318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:17.780318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:17.780318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:39:17.780318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:39:17.780318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:39:17.780318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:39:17.780318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:39:17.780318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:39:17.780318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:39:17.780318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:39:17.780318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 604/1226] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:17.785564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2e784-bd46-4c52-aa6d-2b216a5f1183 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:17.852528 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:17.925676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2e784-bd46-4c52-aa6d-2b216a5f1183 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:17.972581 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab707d7-0059-4c9c-9d08-28b1a2126b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:17.973343 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab707d7-0059-4c9c-9d08-28b1a2126b0b None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:17.973681 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab707d7-0059-4c9c-9d08-28b1a2126b0b None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:17.974103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab707d7-0059-4c9c-9d08-28b1a2126b0b None admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:17.974992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab707d7-0059-4c9c-9d08-28b1a2126b0b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:17.975312 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab707d7-0059-4c9c-9d08-28b1a2126b0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:17.977251 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab707d7-0059-4c9c-9d08-28b1a2126b0b None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:18.006577 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 623/1227] 10.222.0.94 () {56 vars in 1143 bytes} [Wed Aug 24 04:39:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:18.014285 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8bb07c-4a81-4c91-b498-5f51d7c43a6b None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:18.166300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8bb07c-4a81-4c91-b498-5f51d7c43a6b None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:18.217763 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa310907-da91-4354-b917-20f54e13d32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:18.219502 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa310907-da91-4354-b917-20f54e13d32d None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:18.219806 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa310907-da91-4354-b917-20f54e13d32d None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:18.220138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa310907-da91-4354-b917-20f54e13d32d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:18.235733 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa310907-da91-4354-b917-20f54e13d32d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:18.237233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa310907-da91-4354-b917-20f54e13d32d None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:18.256033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-aa310907-da91-4354-b917-20f54e13d32d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:18.256033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:18.256033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:18.256033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:18.256033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:18.256033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:18.256033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:18.256033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:18.256033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:18.256033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:18.256033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:18.256033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:18.256033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:39:18.256033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:39:18.256033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:39:18.256033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:39:18.257383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:18.257383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:18.257383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:18.257383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:18.257383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:18.257383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:18.257383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:18.257383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:18.257383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:18.257383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:18.257383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:18.257383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:18.257383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:18.257383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:18.257383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:18.257383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:18.257383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:39:18.258457 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:39:18.258457 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:18.258457 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:39:18.258457 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 605/1228] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:18.265363 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab707d7-0059-4c9c-9d08-28b1a2126b0b None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:18.441753 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab707d7-0059-4c9c-9d08-28b1a2126b0b None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:18.446426 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:18.490967 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677a1e5-a6a6-468f-801e-949b5e8dbfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:18.491699 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677a1e5-a6a6-468f-801e-949b5e8dbfb0 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:18.492061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677a1e5-a6a6-468f-801e-949b5e8dbfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:18.492410 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677a1e5-a6a6-468f-801e-949b5e8dbfb0 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:18.493197 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677a1e5-a6a6-468f-801e-949b5e8dbfb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:18.493839 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677a1e5-a6a6-468f-801e-949b5e8dbfb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:18.495317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677a1e5-a6a6-468f-801e-949b5e8dbfb0 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:18.510395 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 624/1229] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:18.518060 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa310907-da91-4354-b917-20f54e13d32d None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:18.533735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:18.681625 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa310907-da91-4354-b917-20f54e13d32d None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:18.727256 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd175f4b-93cd-48c9-9331-4dd3b5114b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:18.728627 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd175f4b-93cd-48c9-9331-4dd3b5114b40 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:18.728865 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd175f4b-93cd-48c9-9331-4dd3b5114b40 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:18.729131 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd175f4b-93cd-48c9-9331-4dd3b5114b40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:18.738339 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd175f4b-93cd-48c9-9331-4dd3b5114b40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:18.739961 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd175f4b-93cd-48c9-9331-4dd3b5114b40 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:18.754639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-cd175f4b-93cd-48c9-9331-4dd3b5114b40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:39:18.754639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:18.754639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:18.754639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:18.754639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:18.754639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:18.754639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:18.754639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:18.754639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:18.754639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:18.754639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:18.754639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:18.754639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:39:18.754639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:39:18.754639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:39:18.756390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:39:18.756390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:18.756390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:18.756390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:18.756390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:18.756390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:18.756390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:18.756390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:18.756390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:18.756390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:18.756390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:18.756390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:18.756390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:18.756390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:18.756390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:18.756390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:18.756390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:18.758061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:39:18.758061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:39:18.758061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:39:18.758061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:39:18.758061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:39:18.758061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:39:18.758061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:39:18.758061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:39:18.758061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 606/1230] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:39:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:18.763204 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677a1e5-a6a6-468f-801e-949b5e8dbfb0 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:18.908965 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677a1e5-a6a6-468f-801e-949b5e8dbfb0 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:18.958570 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdc176-3006-4a68-b703-e53f591b953a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:18.959605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdc176-3006-4a68-b703-e53f591b953a None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:18.960128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdc176-3006-4a68-b703-e53f591b953a None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:18.960634 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdc176-3006-4a68-b703-e53f591b953a None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:18.962672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbdc176-3006-4a68-b703-e53f591b953a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:18.963843 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbdc176-3006-4a68-b703-e53f591b953a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:18.966617 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbdc176-3006-4a68-b703-e53f591b953a None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:18.984525 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 625/1231] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:39:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:18.990644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd175f4b-93cd-48c9-9331-4dd3b5114b40 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:19.095664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:19.143871 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd175f4b-93cd-48c9-9331-4dd3b5114b40 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:19.192033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0b699-de6b-4c6c-8a86-6812ce2da00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:19.192724 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0b699-de6b-4c6c-8a86-6812ce2da00e None admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:19.193082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0b699-de6b-4c6c-8a86-6812ce2da00e None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:19.193377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0b699-de6b-4c6c-8a86-6812ce2da00e None admin] PATH_INFO: `/v3/projects/4416325d266642f3a786ff9f16c827aa/users/3a3274d404cb403bbf272ce023aa5e0c/roles/5e5c4aa158a845b981b0e847f8bd47a6` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:19.217719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0b699-de6b-4c6c-8a86-6812ce2da00e None admin] RBAC: Authorizing `identity:create_grant(project_id=4416325d266642f3a786ff9f16c827aa, user_id=3a3274d404cb403bbf272ce023aa5e0c, role_id=5e5c4aa158a845b981b0e847f8bd47a6)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:19.219308 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0b699-de6b-4c6c-8a86-6812ce2da00e None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:19.236631 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 607/1232] 10.222.0.94 () {58 vars in 1439 bytes} [Wed Aug 24 04:39:18 2022] PUT /identity/v3/projects/4416325d266642f3a786ff9f16c827aa/users/3a3274d404cb403bbf272ce023aa5e0c/roles/5e5c4aa158a845b981b0e847f8bd47a6 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:21.604819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6023ce9-7371-4dcb-93a3-441f3377063d None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:21.605423 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6023ce9-7371-4dcb-93a3-441f3377063d None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:21.605798 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6023ce9-7371-4dcb-93a3-441f3377063d None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:21.607546 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 626/1233] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:39:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:39:21.614390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131e4b4-7f8d-45f9-966d-177f889ac3c4 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:21.615038 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131e4b4-7f8d-45f9-966d-177f889ac3c4 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:21.615168 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131e4b4-7f8d-45f9-966d-177f889ac3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:21.635999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-a131e4b4-7f8d-45f9-966d-177f889ac3c4 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:21.637222 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-a131e4b4-7f8d-45f9-966d-177f889ac3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:21.726186 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 608/1234] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:39:22.010188 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6023ce9-7371-4dcb-93a3-441f3377063d None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:22.057861 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:22.186671 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6023ce9-7371-4dcb-93a3-441f3377063d None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:22.229009 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf0eb3-d953-4e3b-b1a9-24ac0c4c7a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:22.229734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf0eb3-d953-4e3b-b1a9-24ac0c4c7a1d None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:22.230071 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf0eb3-d953-4e3b-b1a9-24ac0c4c7a1d None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:22.230364 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf0eb3-d953-4e3b-b1a9-24ac0c4c7a1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:22.250663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf0eb3-d953-4e3b-b1a9-24ac0c4c7a1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:22.256149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-99cf0eb3-d953-4e3b-b1a9-24ac0c4c7a1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:39:22.256149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:22.256149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:22.256149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:22.256149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:22.256149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:22.256149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:22.256149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:22.256149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:22.256149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:22.256149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:22.256149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:22.256149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:22.256149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:22.256149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:22.256149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:22.257661 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:22.257661 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:22.257661 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:22.257661 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:22.257661 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:22.257661 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:22.257661 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:22.257661 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:22.257661 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:22.257661 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:22.257661 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:22.257661 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:22.257661 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:22.257661 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:22.257661 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:22.257661 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:22.259017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:22.259017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:22.259017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:22.259017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:22.259017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:22.259017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:22.259017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:22.259017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:22.259017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:22.259017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:22.259017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:39:22.259017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:39:22.259017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 627/1235] 10.222.0.94 () {56 vars in 1102 bytes} [Wed Aug 24 04:39:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:22.264453 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131e4b4-7f8d-45f9-966d-177f889ac3c4 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:22.329683 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:22.412502 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131e4b4-7f8d-45f9-966d-177f889ac3c4 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:22.473994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b0fe0-a200-4bee-9479-690435b31821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:22.474764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b0fe0-a200-4bee-9479-690435b31821 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:22.474986 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b0fe0-a200-4bee-9479-690435b31821 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:22.475241 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b0fe0-a200-4bee-9479-690435b31821 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:22.475974 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b0fe0-a200-4bee-9479-690435b31821 None admin] RBAC: Adding query filter params (name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:22.476286 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b0fe0-a200-4bee-9479-690435b31821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:22.478641 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b0fe0-a200-4bee-9479-690435b31821 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:22.489467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 609/1236] 10.222.0.94 () {56 vars in 1103 bytes} [Wed Aug 24 04:39:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:22.499152 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf0eb3-d953-4e3b-b1a9-24ac0c4c7a1d None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:22.641578 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:22.666806 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf0eb3-d953-4e3b-b1a9-24ac0c4c7a1d None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:22.715384 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9592d2-4ec6-4ef6-80e3-557e2666df0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:22.716100 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9592d2-4ec6-4ef6-80e3-557e2666df0c None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:22.716399 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9592d2-4ec6-4ef6-80e3-557e2666df0c None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:22.716673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9592d2-4ec6-4ef6-80e3-557e2666df0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:22.731032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9592d2-4ec6-4ef6-80e3-557e2666df0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:22.732699 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9592d2-4ec6-4ef6-80e3-557e2666df0c None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:22.751068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-1c9592d2-4ec6-4ef6-80e3-557e2666df0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:22.751068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:22.751068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:22.751068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:22.751068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:22.751068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:22.751068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:22.751068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:22.751068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:22.751068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:22.751068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:22.751068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:22.751068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:39:22.751068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:39:22.751068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:39:22.751068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:39:22.752275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:22.752275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:22.752275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:22.752275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:22.752275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:22.752275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:22.752275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:22.752275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:22.752275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:22.752275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:22.752275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:22.752275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:22.752275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:22.752275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:22.752275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:22.752275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:22.752275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:39:22.754121 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:39:22.754121 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:22.754121 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:39:22.758485 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 628/1237] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:22.760175 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b0fe0-a200-4bee-9479-690435b31821 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:22.900585 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b0fe0-a200-4bee-9479-690435b31821 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:22.911794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:22.940917 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1d9c6-8d60-4b08-af66-a7531434af57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:22.941584 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1d9c6-8d60-4b08-af66-a7531434af57 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:22.942036 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1d9c6-8d60-4b08-af66-a7531434af57 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:22.942563 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1d9c6-8d60-4b08-af66-a7531434af57 None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:22.943698 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1d9c6-8d60-4b08-af66-a7531434af57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:22.944259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1d9c6-8d60-4b08-af66-a7531434af57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:22.947149 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1d9c6-8d60-4b08-af66-a7531434af57 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:22.970270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 610/1238] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:22.978010 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9592d2-4ec6-4ef6-80e3-557e2666df0c None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:23.143552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9592d2-4ec6-4ef6-80e3-557e2666df0c None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:23.213451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253dca9-467a-45b8-a856-795508c167ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:23.214234 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253dca9-467a-45b8-a856-795508c167ae None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:23.214629 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253dca9-467a-45b8-a856-795508c167ae None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:23.215033 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253dca9-467a-45b8-a856-795508c167ae None admin] PATH_INFO: `/v3/users/placement` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:23.220288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:23.226250 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253dca9-467a-45b8-a856-795508c167ae None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:23.228653 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253dca9-467a-45b8-a856-795508c167ae None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:23.243365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-8253dca9-467a-45b8-a856-795508c167ae None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:39:23.243365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:23.243365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:23.243365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:23.243365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:23.243365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:23.243365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:23.243365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:23.243365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:23.243365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:23.243365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:23.243365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:23.243365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:39:23.243365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:39:23.243365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:39:23.243365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:39:23.244663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:23.244663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:23.244663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:39:23.244663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:39:23.244663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:39:23.244663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:39:23.244663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:23.244663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:23.244663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:23.244663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:23.244663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:23.244663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:23.244663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:23.244663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:23.244663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:23.244663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:23.244663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:23.244663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:23.245922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:23.245922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:23.245922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:39:23.245922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:39:23.245922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:39:23.245922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:39:23.245922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:39:23.245922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:39:23.245922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:39:23.245922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:39:23.248126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 629/1239] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:23.256607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1d9c6-8d60-4b08-af66-a7531434af57 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:23.424608 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1d9c6-8d60-4b08-af66-a7531434af57 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:23.480681 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5403d-de18-4bb4-9a56-602423ab415e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:23.481256 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5403d-de18-4bb4-9a56-602423ab415e None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:23.481550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5403d-de18-4bb4-9a56-602423ab415e None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:23.481963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5403d-de18-4bb4-9a56-602423ab415e None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:23.482580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5403d-de18-4bb4-9a56-602423ab415e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:23.482882 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5403d-de18-4bb4-9a56-602423ab415e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:23.484377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5403d-de18-4bb4-9a56-602423ab415e None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:23.510743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 611/1240] 10.222.0.94 () {56 vars in 1143 bytes} [Wed Aug 24 04:39:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:23.517709 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253dca9-467a-45b8-a856-795508c167ae None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:23.707385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253dca9-467a-45b8-a856-795508c167ae None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:23.772486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2e8ce-45ec-41ce-ad5f-aca592e72798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:23.773597 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2e8ce-45ec-41ce-ad5f-aca592e72798 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:23.774581 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2e8ce-45ec-41ce-ad5f-aca592e72798 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:23.775048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2e8ce-45ec-41ce-ad5f-aca592e72798 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:23.891775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:23.902608 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2e8ce-45ec-41ce-ad5f-aca592e72798 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:23.905332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2e8ce-45ec-41ce-ad5f-aca592e72798 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:24.057040 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 630/1241] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:39:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:39:24.064256 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5403d-de18-4bb4-9a56-602423ab415e None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:24.114975 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:24.233378 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5403d-de18-4bb4-9a56-602423ab415e None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:24.293818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a16eda-4523-492f-87bb-104d2e3bc7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:24.294721 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a16eda-4523-492f-87bb-104d2e3bc7ef None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:24.295124 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a16eda-4523-492f-87bb-104d2e3bc7ef None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:24.295583 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a16eda-4523-492f-87bb-104d2e3bc7ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:24.311405 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a16eda-4523-492f-87bb-104d2e3bc7ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:24.313742 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a16eda-4523-492f-87bb-104d2e3bc7ef None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:24.343265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-60a16eda-4523-492f-87bb-104d2e3bc7ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:24.343265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:24.343265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:24.343265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:24.343265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:24.343265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:24.343265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:24.343265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:24.343265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:24.343265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:24.343265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:24.343265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:24.343265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:39:24.343265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:39:24.343265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:39:24.343265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:39:24.344381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:24.344381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:24.344381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:24.344381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:24.344381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:24.344381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:24.344381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:24.344381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:24.344381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:24.344381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:24.344381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:24.344381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:24.344381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:24.344381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:24.344381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:24.344381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:24.344381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:39:24.345847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:39:24.345847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:24.345847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:39:24.345847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 612/1242] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:24.350885 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2e8ce-45ec-41ce-ad5f-aca592e72798 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:24.502098 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:24.515665 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2e8ce-45ec-41ce-ad5f-aca592e72798 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:24.584075 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b111e0-e577-4b0f-b871-91c585da25af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:24.584885 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b111e0-e577-4b0f-b871-91c585da25af None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:24.585313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b111e0-e577-4b0f-b871-91c585da25af None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:24.585727 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b111e0-e577-4b0f-b871-91c585da25af None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:24.587617 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b111e0-e577-4b0f-b871-91c585da25af None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:24.587973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b111e0-e577-4b0f-b871-91c585da25af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:24.589773 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b111e0-e577-4b0f-b871-91c585da25af None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:24.606194 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 631/1243] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:24.612759 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a16eda-4523-492f-87bb-104d2e3bc7ef None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:24.712605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:24.748535 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a16eda-4523-492f-87bb-104d2e3bc7ef None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:24.787482 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc336a47-9d8c-454b-b332-eee6c4bf9861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:24.788247 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc336a47-9d8c-454b-b332-eee6c4bf9861 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:24.788401 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc336a47-9d8c-454b-b332-eee6c4bf9861 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:24.788696 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc336a47-9d8c-454b-b332-eee6c4bf9861 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:24.796879 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc336a47-9d8c-454b-b332-eee6c4bf9861 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:24.798374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc336a47-9d8c-454b-b332-eee6c4bf9861 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:24.813246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-dc336a47-9d8c-454b-b332-eee6c4bf9861 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:39:24.813246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:24.813246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:24.813246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:24.813246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:24.813246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:24.813246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:24.813246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:24.813246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:24.813246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:24.813246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:24.813246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:24.813246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:39:24.813246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:39:24.813246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:39:24.814490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:39:24.814490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:24.814490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:24.814490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:24.814490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:24.814490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:24.814490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:24.814490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:24.814490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:24.814490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:24.814490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:24.814490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:24.814490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:24.814490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:24.814490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:24.814490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:24.814490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:24.816070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:39:24.816070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:39:24.816070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:39:24.816070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:39:24.816070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:39:24.816070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:39:24.816070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:39:24.816070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:39:24.816070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 613/1244] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:39:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:24.820635 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b111e0-e577-4b0f-b871-91c585da25af None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:24.960718 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b111e0-e577-4b0f-b871-91c585da25af None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:25.011477 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed132379-5d0a-496f-a822-f6a114f7c218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:25.012252 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed132379-5d0a-496f-a822-f6a114f7c218 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:25.012708 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed132379-5d0a-496f-a822-f6a114f7c218 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:25.013757 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed132379-5d0a-496f-a822-f6a114f7c218 None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:25.015523 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed132379-5d0a-496f-a822-f6a114f7c218 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:25.015977 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed132379-5d0a-496f-a822-f6a114f7c218 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:25.018140 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed132379-5d0a-496f-a822-f6a114f7c218 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:25.035684 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 632/1245] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:39:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:25.044853 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc336a47-9d8c-454b-b332-eee6c4bf9861 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:25.199160 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc336a47-9d8c-454b-b332-eee6c4bf9861 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:25.245396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03ebee-37aa-4f5a-abed-cc43ce36cd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:25.245960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03ebee-37aa-4f5a-abed-cc43ce36cd73 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:25.246238 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03ebee-37aa-4f5a-abed-cc43ce36cd73 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:25.246599 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03ebee-37aa-4f5a-abed-cc43ce36cd73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:25.247434 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03ebee-37aa-4f5a-abed-cc43ce36cd73 None admin] RBAC: Adding query filter params (role.id=5e5c4aa158a845b981b0e847f8bd47a6, scope.project.id=4416325d266642f3a786ff9f16c827aa, user.id=3a3274d404cb403bbf272ce023aa5e0c) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:25.247793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03ebee-37aa-4f5a-abed-cc43ce36cd73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:25.249264 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03ebee-37aa-4f5a-abed-cc43ce36cd73 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:25.256286 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 614/1246] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:39:25 2022] GET /identity/v3/role_assignments?user.id=3a3274d404cb403bbf272ce023aa5e0c&scope.project.id=4416325d266642f3a786ff9f16c827aa&role.id=5e5c4aa158a845b981b0e847f8bd47a6 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:27.720040 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ed852-0183-4edf-b8c8-4d4ecc879410 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:27.720649 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ed852-0183-4edf-b8c8-4d4ecc879410 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:27.721153 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ed852-0183-4edf-b8c8-4d4ecc879410 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:27.723845 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 633/1247] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:39:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:39:27.734483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ccfa9-5a37-41ac-bf00-41bb0d427e6a None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:27.735081 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ccfa9-5a37-41ac-bf00-41bb0d427e6a None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:27.735614 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ccfa9-5a37-41ac-bf00-41bb0d427e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:27.748539 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:27.772292 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-e36ccfa9-5a37-41ac-bf00-41bb0d427e6a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:27.775082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e36ccfa9-5a37-41ac-bf00-41bb0d427e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:27.885796 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 615/1248] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:39:28.179615 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ed852-0183-4edf-b8c8-4d4ecc879410 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:28.203306 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:28.340960 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ed852-0183-4edf-b8c8-4d4ecc879410 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:28.393837 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bfb9c-3668-40e5-b266-616782bf7bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:28.394509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bfb9c-3668-40e5-b266-616782bf7bd0 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:28.394810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bfb9c-3668-40e5-b266-616782bf7bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:28.395078 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bfb9c-3668-40e5-b266-616782bf7bd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:28.416313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525bfb9c-3668-40e5-b266-616782bf7bd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:28.425552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-525bfb9c-3668-40e5-b266-616782bf7bd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:39:28.425552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:28.425552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:28.425552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:28.425552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:28.425552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:28.425552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:28.425552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:28.425552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:28.425552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:28.425552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:28.425552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:28.425552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:28.425552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:28.425552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:28.425552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:28.427351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:28.427351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:28.427351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:28.427351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:28.427351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:28.427351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:28.427351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:28.427351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:28.427351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:28.427351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:28.427351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:28.427351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:28.427351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:28.427351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:28.427351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:28.427351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:28.428960 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:28.428960 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:28.428960 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:28.428960 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:28.428960 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:28.428960 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:28.428960 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:28.428960 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:28.428960 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:28.428960 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:28.428960 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:39:28.428960 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:39:28.428960 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 634/1249] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:39:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:28.437715 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ccfa9-5a37-41ac-bf00-41bb0d427e6a None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:28.616893 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ccfa9-5a37-41ac-bf00-41bb0d427e6a None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:28.668693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:28.676895 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c15d0-ccdf-4789-8c99-f3f3f3704cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:28.677755 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c15d0-ccdf-4789-8c99-f3f3f3704cd4 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:28.678157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c15d0-ccdf-4789-8c99-f3f3f3704cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:28.678553 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c15d0-ccdf-4789-8c99-f3f3f3704cd4 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:28.679638 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c15d0-ccdf-4789-8c99-f3f3f3704cd4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:28.680814 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c15d0-ccdf-4789-8c99-f3f3f3704cd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:28.682539 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c15d0-ccdf-4789-8c99-f3f3f3704cd4 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:28.698848 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 616/1250] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:28.706769 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bfb9c-3668-40e5-b266-616782bf7bd0 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:28.838026 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:28.886794 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bfb9c-3668-40e5-b266-616782bf7bd0 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:28.959881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a3080-b763-4bc1-ac45-30bb39e1f684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:28.960861 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a3080-b763-4bc1-ac45-30bb39e1f684 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:28.962174 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a3080-b763-4bc1-ac45-30bb39e1f684 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:28.962668 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a3080-b763-4bc1-ac45-30bb39e1f684 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:28.981598 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a3080-b763-4bc1-ac45-30bb39e1f684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:28.983940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a3080-b763-4bc1-ac45-30bb39e1f684 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:29.013439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-0c5a3080-b763-4bc1-ac45-30bb39e1f684 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:29.013439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:29.013439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:29.013439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:29.013439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:29.013439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:29.013439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:29.013439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:29.013439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:29.013439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:29.013439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:29.013439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:29.013439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:39:29.013439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:39:29.013439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:39:29.013439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:39:29.015486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:29.015486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:29.015486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:29.015486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:29.015486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:29.015486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:29.015486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:29.015486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:29.015486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:29.015486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:29.015486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:29.015486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:29.015486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:29.015486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:29.015486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:29.015486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:29.015486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:39:29.017626 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:39:29.017626 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:29.017626 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:39:29.017626 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 635/1251] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:29.028143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c15d0-ccdf-4789-8c99-f3f3f3704cd4 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:29.204561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c15d0-ccdf-4789-8c99-f3f3f3704cd4 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:29.257498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1af21-dc5a-4609-b9b7-0e55d0ed7d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:29.259118 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1af21-dc5a-4609-b9b7-0e55d0ed7d18 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:29.259392 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1af21-dc5a-4609-b9b7-0e55d0ed7d18 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:29.259718 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1af21-dc5a-4609-b9b7-0e55d0ed7d18 None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:29.260387 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1af21-dc5a-4609-b9b7-0e55d0ed7d18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:29.260861 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1af21-dc5a-4609-b9b7-0e55d0ed7d18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:29.263625 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1af21-dc5a-4609-b9b7-0e55d0ed7d18 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:29.285609 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 617/1252] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:29.294633 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a3080-b763-4bc1-ac45-30bb39e1f684 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:29.489334 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a3080-b763-4bc1-ac45-30bb39e1f684 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:29.540424 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:29.553323 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d66eb7-2709-4513-b739-a116f6f5d69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:29.554104 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d66eb7-2709-4513-b739-a116f6f5d69c None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:29.554384 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d66eb7-2709-4513-b739-a116f6f5d69c None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:29.554756 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d66eb7-2709-4513-b739-a116f6f5d69c None admin] PATH_INFO: `/v3/users/placement` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:29.566408 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d66eb7-2709-4513-b739-a116f6f5d69c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:29.568073 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d66eb7-2709-4513-b739-a116f6f5d69c None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:29.581227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-80d66eb7-2709-4513-b739-a116f6f5d69c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:39:29.581227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:29.581227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:29.581227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:29.581227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:29.581227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:29.581227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:29.581227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:29.581227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:29.581227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:29.581227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:29.581227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:29.581227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:39:29.581227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:39:29.581227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:39:29.581227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:39:29.583091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:29.583091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:29.583091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:39:29.583091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:39:29.583091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:39:29.583091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:39:29.583091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:29.583091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:29.583091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:29.583091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:29.583091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:29.583091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:29.583091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:29.583091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:29.583091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:29.583091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:29.583091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:29.583091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:29.585029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:29.585029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:29.585029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:39:29.585029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:39:29.585029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:39:29.585029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:39:29.585029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:39:29.585029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:39:29.585029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:39:29.585029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:39:29.585029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 636/1253] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:29.593130 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1af21-dc5a-4609-b9b7-0e55d0ed7d18 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:29.674833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:29.763102 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1af21-dc5a-4609-b9b7-0e55d0ed7d18 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:29.826206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f7485-12cd-49b0-a691-289b9d88f6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:29.826931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f7485-12cd-49b0-a691-289b9d88f6f1 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:29.827243 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f7485-12cd-49b0-a691-289b9d88f6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:29.827555 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f7485-12cd-49b0-a691-289b9d88f6f1 None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:29.828423 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f7485-12cd-49b0-a691-289b9d88f6f1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:29.828719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f7485-12cd-49b0-a691-289b9d88f6f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:29.830275 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f7485-12cd-49b0-a691-289b9d88f6f1 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:29.864083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 618/1254] 10.222.0.94 () {56 vars in 1143 bytes} [Wed Aug 24 04:39:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:29.865562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d66eb7-2709-4513-b739-a116f6f5d69c None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:30.043514 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d66eb7-2709-4513-b739-a116f6f5d69c None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:30.104670 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428f5c5-53a3-468f-b6c9-c7bb9135cf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:30.105555 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428f5c5-53a3-468f-b6c9-c7bb9135cf6f None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:30.105869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428f5c5-53a3-468f-b6c9-c7bb9135cf6f None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:30.106286 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428f5c5-53a3-468f-b6c9-c7bb9135cf6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:30.194776 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:30.218881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428f5c5-53a3-468f-b6c9-c7bb9135cf6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:30.221782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428f5c5-53a3-468f-b6c9-c7bb9135cf6f None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:30.387406 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 637/1255] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:39:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:39:30.394569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f7485-12cd-49b0-a691-289b9d88f6f1 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:30.520936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f7485-12cd-49b0-a691-289b9d88f6f1 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:30.536953 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:30.563167 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedf5cd-c522-4962-9ab9-dae1593c15bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:30.563167 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedf5cd-c522-4962-9ab9-dae1593c15bb None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:30.563167 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedf5cd-c522-4962-9ab9-dae1593c15bb None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:30.563912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedf5cd-c522-4962-9ab9-dae1593c15bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:30.580180 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedf5cd-c522-4962-9ab9-dae1593c15bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:30.584263 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedf5cd-c522-4962-9ab9-dae1593c15bb None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:30.607837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-ddedf5cd-c522-4962-9ab9-dae1593c15bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:30.607837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:30.607837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:30.607837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:30.607837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:30.607837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:30.607837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:30.607837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:30.607837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:30.607837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:30.607837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:30.607837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:30.607837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:39:30.607837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:39:30.607837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:39:30.607837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:39:30.609689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:30.609689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:30.609689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:30.609689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:30.609689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:30.609689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:30.609689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:30.609689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:30.609689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:30.609689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:30.609689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:30.609689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:30.609689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:30.609689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:30.609689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:30.609689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:30.609689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:39:30.610887 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:39:30.610887 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:30.610887 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:39:30.610887 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 619/1256] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:30.615959 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428f5c5-53a3-468f-b6c9-c7bb9135cf6f None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:30.723664 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:30.744458 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428f5c5-53a3-468f-b6c9-c7bb9135cf6f None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:30.809122 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb6e0f-432b-40b0-9a9c-dbb516c4c9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:30.810037 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb6e0f-432b-40b0-9a9c-dbb516c4c9a2 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:30.810394 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb6e0f-432b-40b0-9a9c-dbb516c4c9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:30.810790 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb6e0f-432b-40b0-9a9c-dbb516c4c9a2 None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:30.811618 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb6e0f-432b-40b0-9a9c-dbb516c4c9a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:30.811993 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb6e0f-432b-40b0-9a9c-dbb516c4c9a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:30.813692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb6e0f-432b-40b0-9a9c-dbb516c4c9a2 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:30.828185 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 638/1257] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:30.838707 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedf5cd-c522-4962-9ab9-dae1593c15bb None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:30.979891 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedf5cd-c522-4962-9ab9-dae1593c15bb None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:31.031774 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ad9ec-9a02-4602-a062-392e1c3af644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:31.032658 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ad9ec-9a02-4602-a062-392e1c3af644 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:31.033163 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ad9ec-9a02-4602-a062-392e1c3af644 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:31.033593 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ad9ec-9a02-4602-a062-392e1c3af644 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:31.045385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ad9ec-9a02-4602-a062-392e1c3af644 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:31.048144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ad9ec-9a02-4602-a062-392e1c3af644 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:31.069941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-3e9ad9ec-9a02-4602-a062-392e1c3af644 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:39:31.069941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:31.069941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:31.069941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:31.069941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:31.069941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:31.069941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:31.069941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:31.069941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:31.069941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:31.069941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:31.069941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:31.069941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:39:31.069941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:39:31.069941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:39:31.072596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:39:31.072596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:31.072596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:31.072596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:31.072596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:31.072596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:31.072596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:31.072596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:31.072596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:31.072596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:31.072596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:31.072596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:31.072596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:31.072596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:31.072596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:31.072596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:31.072596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:31.074906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:39:31.074906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:39:31.074906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:39:31.074906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:39:31.074906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:39:31.074906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:39:31.074906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:39:31.074906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:39:31.074906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 620/1258] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:39:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:31.082572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb6e0f-432b-40b0-9a9c-dbb516c4c9a2 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:31.253737 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb6e0f-432b-40b0-9a9c-dbb516c4c9a2 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:31.310338 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd802a7-02c6-41c0-a1ee-67a8eab7c5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:31.311485 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd802a7-02c6-41c0-a1ee-67a8eab7c5cc None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:31.311980 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd802a7-02c6-41c0-a1ee-67a8eab7c5cc None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:31.312408 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd802a7-02c6-41c0-a1ee-67a8eab7c5cc None admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:31.313843 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd802a7-02c6-41c0-a1ee-67a8eab7c5cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:31.314407 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd802a7-02c6-41c0-a1ee-67a8eab7c5cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:31.317317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd802a7-02c6-41c0-a1ee-67a8eab7c5cc None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:31.349916 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 639/1259] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:39:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:31.354775 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ad9ec-9a02-4602-a062-392e1c3af644 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:31.415834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:31.565840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ad9ec-9a02-4602-a062-392e1c3af644 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:31.613932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707dc404-85d8-4903-b7bd-1c9b204f63b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:31.615084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dc404-85d8-4903-b7bd-1c9b204f63b9 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:31.615546 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dc404-85d8-4903-b7bd-1c9b204f63b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:31.616203 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dc404-85d8-4903-b7bd-1c9b204f63b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:31.618157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707dc404-85d8-4903-b7bd-1c9b204f63b9 None admin] RBAC: Adding query filter params (role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2, scope.project.id=4416325d266642f3a786ff9f16c827aa, user.id=3a3274d404cb403bbf272ce023aa5e0c) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:31.618863 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707dc404-85d8-4903-b7bd-1c9b204f63b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:31.621689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707dc404-85d8-4903-b7bd-1c9b204f63b9 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:31.635340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 621/1260] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:39:31 2022] GET /identity/v3/role_assignments?user.id=3a3274d404cb403bbf272ce023aa5e0c&scope.project.id=4416325d266642f3a786ff9f16c827aa&role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:34.111934 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a93ab-b8a7-40d6-a9f4-a33f8f239d7f None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:34.112488 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a93ab-b8a7-40d6-a9f4-a33f8f239d7f None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:34.112488 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a93ab-b8a7-40d6-a9f4-a33f8f239d7f None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:34.114315 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 640/1261] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:34.121673 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8676ad5-6dee-4835-93c7-a3f196c85966 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:34.122535 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8676ad5-6dee-4835-93c7-a3f196c85966 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:34.122535 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8676ad5-6dee-4835-93c7-a3f196c85966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:34.150833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-c8676ad5-6dee-4835-93c7-a3f196c85966 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:34.152199 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-c8676ad5-6dee-4835-93c7-a3f196c85966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:34.252899 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 622/1262] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:39:34.559279 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a93ab-b8a7-40d6-a9f4-a33f8f239d7f None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:34.574005 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:34.718746 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a93ab-b8a7-40d6-a9f4-a33f8f239d7f None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:34.785953 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b8815-0eed-4c60-ac53-4213a8418458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:34.786947 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b8815-0eed-4c60-ac53-4213a8418458 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:34.787438 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b8815-0eed-4c60-ac53-4213a8418458 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:34.787858 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b8815-0eed-4c60-ac53-4213a8418458 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:34.810506 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b8815-0eed-4c60-ac53-4213a8418458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:34.819734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-052b8815-0eed-4c60-ac53-4213a8418458 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:39:34.819734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:34.819734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:34.819734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:34.819734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:34.819734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:34.819734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:34.819734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:34.819734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:34.819734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:34.819734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:34.819734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:34.819734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:34.819734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:34.819734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:34.819734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:34.821562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:34.821562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:34.821562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:34.821562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:34.821562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:34.821562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:34.821562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:34.821562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:34.821562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:34.821562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:34.821562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:34.821562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:34.821562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:34.821562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:34.821562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:34.821562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:34.822630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:34.822630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:34.822630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:34.822630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:34.822630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:34.822630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:34.822630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:34.822630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:34.822630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:34.822630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:34.822630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:39:34.822630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:39:34.823341 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 641/1263] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:39:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:34.836504 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8676ad5-6dee-4835-93c7-a3f196c85966 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:34.874482 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:35.043446 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8676ad5-6dee-4835-93c7-a3f196c85966 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:35.108444 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8146f8-877d-4171-ad1b-c7ba4672c727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:35.109396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8146f8-877d-4171-ad1b-c7ba4672c727 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:35.109931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8146f8-877d-4171-ad1b-c7ba4672c727 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:35.110420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8146f8-877d-4171-ad1b-c7ba4672c727 None admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:35.111669 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8146f8-877d-4171-ad1b-c7ba4672c727 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:35.112219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8146f8-877d-4171-ad1b-c7ba4672c727 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:35.114887 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8146f8-877d-4171-ad1b-c7ba4672c727 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:35.131681 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 623/1264] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:35.138785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b8815-0eed-4c60-ac53-4213a8418458 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:35.231650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:35.286976 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b8815-0eed-4c60-ac53-4213a8418458 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:35.329806 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b1898-f54e-4b98-a529-a3d2055425d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:35.330522 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b1898-f54e-4b98-a529-a3d2055425d9 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:35.330841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b1898-f54e-4b98-a529-a3d2055425d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:35.331159 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b1898-f54e-4b98-a529-a3d2055425d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:35.345022 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b1898-f54e-4b98-a529-a3d2055425d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:35.346576 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b1898-f54e-4b98-a529-a3d2055425d9 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:35.365825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-672b1898-f54e-4b98-a529-a3d2055425d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:35.365825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:35.365825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:35.365825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:35.365825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:35.365825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:35.365825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:35.365825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:35.365825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:35.365825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:35.365825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:35.365825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:35.365825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:39:35.365825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:39:35.365825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:39:35.365825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:39:35.367641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:35.367641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:35.367641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:35.367641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:35.367641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:35.367641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:35.367641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:35.367641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:35.367641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:35.367641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:35.367641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:35.367641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:35.367641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:35.367641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:35.367641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:35.367641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:35.367641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:39:35.369693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:39:35.369693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:35.369693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:39:35.369693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 642/1265] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:35.375599 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8146f8-877d-4171-ad1b-c7ba4672c727 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:35.497917 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:35.541536 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8146f8-877d-4171-ad1b-c7ba4672c727 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:35.603595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec2cb6-aace-47f9-8a28-9ad2e2e8d3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:35.604274 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec2cb6-aace-47f9-8a28-9ad2e2e8d3a0 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:35.604603 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec2cb6-aace-47f9-8a28-9ad2e2e8d3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:35.604897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec2cb6-aace-47f9-8a28-9ad2e2e8d3a0 None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:35.605660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec2cb6-aace-47f9-8a28-9ad2e2e8d3a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:35.606010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec2cb6-aace-47f9-8a28-9ad2e2e8d3a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:35.607495 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec2cb6-aace-47f9-8a28-9ad2e2e8d3a0 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:35.623039 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 624/1266] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:35.629567 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b1898-f54e-4b98-a529-a3d2055425d9 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:35.828672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b1898-f54e-4b98-a529-a3d2055425d9 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:35.856239 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:35.876170 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945e7fc-9cdb-4443-8f03-55bd36b7e97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:35.876863 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945e7fc-9cdb-4443-8f03-55bd36b7e97d None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:35.877246 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945e7fc-9cdb-4443-8f03-55bd36b7e97d None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:35.877649 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945e7fc-9cdb-4443-8f03-55bd36b7e97d None admin] PATH_INFO: `/v3/users/placement` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:35.887962 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945e7fc-9cdb-4443-8f03-55bd36b7e97d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:35.889512 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945e7fc-9cdb-4443-8f03-55bd36b7e97d None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:35.903344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-8945e7fc-9cdb-4443-8f03-55bd36b7e97d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:39:35.903344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:35.903344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:35.903344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:35.903344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:35.903344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:35.903344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:35.903344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:35.903344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:35.903344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:35.903344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:35.903344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:35.903344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:39:35.903344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:39:35.903344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:39:35.903344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:39:35.907116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:35.907116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:35.907116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:39:35.907116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:39:35.907116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:39:35.907116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:39:35.907116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:35.907116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:35.907116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:35.907116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:35.907116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:35.907116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:35.907116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:35.907116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:35.907116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:35.907116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:35.907116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:35.907116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:35.909264 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:35.909264 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:35.909264 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:39:35.909264 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:39:35.909264 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:39:35.909264 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:39:35.909264 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:39:35.909264 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:39:35.909264 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:39:35.909264 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:39:35.909264 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 643/1267] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:35.914036 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec2cb6-aace-47f9-8a28-9ad2e2e8d3a0 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:36.084780 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec2cb6-aace-47f9-8a28-9ad2e2e8d3a0 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:36.143618 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a9e12-a3fd-4de0-919a-1a782a0fc2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:36.144540 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a9e12-a3fd-4de0-919a-1a782a0fc2c5 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:36.145029 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a9e12-a3fd-4de0-919a-1a782a0fc2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:36.145520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a9e12-a3fd-4de0-919a-1a782a0fc2c5 None admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:36.146833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a9e12-a3fd-4de0-919a-1a782a0fc2c5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:36.147218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a9e12-a3fd-4de0-919a-1a782a0fc2c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:36.150649 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a9e12-a3fd-4de0-919a-1a782a0fc2c5 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:36.168079 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:36.185813 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 625/1268] 10.222.0.94 () {56 vars in 1143 bytes} [Wed Aug 24 04:39:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:36.192817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945e7fc-9cdb-4443-8f03-55bd36b7e97d None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:36.398704 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945e7fc-9cdb-4443-8f03-55bd36b7e97d None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:36.468272 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5758c9-69bb-4ca2-91f8-d04e95fe296c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:36.469372 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5758c9-69bb-4ca2-91f8-d04e95fe296c None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:36.469914 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5758c9-69bb-4ca2-91f8-d04e95fe296c None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:36.470397 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5758c9-69bb-4ca2-91f8-d04e95fe296c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:36.498133 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5758c9-69bb-4ca2-91f8-d04e95fe296c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:36.500937 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5758c9-69bb-4ca2-91f8-d04e95fe296c None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:36.527524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-8e5758c9-69bb-4ca2-91f8-d04e95fe296c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:36.527524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:36.527524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:36.527524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:36.527524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:36.527524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:36.527524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:36.527524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:36.527524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:36.527524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:36.527524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:36.527524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:36.527524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:39:36.527524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:39:36.527524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:39:36.527524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:39:36.529691 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:36.529691 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:36.529691 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:36.529691 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:36.529691 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:36.529691 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:36.529691 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:36.529691 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:36.529691 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:36.529691 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:36.529691 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:36.529691 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:36.529691 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:36.529691 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:36.529691 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:36.529691 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:36.529691 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:39:36.531437 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:39:36.531437 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:36.531437 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:39:36.531437 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 644/1269] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:36.536331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a9e12-a3fd-4de0-919a-1a782a0fc2c5 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:36.669584 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a9e12-a3fd-4de0-919a-1a782a0fc2c5 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:36.723411 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c18b30-43dd-43f2-9670-d5f12c214443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:36.724431 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c18b30-43dd-43f2-9670-d5f12c214443 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:36.724905 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c18b30-43dd-43f2-9670-d5f12c214443 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:36.725368 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c18b30-43dd-43f2-9670-d5f12c214443 None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:36.727123 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c18b30-43dd-43f2-9670-d5f12c214443 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:36.727537 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c18b30-43dd-43f2-9670-d5f12c214443 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:36.729169 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c18b30-43dd-43f2-9670-d5f12c214443 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:36.754126 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 626/1270] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:36.760346 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5758c9-69bb-4ca2-91f8-d04e95fe296c None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:36.800594 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:36.899424 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5758c9-69bb-4ca2-91f8-d04e95fe296c None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:36.942202 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7136598-beb3-4a7a-9133-6c2856cab09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:36.943016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7136598-beb3-4a7a-9133-6c2856cab09a None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:36.943411 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7136598-beb3-4a7a-9133-6c2856cab09a None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:36.943669 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7136598-beb3-4a7a-9133-6c2856cab09a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:36.953059 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7136598-beb3-4a7a-9133-6c2856cab09a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:36.954685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7136598-beb3-4a7a-9133-6c2856cab09a None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:36.968940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-b7136598-beb3-4a7a-9133-6c2856cab09a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:39:36.968940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:36.968940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:36.968940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:36.968940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:36.968940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:36.968940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:36.968940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:36.968940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:36.968940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:36.968940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:36.968940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:36.968940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:39:36.968940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:39:36.968940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:39:36.970775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:39:36.970775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:36.970775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:36.970775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:36.970775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:36.970775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:36.970775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:36.970775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:36.970775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:36.970775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:36.970775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:36.970775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:36.970775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:36.970775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:36.970775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:36.970775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:36.970775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:36.972596 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:39:36.972596 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:39:36.972596 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:39:36.972596 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:39:36.972596 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:39:36.972596 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:39:36.972596 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:39:36.972596 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:39:36.972596 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 645/1271] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:39:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:36.980344 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c18b30-43dd-43f2-9670-d5f12c214443 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:37.081358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:37.165532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c18b30-43dd-43f2-9670-d5f12c214443 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:37.234887 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61c73a-56ac-419b-95ae-848827e978d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:37.235845 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61c73a-56ac-419b-95ae-848827e978d5 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:37.236323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61c73a-56ac-419b-95ae-848827e978d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:37.236759 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61c73a-56ac-419b-95ae-848827e978d5 None admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:37.238115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61c73a-56ac-419b-95ae-848827e978d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:37.238662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61c73a-56ac-419b-95ae-848827e978d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:37.241813 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61c73a-56ac-419b-95ae-848827e978d5 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:37.266496 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 627/1272] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:39:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:37.277128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7136598-beb3-4a7a-9133-6c2856cab09a None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:37.427369 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:37.438671 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7136598-beb3-4a7a-9133-6c2856cab09a None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:37.488931 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a15bb-12c1-4992-82e4-d09e6d7e7a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:37.489907 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a15bb-12c1-4992-82e4-d09e6d7e7a11 None admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:37.490275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a15bb-12c1-4992-82e4-d09e6d7e7a11 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:37.490632 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a15bb-12c1-4992-82e4-d09e6d7e7a11 None admin] PATH_INFO: `/v3/projects/4416325d266642f3a786ff9f16c827aa/users/3a3274d404cb403bbf272ce023aa5e0c/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:37.493451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a15bb-12c1-4992-82e4-d09e6d7e7a11 None admin] RBAC: Authorizing `identity:create_grant(project_id=4416325d266642f3a786ff9f16c827aa, user_id=3a3274d404cb403bbf272ce023aa5e0c, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:37.495086 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a15bb-12c1-4992-82e4-d09e6d7e7a11 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:37.521252 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 646/1273] 10.222.0.94 () {58 vars in 1439 bytes} [Wed Aug 24 04:39:37 2022] PUT /identity/v3/projects/4416325d266642f3a786ff9f16c827aa/users/3a3274d404cb403bbf272ce023aa5e0c/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:39:39.909798 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18827133-1856-4f60-a093-e3a9381fb7b3 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:39.910763 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18827133-1856-4f60-a093-e3a9381fb7b3 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:39.910763 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18827133-1856-4f60-a093-e3a9381fb7b3 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:39.912675 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 628/1274] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:39:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:39.920637 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320d5bb-f9a3-43a4-9c8e-567f709c03e5 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:39.921288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320d5bb-f9a3-43a4-9c8e-567f709c03e5 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:39.921837 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320d5bb-f9a3-43a4-9c8e-567f709c03e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:39.956979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-5320d5bb-f9a3-43a4-9c8e-567f709c03e5 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:39.958667 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-5320d5bb-f9a3-43a4-9c8e-567f709c03e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:40.065346 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 647/1275] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:39:40.372195 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18827133-1856-4f60-a093-e3a9381fb7b3 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:40.550650 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18827133-1856-4f60-a093-e3a9381fb7b3 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:40.586574 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:40.616164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c653359-66de-49f5-96f1-67317dc143aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:40.617645 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c653359-66de-49f5-96f1-67317dc143aa None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:40.617957 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c653359-66de-49f5-96f1-67317dc143aa None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:40.618226 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c653359-66de-49f5-96f1-67317dc143aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:40.630997 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c653359-66de-49f5-96f1-67317dc143aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:40.637375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-7c653359-66de-49f5-96f1-67317dc143aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:39:40.637375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:40.637375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:40.637375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:40.637375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:40.637375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:40.637375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:40.637375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:40.637375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:40.637375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:40.637375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:40.637375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:40.637375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:40.637375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:40.637375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:40.637375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:40.640211 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:40.640211 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:40.640211 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:40.640211 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:40.640211 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:40.640211 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:40.640211 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:40.640211 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:40.640211 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:40.640211 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:40.640211 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:40.640211 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:40.640211 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:40.640211 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:40.640211 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:40.640211 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:40.642904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:40.642904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:40.642904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:40.642904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:40.642904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:40.642904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:40.642904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:40.642904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:40.642904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:40.642904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:40.642904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:39:40.642904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:39:40.642904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 629/1276] 10.222.0.94 () {56 vars in 1096 bytes} [Wed Aug 24 04:39:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:40.651805 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320d5bb-f9a3-43a4-9c8e-567f709c03e5 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:40.799358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:40.836830 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320d5bb-f9a3-43a4-9c8e-567f709c03e5 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:40.904505 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c72bc-5975-46ca-ae28-7a4ad271e60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:40.905477 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c72bc-5975-46ca-ae28-7a4ad271e60e None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:40.906001 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c72bc-5975-46ca-ae28-7a4ad271e60e None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:40.906508 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c72bc-5975-46ca-ae28-7a4ad271e60e None admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:40.907612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c72bc-5975-46ca-ae28-7a4ad271e60e None admin] RBAC: Adding query filter params (name=admin) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:40.908186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c72bc-5975-46ca-ae28-7a4ad271e60e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:40.910860 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c72bc-5975-46ca-ae28-7a4ad271e60e None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:40.931577 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 648/1277] 10.222.0.94 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:40.938148 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c653359-66de-49f5-96f1-67317dc143aa None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:41.075459 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c653359-66de-49f5-96f1-67317dc143aa None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:41.124317 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4460a-e601-4be9-8e63-2d6bcdb2a564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:41.125066 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4460a-e601-4be9-8e63-2d6bcdb2a564 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:41.125394 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4460a-e601-4be9-8e63-2d6bcdb2a564 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:41.125763 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4460a-e601-4be9-8e63-2d6bcdb2a564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:41.142489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4460a-e601-4be9-8e63-2d6bcdb2a564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:41.145263 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4460a-e601-4be9-8e63-2d6bcdb2a564 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:41.165945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-0ea4460a-e601-4be9-8e63-2d6bcdb2a564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:41.165945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:41.165945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:41.165945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:41.165945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:41.165945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:41.165945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:41.165945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:41.165945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:41.165945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:41.165945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:41.165945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:41.165945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:39:41.165945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:39:41.165945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:39:41.165945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:39:41.168433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:41.168433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:41.168433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:41.168433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:41.168433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:41.168433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:41.168433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:41.168433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:41.168433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:41.168433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:41.168433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:41.168433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:41.168433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:41.168433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:41.168433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:41.168433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:41.168433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:39:41.170696 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:39:41.170696 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:41.170696 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:39:41.170696 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 630/1278] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:41.174423 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c72bc-5975-46ca-ae28-7a4ad271e60e None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:41.375862 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c72bc-5975-46ca-ae28-7a4ad271e60e None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:41.446166 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb1723-9703-4708-a81c-04ff4001551d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:41.447183 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb1723-9703-4708-a81c-04ff4001551d None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:41.447674 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb1723-9703-4708-a81c-04ff4001551d None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:41.448149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb1723-9703-4708-a81c-04ff4001551d None admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:41.449451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb1723-9703-4708-a81c-04ff4001551d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:41.449997 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb1723-9703-4708-a81c-04ff4001551d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:41.452785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb1723-9703-4708-a81c-04ff4001551d None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:41.479905 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 649/1279] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:41.490573 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4460a-e601-4be9-8e63-2d6bcdb2a564 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:41.555089 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:41.699231 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4460a-e601-4be9-8e63-2d6bcdb2a564 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:41.768955 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765515e-8997-4e1c-a2e2-4474b4ed7d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:41.770150 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765515e-8997-4e1c-a2e2-4474b4ed7d02 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:41.770634 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765515e-8997-4e1c-a2e2-4474b4ed7d02 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:41.771111 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765515e-8997-4e1c-a2e2-4474b4ed7d02 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:41.787125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765515e-8997-4e1c-a2e2-4474b4ed7d02 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:41.790783 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765515e-8997-4e1c-a2e2-4474b4ed7d02 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:41.813708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-f765515e-8997-4e1c-a2e2-4474b4ed7d02 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:39:41.813708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:41.813708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:41.813708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:41.813708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:41.813708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:41.813708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:41.813708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:41.813708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:41.813708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:41.813708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:41.813708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:41.813708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:39:41.813708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:39:41.813708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:39:41.813708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:39:41.818467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:41.818467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:41.818467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:39:41.818467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:39:41.818467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:39:41.818467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:39:41.818467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:41.818467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:41.818467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:41.818467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:41.818467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:41.818467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:41.818467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:41.818467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:41.818467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:41.818467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:41.818467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:41.818467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:41.820693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:41.820693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:41.820693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:39:41.820693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:39:41.820693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:39:41.820693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:39:41.820693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:39:41.820693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:39:41.820693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:39:41.820693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:39:41.820693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 631/1280] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:41.824887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb1723-9703-4708-a81c-04ff4001551d None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:41.830864 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:42.017776 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb1723-9703-4708-a81c-04ff4001551d None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:42.087158 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cbf76-c602-43be-b189-fba71f13a145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:42.087998 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cbf76-c602-43be-b189-fba71f13a145 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:42.088357 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cbf76-c602-43be-b189-fba71f13a145 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:42.088853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cbf76-c602-43be-b189-fba71f13a145 None admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:42.090293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0cbf76-c602-43be-b189-fba71f13a145 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:42.090807 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0cbf76-c602-43be-b189-fba71f13a145 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:42.093653 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0cbf76-c602-43be-b189-fba71f13a145 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:42.129899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 650/1281] 10.222.0.94 () {56 vars in 1143 bytes} [Wed Aug 24 04:39:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:42.140704 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765515e-8997-4e1c-a2e2-4474b4ed7d02 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:42.272632 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:42.285744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765515e-8997-4e1c-a2e2-4474b4ed7d02 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:42.327378 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1580fa0-a8ef-403f-9d77-cc18a52c8f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:42.327997 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1580fa0-a8ef-403f-9d77-cc18a52c8f34 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:42.328280 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1580fa0-a8ef-403f-9d77-cc18a52c8f34 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:42.328556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1580fa0-a8ef-403f-9d77-cc18a52c8f34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:42.417359 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1580fa0-a8ef-403f-9d77-cc18a52c8f34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:42.419012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1580fa0-a8ef-403f-9d77-cc18a52c8f34 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:42.547477 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:42.562579 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 632/1282] 10.222.0.94 () {58 vars in 1282 bytes} [Wed Aug 24 04:39:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:39:42.569017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cbf76-c602-43be-b189-fba71f13a145 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:42.680411 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:42.733896 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cbf76-c602-43be-b189-fba71f13a145 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:42.782815 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148c2f8-ad5c-4b7f-a598-4a2d07eb62d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:42.783936 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148c2f8-ad5c-4b7f-a598-4a2d07eb62d3 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:42.784467 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148c2f8-ad5c-4b7f-a598-4a2d07eb62d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:42.784960 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148c2f8-ad5c-4b7f-a598-4a2d07eb62d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:42.806782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148c2f8-ad5c-4b7f-a598-4a2d07eb62d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:42.809560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148c2f8-ad5c-4b7f-a598-4a2d07eb62d3 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:42.839546 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-b148c2f8-ad5c-4b7f-a598-4a2d07eb62d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:42.839546 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:42.839546 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:42.839546 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:42.839546 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:42.839546 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:42.839546 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:42.839546 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:42.839546 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:42.839546 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:42.839546 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:42.839546 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:42.839546 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:39:42.839546 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:39:42.839546 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:39:42.839546 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:39:42.841385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:42.841385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:42.841385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:42.841385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:42.841385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:42.841385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:42.841385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:42.841385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:42.841385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:42.841385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:42.841385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:42.841385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:42.841385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:42.841385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:42.841385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:42.841385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:42.841385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:39:42.843507 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:39:42.843507 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:42.843507 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:39:42.843507 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 651/1283] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:42.852101 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1580fa0-a8ef-403f-9d77-cc18a52c8f34 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:43.013283 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1580fa0-a8ef-403f-9d77-cc18a52c8f34 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:43.079091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a913c18-5e9c-4bb3-8630-fc397e170872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:43.079963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a913c18-5e9c-4bb3-8630-fc397e170872 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:43.080432 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a913c18-5e9c-4bb3-8630-fc397e170872 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:43.080946 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a913c18-5e9c-4bb3-8630-fc397e170872 None admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:43.082234 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a913c18-5e9c-4bb3-8630-fc397e170872 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:43.082796 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a913c18-5e9c-4bb3-8630-fc397e170872 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:43.085317 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a913c18-5e9c-4bb3-8630-fc397e170872 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:43.109054 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 633/1284] 10.222.0.94 () {56 vars in 1109 bytes} [Wed Aug 24 04:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:43.119841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148c2f8-ad5c-4b7f-a598-4a2d07eb62d3 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:43.321865 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148c2f8-ad5c-4b7f-a598-4a2d07eb62d3 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:43.350057 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:43.388055 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeee4fe-e0dc-4ebc-bd9f-c38494b4ec10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:43.389121 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeee4fe-e0dc-4ebc-bd9f-c38494b4ec10 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:43.389640 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeee4fe-e0dc-4ebc-bd9f-c38494b4ec10 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:43.390028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeee4fe-e0dc-4ebc-bd9f-c38494b4ec10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:43.403610 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeee4fe-e0dc-4ebc-bd9f-c38494b4ec10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:43.406380 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeee4fe-e0dc-4ebc-bd9f-c38494b4ec10 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:43.428447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application [None req-caeee4fe-e0dc-4ebc-bd9f-c38494b4ec10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:39:43.428447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:43.428447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:43.428447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:43.428447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:43.428447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:43.428447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:43.428447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:43.428447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:43.428447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:43.428447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:43.428447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:43.428447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:39:43.428447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:39:43.428447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:39:43.432072 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:39:43.432072 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:43.432072 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:43.432072 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:43.432072 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:43.432072 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:43.432072 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:43.432072 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:43.432072 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:43.432072 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:43.432072 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:43.432072 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:43.432072 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:43.432072 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:43.432072 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:43.432072 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:43.432072 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:43.434228 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:39:43.434228 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:39:43.434228 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:39:43.434228 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:39:43.434228 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:39:43.434228 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:39:43.434228 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:39:43.434228 dv-cinder-854264-1-smb devstack@keystone.service[93412]: ERROR keystone.server.flask.application Aug 24 04:39:43.434228 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 652/1285] 10.222.0.94 () {56 vars in 1111 bytes} [Wed Aug 24 04:39:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:43.442265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a913c18-5e9c-4bb3-8630-fc397e170872 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:43.546350 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:43.650557 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a913c18-5e9c-4bb3-8630-fc397e170872 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:43.725099 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d54d66-92d5-4ca6-b579-1e25fbb66416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:43.727302 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d54d66-92d5-4ca6-b579-1e25fbb66416 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:43.728218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d54d66-92d5-4ca6-b579-1e25fbb66416 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:43.728866 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d54d66-92d5-4ca6-b579-1e25fbb66416 None admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:43.730732 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d54d66-92d5-4ca6-b579-1e25fbb66416 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:43.731736 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d54d66-92d5-4ca6-b579-1e25fbb66416 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:43.735412 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d54d66-92d5-4ca6-b579-1e25fbb66416 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:43.760781 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 634/1286] 10.222.0.94 () {56 vars in 1148 bytes} [Wed Aug 24 04:39:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:43.771033 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeee4fe-e0dc-4ebc-bd9f-c38494b4ec10 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:43.972302 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeee4fe-e0dc-4ebc-bd9f-c38494b4ec10 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:44.044081 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40fff0-7d66-4818-9179-1c02d80c2d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:44.045737 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40fff0-7d66-4818-9179-1c02d80c2d08 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:44.046485 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40fff0-7d66-4818-9179-1c02d80c2d08 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:44.047270 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40fff0-7d66-4818-9179-1c02d80c2d08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:44.048745 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40fff0-7d66-4818-9179-1c02d80c2d08 None admin] RBAC: Adding query filter params (role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2, scope.project.id=4416325d266642f3a786ff9f16c827aa, user.id=3a3274d404cb403bbf272ce023aa5e0c) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:44.049292 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40fff0-7d66-4818-9179-1c02d80c2d08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:44.052155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40fff0-7d66-4818-9179-1c02d80c2d08 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:44.065111 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 653/1287] 10.222.0.94 () {56 vars in 1374 bytes} [Wed Aug 24 04:39:43 2022] GET /identity/v3/role_assignments?user.id=3a3274d404cb403bbf272ce023aa5e0c&scope.project.id=4416325d266642f3a786ff9f16c827aa&role.id=4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:46.935307 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384694ca-a38b-4c4a-a7f5-964efdaa0600 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:46.936040 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384694ca-a38b-4c4a-a7f5-964efdaa0600 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:46.936040 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384694ca-a38b-4c4a-a7f5-964efdaa0600 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:46.937345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 635/1288] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:39:46.943639 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204628e2-25a3-4a14-bf7d-6d5d3e32bed4 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:46.944421 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204628e2-25a3-4a14-bf7d-6d5d3e32bed4 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:46.944574 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204628e2-25a3-4a14-bf7d-6d5d3e32bed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:46.974259 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-204628e2-25a3-4a14-bf7d-6d5d3e32bed4 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:46.976007 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-204628e2-25a3-4a14-bf7d-6d5d3e32bed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:47.019596 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:47.078421 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 654/1289] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:39:47.369520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384694ca-a38b-4c4a-a7f5-964efdaa0600 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:47.590113 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384694ca-a38b-4c4a-a7f5-964efdaa0600 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:47.614301 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:47.661337 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f65fcf-8d57-42b1-af1c-fd6835d6186b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:47.662416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f65fcf-8d57-42b1-af1c-fd6835d6186b None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:47.662927 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f65fcf-8d57-42b1-af1c-fd6835d6186b None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:47.663431 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f65fcf-8d57-42b1-af1c-fd6835d6186b None admin] PATH_INFO: `/v3/services/placement` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:47.665095 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f65fcf-8d57-42b1-af1c-fd6835d6186b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:47.667867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f65fcf-8d57-42b1-af1c-fd6835d6186b None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:47.686458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-f5f65fcf-8d57-42b1-af1c-fd6835d6186b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:39:47.686458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:47.686458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:39:47.686458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:39:47.686458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:39:47.686458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:39:47.686458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:39:47.686458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:39:47.686458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:39:47.686458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:39:47.686458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:39:47.686458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:39:47.686458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:47.686458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:47.686458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:47.686458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:47.686458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:47.688461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:47.688461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:47.688461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:47.688461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:47.688461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:47.688461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:47.688461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:39:47.688461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:39:47.688461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:39:47.688461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:39:47.688461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:47.688461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:47.688461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:47.688461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:47.688461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:47.688461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:47.691087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:47.691087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:47.691087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:47.691087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:47.691087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:47.691087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:47.691087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:47.691087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:47.691087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:47.691087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:47.691087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:39:47.691087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:39:47.691087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:39:47.691087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:39:47.691087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 636/1290] 10.222.0.94 () {56 vars in 1117 bytes} [Wed Aug 24 04:39:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:47.699337 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204628e2-25a3-4a14-bf7d-6d5d3e32bed4 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:47.839410 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204628e2-25a3-4a14-bf7d-6d5d3e32bed4 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:47.906516 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c0768-a49d-4721-b479-1111be62cd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:47.907576 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c0768-a49d-4721-b479-1111be62cd21 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:47.908366 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c0768-a49d-4721-b479-1111be62cd21 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:47.909057 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c0768-a49d-4721-b479-1111be62cd21 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:47.910295 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c0768-a49d-4721-b479-1111be62cd21 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:47.910850 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c0768-a49d-4721-b479-1111be62cd21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:47.913704 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c0768-a49d-4721-b479-1111be62cd21 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:47.923635 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 655/1291] 10.222.0.94 () {56 vars in 1116 bytes} [Wed Aug 24 04:39:47 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:47.931865 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f65fcf-8d57-42b1-af1c-fd6835d6186b None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:48.058676 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f65fcf-8d57-42b1-af1c-fd6835d6186b None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:48.101790 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dae178-db7c-4cd3-b6fd-89a68f1d10a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:48.102474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dae178-db7c-4cd3-b6fd-89a68f1d10a1 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:48.102796 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dae178-db7c-4cd3-b6fd-89a68f1d10a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:48.103115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dae178-db7c-4cd3-b6fd-89a68f1d10a1 None admin] PATH_INFO: `/v3/services` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:48.103825 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dae178-db7c-4cd3-b6fd-89a68f1d10a1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:48.104170 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dae178-db7c-4cd3-b6fd-89a68f1d10a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:48.105671 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dae178-db7c-4cd3-b6fd-89a68f1d10a1 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:48.111164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 637/1292] 10.222.0.94 () {56 vars in 1116 bytes} [Wed Aug 24 04:39:47 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:50.151640 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf12935-3798-41a3-870e-baa29c8c37e9 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:50.152297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf12935-3798-41a3-870e-baa29c8c37e9 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:50.152297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf12935-3798-41a3-870e-baa29c8c37e9 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:50.153573 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 656/1293] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:50.159445 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf77609-d290-4673-b9b0-c0fa7aec5ec1 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:50.159969 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf77609-d290-4673-b9b0-c0fa7aec5ec1 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:50.160083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf77609-d290-4673-b9b0-c0fa7aec5ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:50.185432 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-bbf77609-d290-4673-b9b0-c0fa7aec5ec1 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:50.187614 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-bbf77609-d290-4673-b9b0-c0fa7aec5ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:50.246785 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:50.320931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 638/1294] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:39:50.619820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf12935-3798-41a3-870e-baa29c8c37e9 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:50.656617 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:50.740979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf12935-3798-41a3-870e-baa29c8c37e9 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:50.785162 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f132c1d-2014-474e-929a-0675239b7dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:50.785817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f132c1d-2014-474e-929a-0675239b7dff None admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:50.786100 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f132c1d-2014-474e-929a-0675239b7dff None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:50.786375 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f132c1d-2014-474e-929a-0675239b7dff None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:50.787029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f132c1d-2014-474e-929a-0675239b7dff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:50.788413 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f132c1d-2014-474e-929a-0675239b7dff None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:50.808428 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 657/1295] 10.222.0.94 () {60 vars in 1141 bytes} [Wed Aug 24 04:39:50 2022] POST /identity/v3/services => generated 246 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:39:52.866380 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98f6c9-65f2-41af-bd1d-99842a42649a None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:52.867021 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98f6c9-65f2-41af-bd1d-99842a42649a None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:52.867021 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98f6c9-65f2-41af-bd1d-99842a42649a None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:52.868753 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 639/1296] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:52.875223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910cc62-ff3d-4511-b0ee-2035a6e5d84c None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:52.875972 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910cc62-ff3d-4511-b0ee-2035a6e5d84c None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:52.875972 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910cc62-ff3d-4511-b0ee-2035a6e5d84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:52.898246 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-0910cc62-ff3d-4511-b0ee-2035a6e5d84c None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:52.900074 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-0910cc62-ff3d-4511-b0ee-2035a6e5d84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:52.984964 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 658/1297] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:52 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:39:53.270703 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98f6c9-65f2-41af-bd1d-99842a42649a None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:53.400807 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98f6c9-65f2-41af-bd1d-99842a42649a None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:53.443240 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47866f8b-db1f-4992-aa10-b715e862d844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:53.443889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47866f8b-db1f-4992-aa10-b715e862d844 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:53.444171 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47866f8b-db1f-4992-aa10-b715e862d844 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:53.444445 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47866f8b-db1f-4992-aa10-b715e862d844 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:53.445047 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47866f8b-db1f-4992-aa10-b715e862d844 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:53.447795 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47866f8b-db1f-4992-aa10-b715e862d844 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:53.457740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-47866f8b-db1f-4992-aa10-b715e862d844 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:39:53.457740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:53.457740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:39:53.457740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:39:53.457740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:39:53.457740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:39:53.457740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:39:53.457740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:39:53.457740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:39:53.457740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:39:53.457740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:39:53.457740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:39:53.457740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:53.457740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:53.457740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:53.457740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:53.457740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:53.459284 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:53.459284 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:53.459284 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:53.459284 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:53.459284 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:53.459284 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:53.459284 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:39:53.459284 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:39:53.459284 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:39:53.459284 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:39:53.459284 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:53.459284 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:53.459284 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:53.459284 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:53.459284 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:53.459284 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:53.460526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:53.460526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:53.460526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:53.460526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:53.460526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:53.460526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:53.460526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:53.460526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:53.460526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:53.460526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:53.460526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:39:53.460526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:39:53.460526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:39:53.460526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:39:53.460526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 640/1298] 10.222.0.94 () {56 vars in 1117 bytes} [Wed Aug 24 04:39:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:53.468098 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910cc62-ff3d-4511-b0ee-2035a6e5d84c None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:53.488454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:53.580977 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910cc62-ff3d-4511-b0ee-2035a6e5d84c None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:53.617939 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58b600-8cc9-43ab-9496-f1c9e1ca6425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:53.618558 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58b600-8cc9-43ab-9496-f1c9e1ca6425 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:53.618862 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58b600-8cc9-43ab-9496-f1c9e1ca6425 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:53.619113 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58b600-8cc9-43ab-9496-f1c9e1ca6425 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:53.619748 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58b600-8cc9-43ab-9496-f1c9e1ca6425 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:53.620052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58b600-8cc9-43ab-9496-f1c9e1ca6425 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:53.621437 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58b600-8cc9-43ab-9496-f1c9e1ca6425 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:53.627396 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 659/1299] 10.222.0.94 () {56 vars in 1116 bytes} [Wed Aug 24 04:39:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:53.636094 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47866f8b-db1f-4992-aa10-b715e862d844 None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:53.690845 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:53.778203 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47866f8b-db1f-4992-aa10-b715e862d844 None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:53.820967 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d2496-20d0-4692-b412-0cb4fc8c18e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:53.821761 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d2496-20d0-4692-b412-0cb4fc8c18e0 None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:53.822172 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d2496-20d0-4692-b412-0cb4fc8c18e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:53.822480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d2496-20d0-4692-b412-0cb4fc8c18e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:53.823160 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d2496-20d0-4692-b412-0cb4fc8c18e0 None admin] RBAC: Adding query filter params (interface=public, service_id=d4ec6648fe1b4d7588bd051bf3e210d7, region_id=RegionOne) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:53.823459 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d2496-20d0-4692-b412-0cb4fc8c18e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:53.824896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d2496-20d0-4692-b412-0cb4fc8c18e0 None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:53.830692 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 641/1300] 10.222.0.94 () {56 vars in 1251 bytes} [Wed Aug 24 04:39:53 2022] GET /identity/v3/endpoints?service_id=d4ec6648fe1b4d7588bd051bf3e210d7&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:53.837702 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58b600-8cc9-43ab-9496-f1c9e1ca6425 None admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:53.939091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:53.964406 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58b600-8cc9-43ab-9496-f1c9e1ca6425 None admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:54.012222 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc917455-c032-4922-be63-b0de60fe3c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:54.012837 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc917455-c032-4922-be63-b0de60fe3c11 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:54.013124 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc917455-c032-4922-be63-b0de60fe3c11 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:54.013432 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc917455-c032-4922-be63-b0de60fe3c11 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:54.014047 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc917455-c032-4922-be63-b0de60fe3c11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:54.015419 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc917455-c032-4922-be63-b0de60fe3c11 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:54.022914 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 660/1301] 10.222.0.94 () {56 vars in 1087 bytes} [Wed Aug 24 04:39:53 2022] GET /identity/v3/services => generated 2191 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:39:56.034727 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a678c86-3c06-4355-a408-e4608ce66c57 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:56.035362 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a678c86-3c06-4355-a408-e4608ce66c57 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:56.035362 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a678c86-3c06-4355-a408-e4608ce66c57 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:56.036909 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 642/1302] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:56.046060 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22d064-8960-4af3-b26f-02182e9224cc None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:56.046841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22d064-8960-4af3-b26f-02182e9224cc None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:56.046841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22d064-8960-4af3-b26f-02182e9224cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:56.073523 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-6d22d064-8960-4af3-b26f-02182e9224cc None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:56.075693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-6d22d064-8960-4af3-b26f-02182e9224cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:56.204040 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 661/1303] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:56 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:39:56.514374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a678c86-3c06-4355-a408-e4608ce66c57 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:56.677450 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:56.693357 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a678c86-3c06-4355-a408-e4608ce66c57 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:56.766784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce77fab-8d13-4dca-9b55-917220ce035f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:56.768134 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce77fab-8d13-4dca-9b55-917220ce035f None admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:56.768645 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce77fab-8d13-4dca-9b55-917220ce035f None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:56.769144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce77fab-8d13-4dca-9b55-917220ce035f None admin] PATH_INFO: `/v3/services/placement` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:56.770306 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce77fab-8d13-4dca-9b55-917220ce035f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:56.773021 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce77fab-8d13-4dca-9b55-917220ce035f None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:56.793565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application [None req-7ce77fab-8d13-4dca-9b55-917220ce035f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:39:56.793565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:56.793565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:39:56.793565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:39:56.793565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:39:56.793565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:39:56.793565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:39:56.793565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:39:56.793565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:39:56.793565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:39:56.793565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:39:56.793565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:39:56.793565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:56.793565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:56.793565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:56.793565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:56.793565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:56.795050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:56.795050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:56.795050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:56.795050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:56.795050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:56.795050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:56.795050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:39:56.795050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:39:56.795050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:39:56.795050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:39:56.795050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:56.795050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:56.795050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:56.795050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:56.795050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:56.795050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:56.798399 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:56.798399 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:56.798399 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:56.798399 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:56.798399 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:56.798399 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:56.798399 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:56.798399 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:56.798399 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:56.798399 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:56.798399 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:39:56.798399 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:39:56.798399 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:39:56.798399 dv-cinder-854264-1-smb devstack@keystone.service[93411]: ERROR keystone.server.flask.application Aug 24 04:39:56.798399 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 643/1304] 10.222.0.94 () {56 vars in 1117 bytes} [Wed Aug 24 04:39:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:56.803490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22d064-8960-4af3-b26f-02182e9224cc None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:56.904345 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:56.936997 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22d064-8960-4af3-b26f-02182e9224cc None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:56.984645 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac81c2-36c4-4150-a31c-0f0700e526f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:56.985280 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac81c2-36c4-4150-a31c-0f0700e526f2 None admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:56.985590 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac81c2-36c4-4150-a31c-0f0700e526f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:56.985865 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac81c2-36c4-4150-a31c-0f0700e526f2 None admin] PATH_INFO: `/v3/services` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:56.986511 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac81c2-36c4-4150-a31c-0f0700e526f2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:56.986811 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac81c2-36c4-4150-a31c-0f0700e526f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:56.988204 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac81c2-36c4-4150-a31c-0f0700e526f2 None admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:56.996881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 662/1305] 10.222.0.94 () {56 vars in 1116 bytes} [Wed Aug 24 04:39:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:57.003243 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce77fab-8d13-4dca-9b55-917220ce035f None admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:57.134524 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce77fab-8d13-4dca-9b55-917220ce035f None admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:57.174789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe17c7-e6ab-4553-ade8-bf8f6946f5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:57.175651 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe17c7-e6ab-4553-ade8-bf8f6946f5cd None admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:57.176044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe17c7-e6ab-4553-ade8-bf8f6946f5cd None admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:57.176374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe17c7-e6ab-4553-ade8-bf8f6946f5cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:57.177285 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe17c7-e6ab-4553-ade8-bf8f6946f5cd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:57.178720 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe17c7-e6ab-4553-ade8-bf8f6946f5cd None admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:57.207991 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 644/1306] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:39:57 2022] POST /identity/v3/endpoints => generated 331 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:40:06.990970 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=30 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:07.202988 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:15.026512 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea4f43-3169-4b53-a2db-4a50e0783a3b None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:15.027961 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea4f43-3169-4b53-a2db-4a50e0783a3b None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:15.028640 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea4f43-3169-4b53-a2db-4a50e0783a3b None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:15.037843 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 663/1307] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:41:15 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:15.039953 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d40d67-af01-41ae-b3fd-9cac0a9a1b7c None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:15.041177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d40d67-af01-41ae-b3fd-9cac0a9a1b7c None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:15.041429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d40d67-af01-41ae-b3fd-9cac0a9a1b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:15.318051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-41d40d67-af01-41ae-b3fd-9cac0a9a1b7c None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:15.319417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-41d40d67-af01-41ae-b3fd-9cac0a9a1b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:15.480673 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 645/1308] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:41:16.135051 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e66cb-9c9e-402b-8c38-723e55d0089d None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:16.136341 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e66cb-9c9e-402b-8c38-723e55d0089d None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:16.137010 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e66cb-9c9e-402b-8c38-723e55d0089d None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:16.139694 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 664/1309] 10.222.0.94 () {54 vars in 965 bytes} [Wed Aug 24 04:41:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:16.149721 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85f731-c4b1-46ef-98ce-b9e2a198f15b None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:16.150444 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85f731-c4b1-46ef-98ce-b9e2a198f15b None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:16.151122 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85f731-c4b1-46ef-98ce-b9e2a198f15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:16.326198 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-9f85f731-c4b1-46ef-98ce-b9e2a198f15b None None] MFA Rules not processed for user `0742c7ecf68d40a38c8947a05eee2797`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:16.327757 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-9f85f731-c4b1-46ef-98ce-b9e2a198f15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:16.358352 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:16.580902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 646/1310] 10.222.0.94 () {58 vars in 1062 bytes} [Wed Aug 24 04:41:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:41:16.603790 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e66cb-9c9e-402b-8c38-723e55d0089d None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:16.607467 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-cd4e66cb-9c9e-402b-8c38-723e55d0089d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:16.956948 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e66cb-9c9e-402b-8c38-723e55d0089d None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:17.138477 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549ef39-e584-49f1-8d91-2d3c14626fec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:17.139647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549ef39-e584-49f1-8d91-2d3c14626fec service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:17.139982 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549ef39-e584-49f1-8d91-2d3c14626fec service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:17.140338 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549ef39-e584-49f1-8d91-2d3c14626fec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:17.146726 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-8549ef39-e584-49f1-8d91-2d3c14626fec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:17.233541 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:17.315371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549ef39-e584-49f1-8d91-2d3c14626fec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:17.316655 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549ef39-e584-49f1-8d91-2d3c14626fec service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:17.342899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 665/1311] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:41:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 740 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:41:20.401916 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c43a4-24cf-4eda-b2ab-e9f9682d1eee None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:20.402541 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c43a4-24cf-4eda-b2ab-e9f9682d1eee None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:20.402541 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c43a4-24cf-4eda-b2ab-e9f9682d1eee None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:20.403828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 647/1312] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:41:20.409792 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038515b-c36a-4cb7-9175-da8287fcdf00 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:20.410336 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038515b-c36a-4cb7-9175-da8287fcdf00 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:20.410336 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038515b-c36a-4cb7-9175-da8287fcdf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:20.494363 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-e038515b-c36a-4cb7-9175-da8287fcdf00 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:20.495654 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-e038515b-c36a-4cb7-9175-da8287fcdf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:20.608485 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 666/1313] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:41:20.920078 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400c2a0-57ff-42bb-98c3-39b6555f178b None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:20.920367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400c2a0-57ff-42bb-98c3-39b6555f178b None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:20.920650 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400c2a0-57ff-42bb-98c3-39b6555f178b None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:20.922088 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 648/1314] 10.222.0.94 () {54 vars in 965 bytes} [Wed Aug 24 04:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:20.928816 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b056ea9-f551-48c5-ba30-0f7574803fd5 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:20.929144 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b056ea9-f551-48c5-ba30-0f7574803fd5 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:20.929995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b056ea9-f551-48c5-ba30-0f7574803fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:20.942751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:21.021827 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-4b056ea9-f551-48c5-ba30-0f7574803fd5 None None] MFA Rules not processed for user `0742c7ecf68d40a38c8947a05eee2797`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:21.023161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-4b056ea9-f551-48c5-ba30-0f7574803fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:21.119946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 667/1315] 10.222.0.94 () {58 vars in 1062 bytes} [Wed Aug 24 04:41:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:41:21.134672 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400c2a0-57ff-42bb-98c3-39b6555f178b None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:21.136224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-9400c2a0-57ff-42bb-98c3-39b6555f178b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:21.275643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400c2a0-57ff-42bb-98c3-39b6555f178b None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:21.351101 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:21.354537 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730590e6-5110-4245-84bb-d7b22c2679e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:21.355157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730590e6-5110-4245-84bb-d7b22c2679e2 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:21.355640 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730590e6-5110-4245-84bb-d7b22c2679e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:21.355923 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730590e6-5110-4245-84bb-d7b22c2679e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:21.358041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-730590e6-5110-4245-84bb-d7b22c2679e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:21.474343 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730590e6-5110-4245-84bb-d7b22c2679e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:21.475909 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730590e6-5110-4245-84bb-d7b22c2679e2 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:21.494806 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 649/1316] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:41:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:41:24.114975 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da576b67-055a-46e5-99f3-b6182982a2e1 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:24.115608 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da576b67-055a-46e5-99f3-b6182982a2e1 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:24.116045 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da576b67-055a-46e5-99f3-b6182982a2e1 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:24.118671 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 668/1317] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:41:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:24.127473 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07b975-80f8-4ea6-b608-6607700552ad None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:24.128307 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07b975-80f8-4ea6-b608-6607700552ad None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:24.128513 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07b975-80f8-4ea6-b608-6607700552ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:24.206526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-7f07b975-80f8-4ea6-b608-6607700552ad None None] MFA Rules not processed for user `37fda8d07e354fa9ab9472785c33f6e4`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:24.208143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-7f07b975-80f8-4ea6-b608-6607700552ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:24.271070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:24.336038 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 650/1318] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:24 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:41:24.659743 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da576b67-055a-46e5-99f3-b6182982a2e1 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:24.661398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-da576b67-055a-46e5-99f3-b6182982a2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:24.805562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da576b67-055a-46e5-99f3-b6182982a2e1 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:24.808575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:24.890011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcea07f-f1d3-4024-9723-c23b916071e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:24.890729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcea07f-f1d3-4024-9723-c23b916071e2 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:24.891013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcea07f-f1d3-4024-9723-c23b916071e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:24.891288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcea07f-f1d3-4024-9723-c23b916071e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:24.892978 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-5dcea07f-f1d3-4024-9723-c23b916071e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:25.065752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcea07f-f1d3-4024-9723-c23b916071e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:25.068909 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcea07f-f1d3-4024-9723-c23b916071e2 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:25.087837 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 669/1319] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:41:24 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:41:27.928853 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71755f79-c3b1-413b-b81b-0a428393eb8a None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:27.929996 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71755f79-c3b1-413b-b81b-0a428393eb8a None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:27.930152 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71755f79-c3b1-413b-b81b-0a428393eb8a None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:27.931578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 651/1320] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:41:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:27.938353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e48b7a-60d5-46ae-9811-06d73736613a None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:27.938854 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e48b7a-60d5-46ae-9811-06d73736613a None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:27.938854 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e48b7a-60d5-46ae-9811-06d73736613a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:27.985644 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:28.018333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-e2e48b7a-60d5-46ae-9811-06d73736613a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:28.019835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-e2e48b7a-60d5-46ae-9811-06d73736613a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:28.139971 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 670/1321] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:41:28.435489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71755f79-c3b1-413b-b81b-0a428393eb8a None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:28.437039 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-71755f79-c3b1-413b-b81b-0a428393eb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:28.561211 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71755f79-c3b1-413b-b81b-0a428393eb8a None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:28.651401 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188038f7-1f5e-467e-adcc-28bc04274012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:28.652040 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188038f7-1f5e-467e-adcc-28bc04274012 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:28.652323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188038f7-1f5e-467e-adcc-28bc04274012 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:28.652596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188038f7-1f5e-467e-adcc-28bc04274012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:28.654487 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-188038f7-1f5e-467e-adcc-28bc04274012 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:28.664489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:28.792168 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188038f7-1f5e-467e-adcc-28bc04274012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:28.793674 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188038f7-1f5e-467e-adcc-28bc04274012 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:28.815618 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 652/1322] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:41:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:41:31.592525 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8895c-2317-4a92-b02b-82d8b2fd3adf None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:31.593347 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8895c-2317-4a92-b02b-82d8b2fd3adf None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:31.593347 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8895c-2317-4a92-b02b-82d8b2fd3adf None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:31.595011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 671/1323] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:41:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:31.601955 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb138d0c-8a1c-4f43-9c41-b9cfcbbc8334 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:31.602772 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb138d0c-8a1c-4f43-9c41-b9cfcbbc8334 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:31.602929 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb138d0c-8a1c-4f43-9c41-b9cfcbbc8334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:31.686430 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-fb138d0c-8a1c-4f43-9c41-b9cfcbbc8334 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:31.688197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-fb138d0c-8a1c-4f43-9c41-b9cfcbbc8334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:31.766689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:31.817012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 653/1324] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:41:32.132189 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8895c-2317-4a92-b02b-82d8b2fd3adf None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:32.136004 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-e8a8895c-2317-4a92-b02b-82d8b2fd3adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:32.278127 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8895c-2317-4a92-b02b-82d8b2fd3adf None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:32.303002 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:32.392537 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfeb2c1-d0b3-4842-9b7e-ae138ee4c5c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:32.393169 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeb2c1-d0b3-4842-9b7e-ae138ee4c5c5 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:32.393642 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeb2c1-d0b3-4842-9b7e-ae138ee4c5c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:32.394167 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeb2c1-d0b3-4842-9b7e-ae138ee4c5c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:32.396058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-dbfeb2c1-d0b3-4842-9b7e-ae138ee4c5c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:32.548581 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfeb2c1-d0b3-4842-9b7e-ae138ee4c5c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:32.550120 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfeb2c1-d0b3-4842-9b7e-ae138ee4c5c5 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:32.574824 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 672/1325] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:41:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:41:34.920276 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04288d7-57a4-4bf6-9009-bdd4f47d3e95 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:34.920840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04288d7-57a4-4bf6-9009-bdd4f47d3e95 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:34.920840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04288d7-57a4-4bf6-9009-bdd4f47d3e95 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:34.922244 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 654/1326] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:34.927867 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46491644-0ffa-4420-aa74-4416871f19e1 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:34.928530 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46491644-0ffa-4420-aa74-4416871f19e1 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:34.928530 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46491644-0ffa-4420-aa74-4416871f19e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:34.981034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:35.002536 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-46491644-0ffa-4420-aa74-4416871f19e1 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:35.003786 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-46491644-0ffa-4420-aa74-4416871f19e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:35.133014 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 673/1327] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:41:35.453136 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04288d7-57a4-4bf6-9009-bdd4f47d3e95 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:35.456202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-b04288d7-57a4-4bf6-9009-bdd4f47d3e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:35.584635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04288d7-57a4-4bf6-9009-bdd4f47d3e95 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:35.718695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51ad0f-7fa8-4bdc-a849-f9ae84c533a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:35.719466 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51ad0f-7fa8-4bdc-a849-f9ae84c533a9 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:35.719647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51ad0f-7fa8-4bdc-a849-f9ae84c533a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:35.719915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51ad0f-7fa8-4bdc-a849-f9ae84c533a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:35.721737 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-bd51ad0f-7fa8-4bdc-a849-f9ae84c533a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:35.741638 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:35.875917 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51ad0f-7fa8-4bdc-a849-f9ae84c533a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:35.877904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51ad0f-7fa8-4bdc-a849-f9ae84c533a9 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:35.905454 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 655/1328] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:41:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:41:38.105002 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a759d8-21a2-4797-9729-423810f277de None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:38.105830 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a759d8-21a2-4797-9729-423810f277de None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:38.105830 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a759d8-21a2-4797-9729-423810f277de None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:38.107321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 674/1329] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:38.113979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d21d-8d69-4fa1-a8ac-8e68842cd621 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:38.114602 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d21d-8d69-4fa1-a8ac-8e68842cd621 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:38.115162 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d21d-8d69-4fa1-a8ac-8e68842cd621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:38.230268 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-a795d21d-8d69-4fa1-a8ac-8e68842cd621 None None] MFA Rules not processed for user `37fda8d07e354fa9ab9472785c33f6e4`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:38.232017 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-a795d21d-8d69-4fa1-a8ac-8e68842cd621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:38.331743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:38.373356 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 656/1330] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:41:38.688574 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a759d8-21a2-4797-9729-423810f277de None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:38.690199 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-14a759d8-21a2-4797-9729-423810f277de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:38.813708 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a759d8-21a2-4797-9729-423810f277de None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:38.839659 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:38.907353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626b79c-666b-49c0-a2cd-a24dc2a5e791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:38.908274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626b79c-666b-49c0-a2cd-a24dc2a5e791 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:38.908695 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626b79c-666b-49c0-a2cd-a24dc2a5e791 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:38.909104 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626b79c-666b-49c0-a2cd-a24dc2a5e791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:38.911910 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-3626b79c-666b-49c0-a2cd-a24dc2a5e791 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:39.058925 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626b79c-666b-49c0-a2cd-a24dc2a5e791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:39.060379 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626b79c-666b-49c0-a2cd-a24dc2a5e791 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:39.080608 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 675/1331] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:41:38 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:41:42.013793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4243af7-fb85-438e-92cd-ef15179746a2 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:42.014528 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4243af7-fb85-438e-92cd-ef15179746a2 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:42.014886 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4243af7-fb85-438e-92cd-ef15179746a2 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:42.017759 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 657/1332] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:41:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:41:42.029582 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d71004-1e3e-4397-9069-9f7febe89c4d None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:42.030147 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d71004-1e3e-4397-9069-9f7febe89c4d None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:42.030147 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d71004-1e3e-4397-9069-9f7febe89c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:42.116364 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:42.121181 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-62d71004-1e3e-4397-9069-9f7febe89c4d None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:42.122523 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-62d71004-1e3e-4397-9069-9f7febe89c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:42.237070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 676/1333] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:41:42.536413 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4243af7-fb85-438e-92cd-ef15179746a2 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:42.538215 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-f4243af7-fb85-438e-92cd-ef15179746a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:42.657128 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4243af7-fb85-438e-92cd-ef15179746a2 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:42.738029 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a2b7b-aeb2-46b2-8584-2ebcdd65877d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:42.738638 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a2b7b-aeb2-46b2-8584-2ebcdd65877d service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:42.738917 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a2b7b-aeb2-46b2-8584-2ebcdd65877d service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:42.739191 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a2b7b-aeb2-46b2-8584-2ebcdd65877d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:42.740832 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-511a2b7b-aeb2-46b2-8584-2ebcdd65877d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:42.779359 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:42.915561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a2b7b-aeb2-46b2-8584-2ebcdd65877d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:42.918396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a2b7b-aeb2-46b2-8584-2ebcdd65877d service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:42.955919 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 658/1334] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:41:44.960259 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d68a36-5ab3-486c-bcfb-16ffb1aeaecb None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:44.960814 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d68a36-5ab3-486c-bcfb-16ffb1aeaecb None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:44.961090 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d68a36-5ab3-486c-bcfb-16ffb1aeaecb None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:44.962520 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 677/1335] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:44.968315 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4b90b-237c-42b4-8a27-8d8eca443573 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:44.968831 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4b90b-237c-42b4-8a27-8d8eca443573 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:44.968942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4b90b-237c-42b4-8a27-8d8eca443573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:45.046434 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-91e4b90b-237c-42b4-8a27-8d8eca443573 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:45.048048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-91e4b90b-237c-42b4-8a27-8d8eca443573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:45.147329 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:45.175288 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 659/1336] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:41:45.463101 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d68a36-5ab3-486c-bcfb-16ffb1aeaecb None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:45.465774 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-03d68a36-5ab3-486c-bcfb-16ffb1aeaecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:45.601507 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d68a36-5ab3-486c-bcfb-16ffb1aeaecb None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:45.631665 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:45.683189 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5947ea-f5d1-4398-b029-cff335547d09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:45.683894 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5947ea-f5d1-4398-b029-cff335547d09 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:45.684211 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5947ea-f5d1-4398-b029-cff335547d09 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:45.684521 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5947ea-f5d1-4398-b029-cff335547d09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:45.686421 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-6e5947ea-f5d1-4398-b029-cff335547d09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:45.811102 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5947ea-f5d1-4398-b029-cff335547d09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:45.812535 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5947ea-f5d1-4398-b029-cff335547d09 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:45.831594 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 678/1337] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:41:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:41:48.142616 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b629d-9df6-4931-b242-67c006d7f01c None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:48.143245 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b629d-9df6-4931-b242-67c006d7f01c None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:48.143245 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b629d-9df6-4931-b242-67c006d7f01c None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:48.144840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 660/1338] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:48.151777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0a2ce-7561-49a0-af0b-6733db948076 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:48.152386 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0a2ce-7561-49a0-af0b-6733db948076 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:48.152499 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0a2ce-7561-49a0-af0b-6733db948076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:48.231604 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-3ab0a2ce-7561-49a0-af0b-6733db948076 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:48.232885 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-3ab0a2ce-7561-49a0-af0b-6733db948076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:48.243782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:48.357147 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 679/1339] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:41:48.640189 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b629d-9df6-4931-b242-67c006d7f01c None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:48.641803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-ce7b629d-9df6-4931-b242-67c006d7f01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:48.752949 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b629d-9df6-4931-b242-67c006d7f01c None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:48.830149 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d73b93-7bae-422f-b758-1f743e01a3ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:48.830751 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d73b93-7bae-422f-b758-1f743e01a3ce service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:48.831022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d73b93-7bae-422f-b758-1f743e01a3ce service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:48.831290 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d73b93-7bae-422f-b758-1f743e01a3ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:48.832916 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-13d73b93-7bae-422f-b758-1f743e01a3ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:48.872833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:48.959138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d73b93-7bae-422f-b758-1f743e01a3ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:48.961138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d73b93-7bae-422f-b758-1f743e01a3ce service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:48.979921 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 661/1340] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:41:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:41:53.184553 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c49ba-91c8-4d69-86f8-0cc33e3587ca None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:53.185129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c49ba-91c8-4d69-86f8-0cc33e3587ca None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:53.185129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c49ba-91c8-4d69-86f8-0cc33e3587ca None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:53.186925 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 680/1341] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:53.192555 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04499031-c8d8-42c2-9c28-7dbda8a0b3ea None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:53.193260 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04499031-c8d8-42c2-9c28-7dbda8a0b3ea None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:53.193260 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04499031-c8d8-42c2-9c28-7dbda8a0b3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:53.278670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-04499031-c8d8-42c2-9c28-7dbda8a0b3ea None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:53.279974 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-04499031-c8d8-42c2-9c28-7dbda8a0b3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:53.407380 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:53.422030 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 662/1342] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:41:53.759200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c49ba-91c8-4d69-86f8-0cc33e3587ca None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:53.760571 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-4c9c49ba-91c8-4d69-86f8-0cc33e3587ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:53.886725 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c49ba-91c8-4d69-86f8-0cc33e3587ca None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:53.941976 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:53.990248 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b458649-293e-4309-87bd-dd051a212592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:53.990880 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b458649-293e-4309-87bd-dd051a212592 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:53.991153 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b458649-293e-4309-87bd-dd051a212592 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:53.991749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b458649-293e-4309-87bd-dd051a212592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:53.993168 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-2b458649-293e-4309-87bd-dd051a212592 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:54.151047 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b458649-293e-4309-87bd-dd051a212592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:54.152294 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b458649-293e-4309-87bd-dd051a212592 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:54.180476 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 681/1343] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:41:57.597298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7870d87-271c-4e7e-a736-558ef40fb100 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:57.598202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7870d87-271c-4e7e-a736-558ef40fb100 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:57.598202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7870d87-271c-4e7e-a736-558ef40fb100 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:57.599867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 663/1344] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:41:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:57.606395 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b34bab-9691-428e-9455-45c630d3fb3d None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:57.607149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b34bab-9691-428e-9455-45c630d3fb3d None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:57.607353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b34bab-9691-428e-9455-45c630d3fb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:57.696097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-99b34bab-9691-428e-9455-45c630d3fb3d None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:57.697461 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-99b34bab-9691-428e-9455-45c630d3fb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:57.723184 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:57.837550 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 682/1345] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:41:58.131800 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7870d87-271c-4e7e-a736-558ef40fb100 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:58.135593 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-b7870d87-271c-4e7e-a736-558ef40fb100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:58.290097 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7870d87-271c-4e7e-a736-558ef40fb100 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:58.386252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a51a2-6c41-4d9b-a1d8-762a56215c6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:58.386971 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a51a2-6c41-4d9b-a1d8-762a56215c6b service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:58.387430 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a51a2-6c41-4d9b-a1d8-762a56215c6b service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:58.387837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a51a2-6c41-4d9b-a1d8-762a56215c6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:58.390102 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-2b6a51a2-6c41-4d9b-a1d8-762a56215c6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:58.458922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:58.560701 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a51a2-6c41-4d9b-a1d8-762a56215c6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:58.562434 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a51a2-6c41-4d9b-a1d8-762a56215c6b service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:58.590303 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 664/1346] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:41:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:03.206975 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f29e5-a2a1-41fa-86fa-c71e8960f56e None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:03.207508 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f29e5-a2a1-41fa-86fa-c71e8960f56e None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:03.207632 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f29e5-a2a1-41fa-86fa-c71e8960f56e None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:03.209197 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 683/1347] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:03.215687 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867227fb-f285-4f65-89cd-099cb4c2857c None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:03.216243 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867227fb-f285-4f65-89cd-099cb4c2857c None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:03.216243 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867227fb-f285-4f65-89cd-099cb4c2857c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:03.312421 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-867227fb-f285-4f65-89cd-099cb4c2857c None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:03.314575 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-867227fb-f285-4f65-89cd-099cb4c2857c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:03.437430 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:03.440281 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 665/1348] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:03.740902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f29e5-a2a1-41fa-86fa-c71e8960f56e None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:03.742987 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-de4f29e5-a2a1-41fa-86fa-c71e8960f56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:03.905661 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f29e5-a2a1-41fa-86fa-c71e8960f56e None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:03.982869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:04.017105 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c160a6-daab-4731-a20a-21038d05898b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:04.017105 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c160a6-daab-4731-a20a-21038d05898b service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:04.017105 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c160a6-daab-4731-a20a-21038d05898b service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:04.017105 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c160a6-daab-4731-a20a-21038d05898b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:04.019714 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-17c160a6-daab-4731-a20a-21038d05898b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:04.185872 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c160a6-daab-4731-a20a-21038d05898b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:04.187313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c160a6-daab-4731-a20a-21038d05898b service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:04.206425 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 684/1349] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:11.314490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44603628-3c12-4a8c-a148-49b100e08b74 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:11.314985 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44603628-3c12-4a8c-a148-49b100e08b74 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:11.315215 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44603628-3c12-4a8c-a148-49b100e08b74 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:11.317786 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 666/1350] 10.222.0.94 () {54 vars in 921 bytes} [Wed Aug 24 04:42:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:11.330361 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7bb3a-9292-4cbb-936c-40fb8035f432 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:11.330361 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7bb3a-9292-4cbb-936c-40fb8035f432 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:11.330361 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7bb3a-9292-4cbb-936c-40fb8035f432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:11.506155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-58e7bb3a-9292-4cbb-936c-40fb8035f432 None None] MFA Rules not processed for user `3a3274d404cb403bbf272ce023aa5e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:11.508058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-58e7bb3a-9292-4cbb-936c-40fb8035f432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:11.541929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:11.763995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 685/1351] 10.222.0.94 () {58 vars in 1018 bytes} [Wed Aug 24 04:42:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:18.464120 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e33a5-e5fa-47ab-9774-330d86b51c97 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:18.464952 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e33a5-e5fa-47ab-9774-330d86b51c97 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:18.465243 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e33a5-e5fa-47ab-9774-330d86b51c97 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:18.468256 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 667/1352] 10.222.0.94 () {54 vars in 921 bytes} [Wed Aug 24 04:42:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:18.479216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fa122-bee4-4d84-b39b-68bd942cb280 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:18.480050 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fa122-bee4-4d84-b39b-68bd942cb280 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:18.480319 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fa122-bee4-4d84-b39b-68bd942cb280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:18.610242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-614fa122-bee4-4d84-b39b-68bd942cb280 None None] MFA Rules not processed for user `3a3274d404cb403bbf272ce023aa5e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:18.611788 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-614fa122-bee4-4d84-b39b-68bd942cb280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:18.767295 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:18.840354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 686/1353] 10.222.0.94 () {58 vars in 1018 bytes} [Wed Aug 24 04:42:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:20.280795 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b0316-232c-43d3-b00a-e5495db40eb8 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:20.281365 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b0316-232c-43d3-b00a-e5495db40eb8 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:20.281365 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b0316-232c-43d3-b00a-e5495db40eb8 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:20.282759 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 668/1354] 10.222.0.94 () {54 vars in 921 bytes} [Wed Aug 24 04:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:20.288250 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb14da3-7b7f-4d28-a258-8774b32e55ca None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:20.288809 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb14da3-7b7f-4d28-a258-8774b32e55ca None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:20.288997 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb14da3-7b7f-4d28-a258-8774b32e55ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:20.377077 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-0bb14da3-7b7f-4d28-a258-8774b32e55ca None None] MFA Rules not processed for user `3a3274d404cb403bbf272ce023aa5e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:20.378366 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-0bb14da3-7b7f-4d28-a258-8774b32e55ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:20.510194 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 687/1355] 10.222.0.94 () {58 vars in 1018 bytes} [Wed Aug 24 04:42:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:24.634167 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dedeb2-b481-4818-b2d1-c8e5ad5ebbec None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:24.634793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dedeb2-b481-4818-b2d1-c8e5ad5ebbec None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:24.634793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dedeb2-b481-4818-b2d1-c8e5ad5ebbec None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:24.636000 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 669/1356] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:42:24.642670 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bf632-81ca-43b6-8a4d-a7f9fc81eb1a None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:24.643194 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bf632-81ca-43b6-8a4d-a7f9fc81eb1a None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:24.643311 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bf632-81ca-43b6-8a4d-a7f9fc81eb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:24.726058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:24.784118 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-1f1bf632-81ca-43b6-8a4d-a7f9fc81eb1a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:24.785885 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-1f1bf632-81ca-43b6-8a4d-a7f9fc81eb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:24.939487 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 688/1357] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:25.304428 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ee6b5-dc33-4365-8676-9cb577eeb4e7 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:25.305100 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ee6b5-dc33-4365-8676-9cb577eeb4e7 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:25.306187 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ee6b5-dc33-4365-8676-9cb577eeb4e7 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:25.309834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 670/1358] 10.222.0.94 () {54 vars in 962 bytes} [Wed Aug 24 04:42:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:25.320536 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7302d24-2f62-4b38-ba4d-82336e222c10 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:25.320840 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7302d24-2f62-4b38-ba4d-82336e222c10 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:25.321171 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7302d24-2f62-4b38-ba4d-82336e222c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:25.452946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-a7302d24-2f62-4b38-ba4d-82336e222c10 None None] MFA Rules not processed for user `5bdbda2b9c8f48338c5117585a229cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:25.454252 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-a7302d24-2f62-4b38-ba4d-82336e222c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:25.545253 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:25.666960 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 689/1359] 10.222.0.94 () {58 vars in 1059 bytes} [Wed Aug 24 04:42:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:25.676809 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ee6b5-dc33-4365-8676-9cb577eeb4e7 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:25.678315 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-557ee6b5-dc33-4365-8676-9cb577eeb4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:25.870078 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ee6b5-dc33-4365-8676-9cb577eeb4e7 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:26.012325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:26.093674 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985be33c-deeb-4a90-b175-0ee87a930bd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:26.094578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985be33c-deeb-4a90-b175-0ee87a930bd3 service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:26.094981 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985be33c-deeb-4a90-b175-0ee87a930bd3 service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:26.095411 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985be33c-deeb-4a90-b175-0ee87a930bd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:26.098105 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-985be33c-deeb-4a90-b175-0ee87a930bd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:26.274959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985be33c-deeb-4a90-b175-0ee87a930bd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:26.278113 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985be33c-deeb-4a90-b175-0ee87a930bd3 service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:26.316751 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 671/1360] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:42:29.353288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9752a7-544a-465d-9fe4-63d0e3b7a0fb None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:29.354124 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9752a7-544a-465d-9fe4-63d0e3b7a0fb None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:29.354124 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9752a7-544a-465d-9fe4-63d0e3b7a0fb None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:29.362975 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf64a6-a10c-46be-b567-f84410216ce2 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:29.363828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf64a6-a10c-46be-b567-f84410216ce2 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:29.363828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf64a6-a10c-46be-b567-f84410216ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:29.368479 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 690/1361] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:42:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:29.474453 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-1dbf64a6-a10c-46be-b567-f84410216ce2 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:29.477876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-1dbf64a6-a10c-46be-b567-f84410216ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:29.565003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:29.699932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 672/1362] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:42:30.273914 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9752a7-544a-465d-9fe4-63d0e3b7a0fb None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:30.277105 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ef9752a7-544a-465d-9fe4-63d0e3b7a0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:30.582821 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9752a7-544a-465d-9fe4-63d0e3b7a0fb None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:30.602950 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:30.835857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31399e26-781e-4739-ae04-6d0f942040aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:30.836634 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31399e26-781e-4739-ae04-6d0f942040aa service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:30.837299 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31399e26-781e-4739-ae04-6d0f942040aa service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:30.837656 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31399e26-781e-4739-ae04-6d0f942040aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:30.839584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-31399e26-781e-4739-ae04-6d0f942040aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:31.055535 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31399e26-781e-4739-ae04-6d0f942040aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:31.057865 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31399e26-781e-4739-ae04-6d0f942040aa service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:31.087179 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 691/1363] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 816 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:34.113912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78fdae-b14e-4505-b4af-a8e056584244 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:34.114534 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78fdae-b14e-4505-b4af-a8e056584244 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:34.114534 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78fdae-b14e-4505-b4af-a8e056584244 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:34.116655 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 673/1364] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:34.123982 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b24c4-42c9-4980-9c19-54ffa2ed5afb None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:34.124821 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b24c4-42c9-4980-9c19-54ffa2ed5afb None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:34.124821 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b24c4-42c9-4980-9c19-54ffa2ed5afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:34.147517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:34.220322 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-816b24c4-42c9-4980-9c19-54ffa2ed5afb None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:34.221702 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-816b24c4-42c9-4980-9c19-54ffa2ed5afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:34.407004 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 692/1365] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:42:34.837559 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8983f4-fcf5-42f8-be05-970cfb30aed3 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:34.838042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8983f4-fcf5-42f8-be05-970cfb30aed3 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:34.838495 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8983f4-fcf5-42f8-be05-970cfb30aed3 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:34.841276 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 674/1366] 10.222.0.94 () {54 vars in 962 bytes} [Wed Aug 24 04:42:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:42:34.849825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273321b5-4c02-415e-a04f-7230e715a2a3 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:34.850286 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273321b5-4c02-415e-a04f-7230e715a2a3 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:34.850765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273321b5-4c02-415e-a04f-7230e715a2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:35.013777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-273321b5-4c02-415e-a04f-7230e715a2a3 None None] MFA Rules not processed for user `5bdbda2b9c8f48338c5117585a229cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:35.015889 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-273321b5-4c02-415e-a04f-7230e715a2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:35.091462 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:35.248625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 693/1367] 10.222.0.94 () {58 vars in 1059 bytes} [Wed Aug 24 04:42:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:35.269195 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8983f4-fcf5-42f8-be05-970cfb30aed3 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:35.273872 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-9b8983f4-fcf5-42f8-be05-970cfb30aed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:35.553521 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8983f4-fcf5-42f8-be05-970cfb30aed3 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:35.582658 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:35.741118 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd967846-e589-4f0c-89cf-251f98e850f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:35.741941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd967846-e589-4f0c-89cf-251f98e850f9 service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:35.742343 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd967846-e589-4f0c-89cf-251f98e850f9 service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:35.742793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd967846-e589-4f0c-89cf-251f98e850f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:35.744712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-bd967846-e589-4f0c-89cf-251f98e850f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:35.869562 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd967846-e589-4f0c-89cf-251f98e850f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:35.874112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd967846-e589-4f0c-89cf-251f98e850f9 service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:35.903830 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 675/1368] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:38.230510 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363be3c-cf3b-45ae-a068-4e615aa74cfa None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:38.231562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363be3c-cf3b-45ae-a068-4e615aa74cfa None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:38.231562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363be3c-cf3b-45ae-a068-4e615aa74cfa None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:38.234529 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 694/1369] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:42:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:38.244149 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197ac12-8fcf-48ec-8bc2-6869933c711b None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:38.244937 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197ac12-8fcf-48ec-8bc2-6869933c711b None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:38.245131 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197ac12-8fcf-48ec-8bc2-6869933c711b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:38.313999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:38.397050 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda717a-3a17-434a-832f-c3daab5ab204 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:38.397590 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda717a-3a17-434a-832f-c3daab5ab204 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:38.397989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda717a-3a17-434a-832f-c3daab5ab204 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:38.400482 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 695/1370] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:42:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:42:38.401220 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-b197ac12-8fcf-48ec-8bc2-6869933c711b None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:38.402829 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-b197ac12-8fcf-48ec-8bc2-6869933c711b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:38.410045 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1ec0e-18fd-4810-98e6-52c3c9fc9835 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:38.410548 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1ec0e-18fd-4810-98e6-52c3c9fc9835 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:38.411099 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1ec0e-18fd-4810-98e6-52c3c9fc9835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:38.547168 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-63c1ec0e-18fd-4810-98e6-52c3c9fc9835 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:38.549148 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-63c1ec0e-18fd-4810-98e6-52c3c9fc9835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:38.593493 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 676/1371] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:42:38.748375 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:38.769056 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 696/1372] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:39.197947 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197ac12-8fcf-48ec-8bc2-6869933c711b None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:39.200844 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-b197ac12-8fcf-48ec-8bc2-6869933c711b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:39.341859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ee246-7c0d-42e5-b886-23f382a7d162 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:39.343420 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ee246-7c0d-42e5-b886-23f382a7d162 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:39.343420 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ee246-7c0d-42e5-b886-23f382a7d162 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:39.345727 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 697/1373] 10.222.0.94 () {54 vars in 964 bytes} [Wed Aug 24 04:42:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:39.355551 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cda272-814e-48d4-b748-769979e7dd3c None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:39.356764 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cda272-814e-48d4-b748-769979e7dd3c None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:39.357281 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cda272-814e-48d4-b748-769979e7dd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:39.411086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:39.430631 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197ac12-8fcf-48ec-8bc2-6869933c711b None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:39.509974 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-24cda272-814e-48d4-b748-769979e7dd3c None None] MFA Rules not processed for user `6d36675e4e6045158add36ac528d6c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:39.512047 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-24cda272-814e-48d4-b748-769979e7dd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:39.659263 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 698/1374] 10.222.0.94 () {58 vars in 1061 bytes} [Wed Aug 24 04:42:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:42:39.669929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cda272-814e-48d4-b748-769979e7dd3c None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:39.686305 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cda272-814e-48d4-b748-769979e7dd3c None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:39.786243 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670d9a8-cd3d-4348-9792-77e357580dc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:39.787777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670d9a8-cd3d-4348-9792-77e357580dc9 service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:39.788350 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670d9a8-cd3d-4348-9792-77e357580dc9 service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:39.788858 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670d9a8-cd3d-4348-9792-77e357580dc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:39.791833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-5670d9a8-cd3d-4348-9792-77e357580dc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:39.819488 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ffe29-8060-4bfd-a6b6-9d14ef1687f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:39.820607 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ffe29-8060-4bfd-a6b6-9d14ef1687f1 service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:39.821108 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ffe29-8060-4bfd-a6b6-9d14ef1687f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:39.821646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ffe29-8060-4bfd-a6b6-9d14ef1687f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:39.824937 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-8d1ffe29-8060-4bfd-a6b6-9d14ef1687f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:39.839646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:39.950077 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670d9a8-cd3d-4348-9792-77e357580dc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:39.951839 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670d9a8-cd3d-4348-9792-77e357580dc9 service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:39.979187 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:39.991387 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 677/1375] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 795 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:40.040656 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ffe29-8060-4bfd-a6b6-9d14ef1687f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:40.042893 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ffe29-8060-4bfd-a6b6-9d14ef1687f1 service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:40.072906 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 699/1376] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:42.312075 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cd5a5-a050-40ef-9f7e-d2de0267928a None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:42.312636 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cd5a5-a050-40ef-9f7e-d2de0267928a None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:42.312636 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cd5a5-a050-40ef-9f7e-d2de0267928a None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:42.314032 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 678/1377] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:42.321175 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c4c70-f33e-4ae3-932c-0deb53919580 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:42.321761 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c4c70-f33e-4ae3-932c-0deb53919580 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:42.321966 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c4c70-f33e-4ae3-932c-0deb53919580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:42.412052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-fd5c4c70-f33e-4ae3-932c-0deb53919580 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:42.414278 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-fd5c4c70-f33e-4ae3-932c-0deb53919580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:42.497937 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:42.556896 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 700/1378] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:42.950579 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cd5a5-a050-40ef-9f7e-d2de0267928a None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:42.952519 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-696cd5a5-a050-40ef-9f7e-d2de0267928a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:43.185755 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cd5a5-a050-40ef-9f7e-d2de0267928a None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:43.305014 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:43.387985 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2702051-55bb-453f-8a83-af941db8bc4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:43.389014 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2702051-55bb-453f-8a83-af941db8bc4a service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:43.389535 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2702051-55bb-453f-8a83-af941db8bc4a service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:43.389998 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2702051-55bb-453f-8a83-af941db8bc4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:43.392865 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e2702051-55bb-453f-8a83-af941db8bc4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:43.535889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2702051-55bb-453f-8a83-af941db8bc4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:43.539226 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2702051-55bb-453f-8a83-af941db8bc4a service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:43.578268 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 679/1379] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:46.066384 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142aadf-7e77-4c14-87d5-0c9d80983f26 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:46.067343 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142aadf-7e77-4c14-87d5-0c9d80983f26 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:46.067343 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142aadf-7e77-4c14-87d5-0c9d80983f26 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:46.070865 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 701/1380] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:42:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:46.079950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a552be-5bd0-4ff9-a532-4bc10f12b965 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:46.082201 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a552be-5bd0-4ff9-a532-4bc10f12b965 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:46.083207 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a552be-5bd0-4ff9-a532-4bc10f12b965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:46.233126 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-f7a552be-5bd0-4ff9-a532-4bc10f12b965 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:46.235052 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-f7a552be-5bd0-4ff9-a532-4bc10f12b965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:46.304183 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:46.417350 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 680/1381] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:46.777336 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142aadf-7e77-4c14-87d5-0c9d80983f26 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:46.779308 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-1142aadf-7e77-4c14-87d5-0c9d80983f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:47.007753 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142aadf-7e77-4c14-87d5-0c9d80983f26 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:47.073894 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:47.148382 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb3e77-42ca-4e86-a3b9-898e51e964ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:47.149011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb3e77-42ca-4e86-a3b9-898e51e964ed service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:47.149283 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb3e77-42ca-4e86-a3b9-898e51e964ed service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:47.149612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb3e77-42ca-4e86-a3b9-898e51e964ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:47.151766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-e0cb3e77-42ca-4e86-a3b9-898e51e964ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:47.259528 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb3e77-42ca-4e86-a3b9-898e51e964ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:47.261057 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb3e77-42ca-4e86-a3b9-898e51e964ed service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:47.289009 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 702/1382] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:42:49.641085 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcc33d-b69b-4e34-82c5-a5ab3c39a18e None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:49.641746 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcc33d-b69b-4e34-82c5-a5ab3c39a18e None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:49.641746 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcc33d-b69b-4e34-82c5-a5ab3c39a18e None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:49.642994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 681/1383] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:49.649946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5f3b4-50a7-49f4-8105-9db1754f35ec None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:49.650871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5f3b4-50a7-49f4-8105-9db1754f35ec None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:49.650871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5f3b4-50a7-49f4-8105-9db1754f35ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:49.763302 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:49.769330 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-24c5f3b4-50a7-49f4-8105-9db1754f35ec None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:49.773393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-24c5f3b4-50a7-49f4-8105-9db1754f35ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:49.917724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 703/1384] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:42:50.247350 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcc33d-b69b-4e34-82c5-a5ab3c39a18e None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:50.248931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-29fcc33d-b69b-4e34-82c5-a5ab3c39a18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:50.543500 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcc33d-b69b-4e34-82c5-a5ab3c39a18e None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:50.565368 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:50.693035 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2dddb-103e-4a2a-919c-b23922e5186b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:50.694031 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2dddb-103e-4a2a-919c-b23922e5186b service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:50.694337 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2dddb-103e-4a2a-919c-b23922e5186b service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:50.694617 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2dddb-103e-4a2a-919c-b23922e5186b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:50.696371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-ddd2dddb-103e-4a2a-919c-b23922e5186b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:50.806909 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2dddb-103e-4a2a-919c-b23922e5186b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:50.808966 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2dddb-103e-4a2a-919c-b23922e5186b service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:50.831357 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 682/1385] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:53.262397 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abcdac-10eb-4ecc-9e56-66488bfafcea None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:53.263037 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abcdac-10eb-4ecc-9e56-66488bfafcea None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:53.263656 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abcdac-10eb-4ecc-9e56-66488bfafcea None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:53.265650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 704/1386] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:42:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:53.272358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f45134-79bd-4f47-aa61-0574d0840111 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:53.272987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f45134-79bd-4f47-aa61-0574d0840111 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:53.272987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f45134-79bd-4f47-aa61-0574d0840111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:53.307157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:53.355855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-e3f45134-79bd-4f47-aa61-0574d0840111 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:53.357222 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e3f45134-79bd-4f47-aa61-0574d0840111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:53.477748 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 683/1387] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:53.860539 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abcdac-10eb-4ecc-9e56-66488bfafcea None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:53.862133 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-f6abcdac-10eb-4ecc-9e56-66488bfafcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:54.020540 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:54.046772 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abcdac-10eb-4ecc-9e56-66488bfafcea None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:54.202721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001c3e9-a8d5-4f77-9241-21951d00eb85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:54.203333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001c3e9-a8d5-4f77-9241-21951d00eb85 service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:54.203615 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001c3e9-a8d5-4f77-9241-21951d00eb85 service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:54.203890 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001c3e9-a8d5-4f77-9241-21951d00eb85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:54.205539 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-b001c3e9-a8d5-4f77-9241-21951d00eb85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:54.318758 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001c3e9-a8d5-4f77-9241-21951d00eb85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:54.320895 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001c3e9-a8d5-4f77-9241-21951d00eb85 service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:54.325429 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:54.345867 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 705/1388] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:56.426429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354d8b3-76f4-4076-9ded-b59c7b2398a5 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:56.426985 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354d8b3-76f4-4076-9ded-b59c7b2398a5 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:56.426985 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354d8b3-76f4-4076-9ded-b59c7b2398a5 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:56.428871 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 684/1389] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:42:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:56.434632 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1711c1d-a963-43e5-8c60-f3fea215c72c None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:56.435142 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1711c1d-a963-43e5-8c60-f3fea215c72c None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:56.435259 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1711c1d-a963-43e5-8c60-f3fea215c72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:56.510087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-b1711c1d-a963-43e5-8c60-f3fea215c72c None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:56.511323 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-b1711c1d-a963-43e5-8c60-f3fea215c72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:56.621370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 706/1390] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:56.916089 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354d8b3-76f4-4076-9ded-b59c7b2398a5 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:56.917709 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-f354d8b3-76f4-4076-9ded-b59c7b2398a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:57.030352 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:57.084807 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354d8b3-76f4-4076-9ded-b59c7b2398a5 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:57.207373 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4efa2b-5803-407a-9669-454f63aff4b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:57.207977 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4efa2b-5803-407a-9669-454f63aff4b8 service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:57.208256 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4efa2b-5803-407a-9669-454f63aff4b8 service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:57.209131 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4efa2b-5803-407a-9669-454f63aff4b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:57.210797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-ab4efa2b-5803-407a-9669-454f63aff4b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:57.284878 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:57.314466 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4efa2b-5803-407a-9669-454f63aff4b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:57.316071 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4efa2b-5803-407a-9669-454f63aff4b8 service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:57.336962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 685/1391] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:58.354752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbe443-e62b-454c-9669-0a169a7fab1e None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:58.355339 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbe443-e62b-454c-9669-0a169a7fab1e None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:58.355339 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbe443-e62b-454c-9669-0a169a7fab1e None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:58.356655 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 707/1392] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:58.363126 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4a548-8975-4238-8f6d-7868b8a3e44f None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:58.363614 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4a548-8975-4238-8f6d-7868b8a3e44f None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:58.363711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4a548-8975-4238-8f6d-7868b8a3e44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:58.440202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-d6f4a548-8975-4238-8f6d-7868b8a3e44f None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:58.441729 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-d6f4a548-8975-4238-8f6d-7868b8a3e44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:58.564376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 686/1393] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:42:58.868926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b2ba1-a16f-4a09-b1e6-ac53bf6f1d6a None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:58.869329 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b2ba1-a16f-4a09-b1e6-ac53bf6f1d6a None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:58.869726 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b2ba1-a16f-4a09-b1e6-ac53bf6f1d6a None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:58.871183 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 708/1394] 10.222.0.94 () {54 vars in 967 bytes} [Wed Aug 24 04:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:58.876881 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf330e2-3feb-4373-98cf-77079b0da2b9 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:58.877173 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf330e2-3feb-4373-98cf-77079b0da2b9 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:58.877584 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf330e2-3feb-4373-98cf-77079b0da2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:58.941604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:58.971323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-dbf330e2-3feb-4373-98cf-77079b0da2b9 None None] MFA Rules not processed for user `bbec984d81c84035887220056b3790ec`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:58.972578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-dbf330e2-3feb-4373-98cf-77079b0da2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:59.057233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 687/1395] 10.222.0.94 () {58 vars in 1064 bytes} [Wed Aug 24 04:42:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:59.064700 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b2ba1-a16f-4a09-b1e6-ac53bf6f1d6a None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:59.066237 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-0b9b2ba1-a16f-4a09-b1e6-ac53bf6f1d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:59.143604 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:59.178303 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b2ba1-a16f-4a09-b1e6-ac53bf6f1d6a None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:59.258259 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a307e-29c6-4a50-ae58-906cfc03c372 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbec984d81c84035887220056b3790ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:59.258798 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a307e-29c6-4a50-ae58-906cfc03c372 service glance] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:59.259089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a307e-29c6-4a50-ae58-906cfc03c372 service glance] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:59.259366 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a307e-29c6-4a50-ae58-906cfc03c372 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:59.261015 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-829a307e-29c6-4a50-ae58-906cfc03c372 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:59.395365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a307e-29c6-4a50-ae58-906cfc03c372 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:59.397282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a307e-29c6-4a50-ae58-906cfc03c372 service glance] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:59.413336 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:59.418500 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 709/1396] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:59.422729 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c5267-7b04-4490-aeea-ab6fabb99780 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:59.423216 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c5267-7b04-4490-aeea-ab6fabb99780 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:59.423335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c5267-7b04-4490-aeea-ab6fabb99780 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:59.424609 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 688/1397] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:59.431153 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223cc58-a1e3-40af-817c-37ce52d12420 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:59.431442 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223cc58-a1e3-40af-817c-37ce52d12420 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:59.431720 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223cc58-a1e3-40af-817c-37ce52d12420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:59.502860 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-2223cc58-a1e3-40af-817c-37ce52d12420 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:59.504164 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-2223cc58-a1e3-40af-817c-37ce52d12420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:59.615617 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 710/1398] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:59.928931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c5267-7b04-4490-aeea-ab6fabb99780 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:59.929854 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-c08c5267-7b04-4490-aeea-ab6fabb99780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:00.091653 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:00.105718 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c5267-7b04-4490-aeea-ab6fabb99780 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:00.199077 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e464ff-be3d-4fb1-984f-dd62c15f410f None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:00.199586 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e464ff-be3d-4fb1-984f-dd62c15f410f None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:00.200003 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e464ff-be3d-4fb1-984f-dd62c15f410f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:00.244114 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7475d4-b87e-4938-b01e-059b8e240b07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:00.244725 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7475d4-b87e-4938-b01e-059b8e240b07 service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:00.245010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7475d4-b87e-4938-b01e-059b8e240b07 service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:00.245282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7475d4-b87e-4938-b01e-059b8e240b07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:00.247090 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-9d7475d4-b87e-4938-b01e-059b8e240b07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:00.275276 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-64e464ff-be3d-4fb1-984f-dd62c15f410f None None] MFA Rules not processed for user `7caa973c63e64d639cc2fb55a4955542`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:00.276634 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-64e464ff-be3d-4fb1-984f-dd62c15f410f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:00.307412 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:00.349602 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7475d4-b87e-4938-b01e-059b8e240b07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:00.351332 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7475d4-b87e-4938-b01e-059b8e240b07 service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:00.361246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:00.373613 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 689/1399] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:00.381730 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 711/1400] 10.222.0.94 () {58 vars in 1009 bytes} [Wed Aug 24 04:43:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:00.435967 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb0692-1ad5-495a-8065-cb6f88da3ba4 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:00.436814 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb0692-1ad5-495a-8065-cb6f88da3ba4 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:00.436814 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb0692-1ad5-495a-8065-cb6f88da3ba4 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:00.437966 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 690/1401] 10.222.0.94 () {54 vars in 943 bytes} [Wed Aug 24 04:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:43:00.445912 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d48fa2-afcd-4ba3-ba35-04a915983db0 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:00.446446 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d48fa2-afcd-4ba3-ba35-04a915983db0 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:00.446446 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d48fa2-afcd-4ba3-ba35-04a915983db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:00.555765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-42d48fa2-afcd-4ba3-ba35-04a915983db0 None None] MFA Rules not processed for user `40d2202203204b06a41e57b9d1a300fc`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:00.557039 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-42d48fa2-afcd-4ba3-ba35-04a915983db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:00.694390 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:00.701571 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 712/1402] 10.222.0.94 () {58 vars in 1040 bytes} [Wed Aug 24 04:43:00 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:43:00.706890 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb0692-1ad5-495a-8065-cb6f88da3ba4 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:00.709029 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-3acb0692-1ad5-495a-8065-cb6f88da3ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:00.882169 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb0692-1ad5-495a-8065-cb6f88da3ba4 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:00.992110 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:01.022752 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdc201-8877-4874-ba85-31b11ed79915 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40d2202203204b06a41e57b9d1a300fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:01.023370 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdc201-8877-4874-ba85-31b11ed79915 service swift] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:01.023653 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdc201-8877-4874-ba85-31b11ed79915 service swift] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:01.023922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdc201-8877-4874-ba85-31b11ed79915 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:01.025666 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-51cdc201-8877-4874-ba85-31b11ed79915 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:01.133778 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdc201-8877-4874-ba85-31b11ed79915 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:01.135439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdc201-8877-4874-ba85-31b11ed79915 service swift] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:01.146497 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 691/1403] 10.222.0.94 () {60 vars in 1384 bytes} [Wed Aug 24 04:43:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:43:02.578430 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859a9d4-8aee-42d9-9e80-0f42dc40447e None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:02.579056 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859a9d4-8aee-42d9-9e80-0f42dc40447e None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:02.579056 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859a9d4-8aee-42d9-9e80-0f42dc40447e None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:02.580533 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 713/1404] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:43:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:02.587124 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674c502-9167-4d91-9d64-e73a3ed7232a None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:02.588312 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674c502-9167-4d91-9d64-e73a3ed7232a None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:02.588882 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674c502-9167-4d91-9d64-e73a3ed7232a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:02.709305 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-b674c502-9167-4d91-9d64-e73a3ed7232a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:02.711119 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-b674c502-9167-4d91-9d64-e73a3ed7232a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:02.865250 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:02.921566 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 692/1405] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:03.261177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859a9d4-8aee-42d9-9e80-0f42dc40447e None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:03.262850 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-9859a9d4-8aee-42d9-9e80-0f42dc40447e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:03.516416 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859a9d4-8aee-42d9-9e80-0f42dc40447e None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:03.667612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:03.729925 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf0413-4b44-4ccb-8f81-856b2981348e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:03.730652 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf0413-4b44-4ccb-8f81-856b2981348e service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:03.730997 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf0413-4b44-4ccb-8f81-856b2981348e service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:03.731338 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf0413-4b44-4ccb-8f81-856b2981348e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:03.733149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-67bf0413-4b44-4ccb-8f81-856b2981348e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:03.881475 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf0413-4b44-4ccb-8f81-856b2981348e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:03.885583 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf0413-4b44-4ccb-8f81-856b2981348e service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:03.928654 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 714/1406] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:06.128453 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da603f-143c-49fd-8a46-3eab9707dd1d None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:06.129041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da603f-143c-49fd-8a46-3eab9707dd1d None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:06.129041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da603f-143c-49fd-8a46-3eab9707dd1d None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:06.130765 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 693/1407] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:06.136467 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce45a6b-540a-442c-9c67-556de8538603 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:06.136997 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce45a6b-540a-442c-9c67-556de8538603 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:06.136997 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce45a6b-540a-442c-9c67-556de8538603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:06.213287 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-3ce45a6b-540a-442c-9c67-556de8538603 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:06.215356 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-3ce45a6b-540a-442c-9c67-556de8538603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:06.261966 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:06.354102 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 715/1408] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:06.657875 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da603f-143c-49fd-8a46-3eab9707dd1d None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:06.659575 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-79da603f-143c-49fd-8a46-3eab9707dd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:06.884294 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da603f-143c-49fd-8a46-3eab9707dd1d None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:06.947620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:07.042180 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae98e0-b2ea-4d05-8b2b-b108327f45a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:07.042896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae98e0-b2ea-4d05-8b2b-b108327f45a5 service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:07.043234 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae98e0-b2ea-4d05-8b2b-b108327f45a5 service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:07.043610 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae98e0-b2ea-4d05-8b2b-b108327f45a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:07.045329 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-a7ae98e0-b2ea-4d05-8b2b-b108327f45a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:07.155898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae98e0-b2ea-4d05-8b2b-b108327f45a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:07.157531 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae98e0-b2ea-4d05-8b2b-b108327f45a5 service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:07.179079 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 694/1409] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:16.352698 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=27 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:17.175674 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=75 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:25.104268 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733088f9-4ed1-4e78-9ce7-31e8a625b4ea None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:25.104855 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733088f9-4ed1-4e78-9ce7-31e8a625b4ea None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:25.104855 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733088f9-4ed1-4e78-9ce7-31e8a625b4ea None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:25.106200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 716/1410] 10.222.0.94 () {54 vars in 918 bytes} [Wed Aug 24 04:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:25.111713 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03b63f-b2e8-4b0d-923a-c10fc5a0e002 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:25.112174 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03b63f-b2e8-4b0d-923a-c10fc5a0e002 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:25.112275 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03b63f-b2e8-4b0d-923a-c10fc5a0e002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:25.192886 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-bf03b63f-b2e8-4b0d-923a-c10fc5a0e002 None None] MFA Rules not processed for user `3a3274d404cb403bbf272ce023aa5e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:25.194766 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-bf03b63f-b2e8-4b0d-923a-c10fc5a0e002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:25.306075 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 695/1411] 10.222.0.94 () {58 vars in 1015 bytes} [Wed Aug 24 04:43:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:25.322625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d605b35-7923-445c-be0b-dabf623a4597 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:25.322908 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d605b35-7923-445c-be0b-dabf623a4597 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:25.323193 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d605b35-7923-445c-be0b-dabf623a4597 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:25.324560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 717/1412] 10.222.0.94 () {54 vars in 918 bytes} [Wed Aug 24 04:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:25.329824 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afb032-a52c-4f77-ab40-bddf0cf2c241 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:25.330115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afb032-a52c-4f77-ab40-bddf0cf2c241 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:25.330392 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afb032-a52c-4f77-ab40-bddf0cf2c241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:25.420994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:25.426583 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-59afb032-a52c-4f77-ab40-bddf0cf2c241 None None] MFA Rules not processed for user `5bdbda2b9c8f48338c5117585a229cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:25.428446 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-59afb032-a52c-4f77-ab40-bddf0cf2c241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:25.562335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 696/1413] 10.222.0.94 () {58 vars in 1015 bytes} [Wed Aug 24 04:43:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:28.067472 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdda12f-f64a-4cd9-a8a2-dfb8bbc8177e None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:28.068029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdda12f-f64a-4cd9-a8a2-dfb8bbc8177e None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:28.068029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdda12f-f64a-4cd9-a8a2-dfb8bbc8177e None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:28.069370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 718/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:28.075037 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f74e5-2fb5-438f-953a-2f94c0db3dcc None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:28.075478 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f74e5-2fb5-438f-953a-2f94c0db3dcc None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:28.075582 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f74e5-2fb5-438f-953a-2f94c0db3dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:28.149135 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-511f74e5-2fb5-438f-953a-2f94c0db3dcc None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:28.150656 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-511f74e5-2fb5-438f-953a-2f94c0db3dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:28.214681 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:28.262135 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 697/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:28.565872 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdda12f-f64a-4cd9-a8a2-dfb8bbc8177e None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:28.568997 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-bcdda12f-f64a-4cd9-a8a2-dfb8bbc8177e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:28.756556 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdda12f-f64a-4cd9-a8a2-dfb8bbc8177e None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:28.847446 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:28.894354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bfaeb-6821-44a6-80b2-da5b118d44e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:28.895579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bfaeb-6821-44a6-80b2-da5b118d44e9 service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:28.895856 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bfaeb-6821-44a6-80b2-da5b118d44e9 service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:28.896127 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bfaeb-6821-44a6-80b2-da5b118d44e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:28.897856 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-a01bfaeb-6821-44a6-80b2-da5b118d44e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:29.014068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bfaeb-6821-44a6-80b2-da5b118d44e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:29.015722 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bfaeb-6821-44a6-80b2-da5b118d44e9 service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:29.036912 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 719/1416] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:29.974881 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a22612-af8c-40a8-8a12-11adc5dfd3e2 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:29.974881 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a22612-af8c-40a8-8a12-11adc5dfd3e2 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:29.975673 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a22612-af8c-40a8-8a12-11adc5dfd3e2 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:29.976453 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 698/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:43:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:29.982043 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3815cc8-7b23-48a7-ae6a-13d6c35682b7 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:29.982576 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3815cc8-7b23-48a7-ae6a-13d6c35682b7 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:29.982681 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3815cc8-7b23-48a7-ae6a-13d6c35682b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:30.075630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-d3815cc8-7b23-48a7-ae6a-13d6c35682b7 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:30.076919 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-d3815cc8-7b23-48a7-ae6a-13d6c35682b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:30.108731 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:30.203370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 720/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:30.357661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a22612-af8c-40a8-8a12-11adc5dfd3e2 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:30.359246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-b1a22612-af8c-40a8-8a12-11adc5dfd3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:30.539909 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a22612-af8c-40a8-8a12-11adc5dfd3e2 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:30.584456 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:30.672037 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54cf9b-ffa1-48f8-a52e-6cba40e0b59c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:30.672535 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54cf9b-ffa1-48f8-a52e-6cba40e0b59c service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:30.672814 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54cf9b-ffa1-48f8-a52e-6cba40e0b59c service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:30.673292 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54cf9b-ffa1-48f8-a52e-6cba40e0b59c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:30.675371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-6a54cf9b-ffa1-48f8-a52e-6cba40e0b59c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:30.780067 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a54cf9b-ffa1-48f8-a52e-6cba40e0b59c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:30.781704 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a54cf9b-ffa1-48f8-a52e-6cba40e0b59c service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:30.803210 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 699/1419] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:43:31.753746 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877319a8-8a2a-4746-845f-6517a0a8a8c9 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:31.754913 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877319a8-8a2a-4746-845f-6517a0a8a8c9 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:31.755023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877319a8-8a2a-4746-845f-6517a0a8a8c9 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:31.756511 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 721/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:43:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:31.761876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13de141-968b-425d-bc74-7a63562e298a None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:31.762358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13de141-968b-425d-bc74-7a63562e298a None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:31.762465 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13de141-968b-425d-bc74-7a63562e298a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:31.820657 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:31.843467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-d13de141-968b-425d-bc74-7a63562e298a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:31.844693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-d13de141-968b-425d-bc74-7a63562e298a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:31.946419 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 700/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:32.098983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877319a8-8a2a-4746-845f-6517a0a8a8c9 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:32.100731 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-877319a8-8a2a-4746-845f-6517a0a8a8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:32.249942 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877319a8-8a2a-4746-845f-6517a0a8a8c9 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:32.262789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:32.401227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525532a-2143-4e26-af74-111498307e0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:32.401945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525532a-2143-4e26-af74-111498307e0c service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:32.402224 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525532a-2143-4e26-af74-111498307e0c service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:32.402493 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525532a-2143-4e26-af74-111498307e0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:32.404170 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-1525532a-2143-4e26-af74-111498307e0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:32.515168 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525532a-2143-4e26-af74-111498307e0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:32.516833 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525532a-2143-4e26-af74-111498307e0c service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:32.539042 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 722/1422] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:33.419362 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63337837-0857-4b04-b357-f8b0f54cca87 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:33.419967 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63337837-0857-4b04-b357-f8b0f54cca87 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:33.419967 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63337837-0857-4b04-b357-f8b0f54cca87 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:33.421303 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 701/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:33.427636 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec67cca-8239-45eb-8153-fcbe7728e3ee None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:33.428139 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec67cca-8239-45eb-8153-fcbe7728e3ee None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:33.428236 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec67cca-8239-45eb-8153-fcbe7728e3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:33.449802 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:33.523035 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-2ec67cca-8239-45eb-8153-fcbe7728e3ee None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:33.524313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-2ec67cca-8239-45eb-8153-fcbe7728e3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:33.639890 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 723/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:33.793826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63337837-0857-4b04-b357-f8b0f54cca87 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:33.795418 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-63337837-0857-4b04-b357-f8b0f54cca87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:33.935275 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:33.973488 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63337837-0857-4b04-b357-f8b0f54cca87 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:34.092809 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff03ce-5717-4181-a1e5-cf78c36a87c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:34.093441 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff03ce-5717-4181-a1e5-cf78c36a87c9 service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:34.093730 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff03ce-5717-4181-a1e5-cf78c36a87c9 service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:34.094002 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff03ce-5717-4181-a1e5-cf78c36a87c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:34.095655 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-64ff03ce-5717-4181-a1e5-cf78c36a87c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:34.181303 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:34.196015 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff03ce-5717-4181-a1e5-cf78c36a87c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:34.197599 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff03ce-5717-4181-a1e5-cf78c36a87c9 service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:34.217070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 702/1425] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:35.105054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6780f-196c-4129-9130-5fa5d72608ea None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:35.105707 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6780f-196c-4129-9130-5fa5d72608ea None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:35.105707 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6780f-196c-4129-9130-5fa5d72608ea None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:35.107027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 724/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:35.112461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902a541-495b-4394-88c2-0a84ab3f2bc4 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:35.113101 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902a541-495b-4394-88c2-0a84ab3f2bc4 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:35.113219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902a541-495b-4394-88c2-0a84ab3f2bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:35.195718 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-7902a541-495b-4394-88c2-0a84ab3f2bc4 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:35.196945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-7902a541-495b-4394-88c2-0a84ab3f2bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:35.301906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 703/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:35.465396 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6780f-196c-4129-9130-5fa5d72608ea None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:35.467334 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-89f6780f-196c-4129-9130-5fa5d72608ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:35.576959 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:35.650476 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6780f-196c-4129-9130-5fa5d72608ea None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:35.777740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a18ca-6f87-41b9-a76a-ab7d1e5a2861 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:35.778354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a18ca-6f87-41b9-a76a-ab7d1e5a2861 service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:35.778639 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a18ca-6f87-41b9-a76a-ab7d1e5a2861 service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:35.778911 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a18ca-6f87-41b9-a76a-ab7d1e5a2861 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:35.780562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-da2a18ca-6f87-41b9-a76a-ab7d1e5a2861 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:35.832352 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:35.875980 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a18ca-6f87-41b9-a76a-ab7d1e5a2861 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:35.877609 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a18ca-6f87-41b9-a76a-ab7d1e5a2861 service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:35.897218 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 725/1428] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:36.740943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec125d8-94eb-4309-bd3a-d240f9338771 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:36.741557 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec125d8-94eb-4309-bd3a-d240f9338771 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:36.741557 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec125d8-94eb-4309-bd3a-d240f9338771 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:36.742917 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 704/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:36.748849 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020b096-fe09-4efc-acf9-29800b5064f0 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:36.749799 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020b096-fe09-4efc-acf9-29800b5064f0 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:36.749799 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020b096-fe09-4efc-acf9-29800b5064f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:36.833477 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-9020b096-fe09-4efc-acf9-29800b5064f0 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:36.834824 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-9020b096-fe09-4efc-acf9-29800b5064f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:36.940233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 726/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:37.161772 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec125d8-94eb-4309-bd3a-d240f9338771 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:37.163378 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-2ec125d8-94eb-4309-bd3a-d240f9338771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:37.215871 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:37.320775 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec125d8-94eb-4309-bd3a-d240f9338771 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:37.441097 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8daba7-c516-40a3-90c2-f945e66ac14e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:37.442381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8daba7-c516-40a3-90c2-f945e66ac14e service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:37.442855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8daba7-c516-40a3-90c2-f945e66ac14e service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:37.443124 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8daba7-c516-40a3-90c2-f945e66ac14e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:37.444834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-9c8daba7-c516-40a3-90c2-f945e66ac14e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:37.452270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:37.545930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8daba7-c516-40a3-90c2-f945e66ac14e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:37.547524 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8daba7-c516-40a3-90c2-f945e66ac14e service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:37.567588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 705/1431] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:38.395096 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1eb60-2267-44e1-a6cb-d6bfb7fc32fb None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:38.395686 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1eb60-2267-44e1-a6cb-d6bfb7fc32fb None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:38.395686 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1eb60-2267-44e1-a6cb-d6bfb7fc32fb None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:38.397031 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 727/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:38.402231 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d72bb-2d1c-4a77-9470-a5642fc3f0d5 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:38.402704 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d72bb-2d1c-4a77-9470-a5642fc3f0d5 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:38.402810 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d72bb-2d1c-4a77-9470-a5642fc3f0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:38.482270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-b38d72bb-2d1c-4a77-9470-a5642fc3f0d5 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:38.483511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-b38d72bb-2d1c-4a77-9470-a5642fc3f0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:38.558456 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:38.594002 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 706/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:38.753006 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1eb60-2267-44e1-a6cb-d6bfb7fc32fb None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:38.755223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-94a1eb60-2267-44e1-a6cb-d6bfb7fc32fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:38.774944 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:38.911364 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1eb60-2267-44e1-a6cb-d6bfb7fc32fb None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:39.005840 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:39.036181 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49cb31-fc80-47c9-9ab1-29115e6982bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:39.036809 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49cb31-fc80-47c9-9ab1-29115e6982bb service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:39.037091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49cb31-fc80-47c9-9ab1-29115e6982bb service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:39.037374 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49cb31-fc80-47c9-9ab1-29115e6982bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:39.039041 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-0d49cb31-fc80-47c9-9ab1-29115e6982bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:39.133703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d49cb31-fc80-47c9-9ab1-29115e6982bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:39.135310 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d49cb31-fc80-47c9-9ab1-29115e6982bb service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:39.154309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 728/1434] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:39.999088 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fad75-b136-4955-9bf8-3ce7a194bad7 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:39.999656 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fad75-b136-4955-9bf8-3ce7a194bad7 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:39.999656 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fad75-b136-4955-9bf8-3ce7a194bad7 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:40.000996 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 707/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:40.006541 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d185225-0eed-4831-87b9-46941316d4fd None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:40.007100 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d185225-0eed-4831-87b9-46941316d4fd None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:40.007100 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d185225-0eed-4831-87b9-46941316d4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:40.091831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-7d185225-0eed-4831-87b9-46941316d4fd None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:40.093067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-7d185225-0eed-4831-87b9-46941316d4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:40.138071 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:40.204285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 729/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:40.357954 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936fad75-b136-4955-9bf8-3ce7a194bad7 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:40.359521 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-936fad75-b136-4955-9bf8-3ce7a194bad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:40.513690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936fad75-b136-4955-9bf8-3ce7a194bad7 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:40.570739 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:40.638026 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fff36-da19-41f7-9250-fa77a84a0e93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:40.638647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fff36-da19-41f7-9250-fa77a84a0e93 service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:40.638956 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fff36-da19-41f7-9250-fa77a84a0e93 service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:40.639231 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fff36-da19-41f7-9250-fa77a84a0e93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:40.640875 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-ba7fff36-da19-41f7-9250-fa77a84a0e93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:40.755566 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fff36-da19-41f7-9250-fa77a84a0e93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:40.757187 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fff36-da19-41f7-9250-fa77a84a0e93 service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:40.777106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 708/1437] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:41.621557 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaed0b9-b849-4cbb-9682-40fe4fc8c001 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:41.622288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaed0b9-b849-4cbb-9682-40fe4fc8c001 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:41.622288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaed0b9-b849-4cbb-9682-40fe4fc8c001 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:41.623465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 730/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:41.629610 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46b0c4-7221-4ad0-a85d-fb1809a8d01a None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:41.630156 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46b0c4-7221-4ad0-a85d-fb1809a8d01a None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:41.630156 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46b0c4-7221-4ad0-a85d-fb1809a8d01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:41.712752 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-2c46b0c4-7221-4ad0-a85d-fb1809a8d01a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:41.714009 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-2c46b0c4-7221-4ad0-a85d-fb1809a8d01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:41.716190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:41.817132 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 709/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:41.985773 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaed0b9-b849-4cbb-9682-40fe4fc8c001 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:41.987330 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-0eaed0b9-b849-4cbb-9682-40fe4fc8c001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:42.148914 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaed0b9-b849-4cbb-9682-40fe4fc8c001 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:42.178523 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:42.279410 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dc19d-4aaa-4ddb-a0c9-7ea4d5d8f4b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:42.280061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dc19d-4aaa-4ddb-a0c9-7ea4d5d8f4b4 service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:42.280339 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dc19d-4aaa-4ddb-a0c9-7ea4d5d8f4b4 service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:42.280607 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dc19d-4aaa-4ddb-a0c9-7ea4d5d8f4b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:42.282370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-416dc19d-4aaa-4ddb-a0c9-7ea4d5d8f4b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:42.383906 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416dc19d-4aaa-4ddb-a0c9-7ea4d5d8f4b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:42.385598 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416dc19d-4aaa-4ddb-a0c9-7ea4d5d8f4b4 service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:42.407152 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 731/1440] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:44.377748 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfd6e1-8a2a-4ba1-9abc-23f7cd47920e None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:44.378701 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfd6e1-8a2a-4ba1-9abc-23f7cd47920e None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:44.378701 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfd6e1-8a2a-4ba1-9abc-23f7cd47920e None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:44.379846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 710/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:44.385554 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f142e-feda-4611-94e3-3cfd8772453b None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:44.386018 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f142e-feda-4611-94e3-3cfd8772453b None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:44.386158 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f142e-feda-4611-94e3-3cfd8772453b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:44.429930 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:44.457190 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-442f142e-feda-4611-94e3-3cfd8772453b None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:44.458452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-442f142e-feda-4611-94e3-3cfd8772453b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:44.564143 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 732/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:44.866195 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfd6e1-8a2a-4ba1-9abc-23f7cd47920e None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:44.867765 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-33bfd6e1-8a2a-4ba1-9abc-23f7cd47920e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:44.993669 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfd6e1-8a2a-4ba1-9abc-23f7cd47920e None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:45.030508 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:45.081944 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91a361-5e77-4b36-b7fb-56c91ba465fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:45.082562 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91a361-5e77-4b36-b7fb-56c91ba465fa service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:45.082837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91a361-5e77-4b36-b7fb-56c91ba465fa service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:45.083102 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91a361-5e77-4b36-b7fb-56c91ba465fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:45.084746 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-ef91a361-5e77-4b36-b7fb-56c91ba465fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:45.210590 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91a361-5e77-4b36-b7fb-56c91ba465fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:45.211931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91a361-5e77-4b36-b7fb-56c91ba465fa service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:45.231901 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 711/1443] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:47.385228 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db1ef4-5088-4e15-a6c6-29b764c5bcfc None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:47.385944 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db1ef4-5088-4e15-a6c6-29b764c5bcfc None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:47.385944 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db1ef4-5088-4e15-a6c6-29b764c5bcfc None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:47.387378 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 733/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:43:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:47.394789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4864a9-5f0d-4b7b-afdd-22f72c30ed63 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:47.395416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4864a9-5f0d-4b7b-afdd-22f72c30ed63 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:47.395521 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4864a9-5f0d-4b7b-afdd-22f72c30ed63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:47.483205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-4a4864a9-5f0d-4b7b-afdd-22f72c30ed63 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:47.484433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-4a4864a9-5f0d-4b7b-afdd-22f72c30ed63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:47.507773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:47.628825 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 712/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:47.915205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db1ef4-5088-4e15-a6c6-29b764c5bcfc None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:47.916770 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-36db1ef4-5088-4e15-a6c6-29b764c5bcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:48.060769 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db1ef4-5088-4e15-a6c6-29b764c5bcfc None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:48.076606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:48.150119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d72c6f-5e2a-4a64-87ca-6af72b83f989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:48.150731 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d72c6f-5e2a-4a64-87ca-6af72b83f989 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:48.151004 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d72c6f-5e2a-4a64-87ca-6af72b83f989 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:48.151276 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d72c6f-5e2a-4a64-87ca-6af72b83f989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:48.152900 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-d3d72c6f-5e2a-4a64-87ca-6af72b83f989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:48.289052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d72c6f-5e2a-4a64-87ca-6af72b83f989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:48.290551 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d72c6f-5e2a-4a64-87ca-6af72b83f989 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:48.310127 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 734/1446] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:50.807663 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b255cf-4320-48d2-9aa1-ab62cb87efb2 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:50.808199 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b255cf-4320-48d2-9aa1-ab62cb87efb2 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:50.808199 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b255cf-4320-48d2-9aa1-ab62cb87efb2 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:50.809557 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 713/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:50.815183 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d373a5-e507-4a19-8444-85be8d1af9a3 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:50.815863 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d373a5-e507-4a19-8444-85be8d1af9a3 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:50.816121 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d373a5-e507-4a19-8444-85be8d1af9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:50.873444 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:50.895425 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-46d373a5-e507-4a19-8444-85be8d1af9a3 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:50.896668 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-46d373a5-e507-4a19-8444-85be8d1af9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:51.003414 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 735/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:51.290220 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b255cf-4320-48d2-9aa1-ab62cb87efb2 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:51.291796 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-d8b255cf-4320-48d2-9aa1-ab62cb87efb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:51.415375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b255cf-4320-48d2-9aa1-ab62cb87efb2 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:51.462542 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:51.501423 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5929ced-ce72-4eb1-8db9-96286e2f9261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:51.502066 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5929ced-ce72-4eb1-8db9-96286e2f9261 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:51.502347 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5929ced-ce72-4eb1-8db9-96286e2f9261 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:51.502617 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5929ced-ce72-4eb1-8db9-96286e2f9261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:51.504352 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-c5929ced-ce72-4eb1-8db9-96286e2f9261 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:51.647184 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5929ced-ce72-4eb1-8db9-96286e2f9261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:51.648552 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5929ced-ce72-4eb1-8db9-96286e2f9261 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:51.670694 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 714/1449] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:53.880224 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d65f97-7953-4856-adf1-47d2ce135c0e None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:53.880814 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d65f97-7953-4856-adf1-47d2ce135c0e None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:53.880814 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d65f97-7953-4856-adf1-47d2ce135c0e None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:53.882214 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 736/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:43:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:53.888437 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e5b55-6330-4e97-a3c2-3ce7a20c1237 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:53.889022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e5b55-6330-4e97-a3c2-3ce7a20c1237 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:53.889022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e5b55-6330-4e97-a3c2-3ce7a20c1237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:53.975377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-759e5b55-6330-4e97-a3c2-3ce7a20c1237 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:53.975377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-759e5b55-6330-4e97-a3c2-3ce7a20c1237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:53.996880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:54.104851 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 715/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:54.397041 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d65f97-7953-4856-adf1-47d2ce135c0e None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:54.398674 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-01d65f97-7953-4856-adf1-47d2ce135c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:54.539423 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d65f97-7953-4856-adf1-47d2ce135c0e None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:54.562110 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:54.627531 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7fee0-2a66-442f-bdfb-acfa49a4aa15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:54.628212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7fee0-2a66-442f-bdfb-acfa49a4aa15 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:54.628490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7fee0-2a66-442f-bdfb-acfa49a4aa15 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:54.628760 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7fee0-2a66-442f-bdfb-acfa49a4aa15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:54.630481 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-90c7fee0-2a66-442f-bdfb-acfa49a4aa15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:54.782074 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7fee0-2a66-442f-bdfb-acfa49a4aa15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:54.783535 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7fee0-2a66-442f-bdfb-acfa49a4aa15 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:54.807276 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 737/1452] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:57.002389 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237483e4-c0e0-41f8-a26d-d7bf78fd5911 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:57.003703 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237483e4-c0e0-41f8-a26d-d7bf78fd5911 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:57.003703 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237483e4-c0e0-41f8-a26d-d7bf78fd5911 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:57.005110 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 716/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:43:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:57.011774 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c868b-66ab-4a85-b708-9871dc46fc16 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:57.012290 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c868b-66ab-4a85-b708-9871dc46fc16 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:57.012389 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c868b-66ab-4a85-b708-9871dc46fc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:57.078983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:57.082136 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-429c868b-66ab-4a85-b708-9871dc46fc16 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:57.084083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-429c868b-66ab-4a85-b708-9871dc46fc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:57.195382 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 738/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:57.487641 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237483e4-c0e0-41f8-a26d-d7bf78fd5911 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:57.488934 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-237483e4-c0e0-41f8-a26d-d7bf78fd5911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:57.605238 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237483e4-c0e0-41f8-a26d-d7bf78fd5911 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:57.657591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:57.685232 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24eee8-4b31-4e6f-bef5-434f5f54e031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:57.685232 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24eee8-4b31-4e6f-bef5-434f5f54e031 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:57.685498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24eee8-4b31-4e6f-bef5-434f5f54e031 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:57.685768 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24eee8-4b31-4e6f-bef5-434f5f54e031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:57.687411 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-bf24eee8-4b31-4e6f-bef5-434f5f54e031 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:57.803514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24eee8-4b31-4e6f-bef5-434f5f54e031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:57.804963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24eee8-4b31-4e6f-bef5-434f5f54e031 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:57.826904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 717/1455] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:59.941159 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134adb1-a071-47d1-9b3a-dfa182af2556 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:59.941759 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134adb1-a071-47d1-9b3a-dfa182af2556 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:59.941984 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134adb1-a071-47d1-9b3a-dfa182af2556 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:59.943403 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 739/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:43:59.949693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f10b2-1e83-4556-8b9d-af6c7beced63 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:59.950412 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f10b2-1e83-4556-8b9d-af6c7beced63 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:59.950412 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f10b2-1e83-4556-8b9d-af6c7beced63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:00.032129 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-265f10b2-1e83-4556-8b9d-af6c7beced63 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:00.033522 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-265f10b2-1e83-4556-8b9d-af6c7beced63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:00.083482 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:00.167420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 718/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:44:00.465344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134adb1-a071-47d1-9b3a-dfa182af2556 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:00.467341 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-0134adb1-a071-47d1-9b3a-dfa182af2556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:00.630741 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134adb1-a071-47d1-9b3a-dfa182af2556 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:00.672361 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:00.742827 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c47173-eeb7-464d-bf13-9aef16e1620e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:00.743378 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c47173-eeb7-464d-bf13-9aef16e1620e service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:00.743682 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c47173-eeb7-464d-bf13-9aef16e1620e service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:00.744002 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c47173-eeb7-464d-bf13-9aef16e1620e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:00.745760 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-91c47173-eeb7-464d-bf13-9aef16e1620e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:00.886262 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c47173-eeb7-464d-bf13-9aef16e1620e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:00.887767 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c47173-eeb7-464d-bf13-9aef16e1620e service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:00.909759 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 740/1458] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:44:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:44:03.031459 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004e01d-d897-4ef2-9031-1e0ea666b3cb None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:03.032037 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004e01d-d897-4ef2-9031-1e0ea666b3cb None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:03.032037 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004e01d-d897-4ef2-9031-1e0ea666b3cb None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:03.033385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 719/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:44:03.040091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544e858-3988-4516-a4cb-37519cfaa7ca None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:03.040565 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544e858-3988-4516-a4cb-37519cfaa7ca None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:03.040662 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544e858-3988-4516-a4cb-37519cfaa7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:03.112931 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-3544e858-3988-4516-a4cb-37519cfaa7ca None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:03.114266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-3544e858-3988-4516-a4cb-37519cfaa7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:03.123344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:03.217638 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 741/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:44:03.505051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004e01d-d897-4ef2-9031-1e0ea666b3cb None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:03.508000 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-1004e01d-d897-4ef2-9031-1e0ea666b3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:03.655975 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004e01d-d897-4ef2-9031-1e0ea666b3cb None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:03.725963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:03.748956 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8353af7-67b3-400c-94ec-a979fafd10b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:03.749523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8353af7-67b3-400c-94ec-a979fafd10b9 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:03.749806 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8353af7-67b3-400c-94ec-a979fafd10b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:03.750078 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8353af7-67b3-400c-94ec-a979fafd10b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:03.751781 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-f8353af7-67b3-400c-94ec-a979fafd10b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:03.882712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8353af7-67b3-400c-94ec-a979fafd10b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:03.884162 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8353af7-67b3-400c-94ec-a979fafd10b9 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:03.907829 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 720/1461] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:44:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:44:05.964435 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff382a-0fef-4535-9485-653a02b438aa None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:05.965031 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff382a-0fef-4535-9485-653a02b438aa None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:05.965031 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff382a-0fef-4535-9485-653a02b438aa None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:05.966300 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 742/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:44:05.972777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cea68-55d9-4d2a-aabe-c3824f767a98 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:05.973324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cea68-55d9-4d2a-aabe-c3824f767a98 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:05.973324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cea68-55d9-4d2a-aabe-c3824f767a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:06.042321 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-021cea68-55d9-4d2a-aabe-c3824f767a98 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:06.043568 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-021cea68-55d9-4d2a-aabe-c3824f767a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:06.086598 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:06.149529 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 721/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:44:06.432641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff382a-0fef-4535-9485-653a02b438aa None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:06.434278 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-e4ff382a-0fef-4535-9485-653a02b438aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:06.550894 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff382a-0fef-4535-9485-653a02b438aa None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:06.594805 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:06.638464 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7efb55-21a8-4370-bed2-b9efcb70693a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:06.639081 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7efb55-21a8-4370-bed2-b9efcb70693a service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:06.639356 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7efb55-21a8-4370-bed2-b9efcb70693a service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:06.639626 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7efb55-21a8-4370-bed2-b9efcb70693a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:06.641578 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-0f7efb55-21a8-4370-bed2-b9efcb70693a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:06.756485 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7efb55-21a8-4370-bed2-b9efcb70693a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:06.757968 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7efb55-21a8-4370-bed2-b9efcb70693a service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:06.777163 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 743/1464] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:44:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:44:08.732098 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2c9d6-24ab-41ea-be57-efa413d0c0a2 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:08.732669 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2c9d6-24ab-41ea-be57-efa413d0c0a2 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:08.732669 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2c9d6-24ab-41ea-be57-efa413d0c0a2 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:08.734118 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 722/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:44:08.740126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2e1b6-e488-49d6-845f-76aec47b727d None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:08.740615 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2e1b6-e488-49d6-845f-76aec47b727d None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:08.740719 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2e1b6-e488-49d6-845f-76aec47b727d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:08.810933 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-36d2e1b6-e488-49d6-845f-76aec47b727d None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:08.812145 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-36d2e1b6-e488-49d6-845f-76aec47b727d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:08.831327 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:08.914742 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 744/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:44:09.198486 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2c9d6-24ab-41ea-be57-efa413d0c0a2 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:09.200042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-bff2c9d6-24ab-41ea-be57-efa413d0c0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:09.312056 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2c9d6-24ab-41ea-be57-efa413d0c0a2 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:09.389813 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:09.397975 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae3883-f556-4f5c-8049-32f0c3fb60c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:09.398589 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae3883-f556-4f5c-8049-32f0c3fb60c9 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:09.398878 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae3883-f556-4f5c-8049-32f0c3fb60c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:09.399149 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae3883-f556-4f5c-8049-32f0c3fb60c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:09.400796 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-adae3883-f556-4f5c-8049-32f0c3fb60c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:09.519737 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae3883-f556-4f5c-8049-32f0c3fb60c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:09.521176 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae3883-f556-4f5c-8049-32f0c3fb60c9 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:09.540423 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 723/1467] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:44:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:44:11.524459 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77e6f4-4e12-465e-977e-4b268d0e39e5 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:11.525141 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77e6f4-4e12-465e-977e-4b268d0e39e5 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:11.525141 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77e6f4-4e12-465e-977e-4b268d0e39e5 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:11.526416 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 745/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:44:11.532358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e529a-eb54-4b0f-9dc9-fba0a93cff54 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:11.532875 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e529a-eb54-4b0f-9dc9-fba0a93cff54 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:11.533036 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e529a-eb54-4b0f-9dc9-fba0a93cff54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:11.603706 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-d97e529a-eb54-4b0f-9dc9-fba0a93cff54 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:11.604940 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-d97e529a-eb54-4b0f-9dc9-fba0a93cff54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:11.656239 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:11.711704 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 724/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:44:12.001784 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77e6f4-4e12-465e-977e-4b268d0e39e5 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:12.003468 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-df77e6f4-4e12-465e-977e-4b268d0e39e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:12.111250 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77e6f4-4e12-465e-977e-4b268d0e39e5 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:12.162246 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:12.190892 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83a93a-357a-4d7e-8842-41c5dfcb2c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:12.191142 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83a93a-357a-4d7e-8842-41c5dfcb2c6c service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:12.191255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83a93a-357a-4d7e-8842-41c5dfcb2c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:12.191466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83a93a-357a-4d7e-8842-41c5dfcb2c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:12.193129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ec83a93a-357a-4d7e-8842-41c5dfcb2c6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:12.305129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83a93a-357a-4d7e-8842-41c5dfcb2c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:12.306591 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83a93a-357a-4d7e-8842-41c5dfcb2c6c service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:12.325288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 746/1470] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:44:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:44:21.709633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=22 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:22.322972 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=66 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:32.506750 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dfc6a-21b3-47d1-9ef9-bf1afcfa98b9 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:32.507589 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dfc6a-21b3-47d1-9ef9-bf1afcfa98b9 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:32.507589 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dfc6a-21b3-47d1-9ef9-bf1afcfa98b9 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:32.508679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 725/1471] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:44:32.514782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30cad0-a2ff-4a8b-bb53-892299aed4ad None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:32.515280 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30cad0-a2ff-4a8b-bb53-892299aed4ad None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:32.515397 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30cad0-a2ff-4a8b-bb53-892299aed4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:32.591992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-bd30cad0-a2ff-4a8b-bb53-892299aed4ad None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:32.593444 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-bd30cad0-a2ff-4a8b-bb53-892299aed4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:32.726854 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 747/1472] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:44:33.035431 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdcb12-6f84-4ec9-aab8-c063a95cfa0c None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:33.035718 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdcb12-6f84-4ec9-aab8-c063a95cfa0c None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:33.036000 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdcb12-6f84-4ec9-aab8-c063a95cfa0c None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:33.037314 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 726/1473] 10.222.0.94 () {54 vars in 967 bytes} [Wed Aug 24 04:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:44:33.042358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764205a-32da-489f-af3b-cbef0acfdd92 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:33.042638 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764205a-32da-489f-af3b-cbef0acfdd92 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:33.042910 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764205a-32da-489f-af3b-cbef0acfdd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:33.120633 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-f764205a-32da-489f-af3b-cbef0acfdd92 None None] MFA Rules not processed for user `bbec984d81c84035887220056b3790ec`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:33.121918 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-f764205a-32da-489f-af3b-cbef0acfdd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:33.144732 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:33.205392 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 748/1474] 10.222.0.94 () {58 vars in 1064 bytes} [Wed Aug 24 04:44:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:44:33.213187 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdcb12-6f84-4ec9-aab8-c063a95cfa0c None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:33.214795 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-98fdcb12-6f84-4ec9-aab8-c063a95cfa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:33.323934 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdcb12-6f84-4ec9-aab8-c063a95cfa0c None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:33.403346 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9f9ff-901a-4568-bc60-c66524e9dfcd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbec984d81c84035887220056b3790ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:33.404000 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9f9ff-901a-4568-bc60-c66524e9dfcd service glance] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:33.404270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9f9ff-901a-4568-bc60-c66524e9dfcd service glance] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:33.404539 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9f9ff-901a-4568-bc60-c66524e9dfcd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:33.406208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-4ab9f9ff-901a-4568-bc60-c66524e9dfcd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:33.465203 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:33.524092 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9f9ff-901a-4568-bc60-c66524e9dfcd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:33.525693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9f9ff-901a-4568-bc60-c66524e9dfcd service glance] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:33.545690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 727/1475] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:44:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:44:35.636654 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ff483-cf50-420e-82ac-65b472514454 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:35.637204 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ff483-cf50-420e-82ac-65b472514454 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:35.637204 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ff483-cf50-420e-82ac-65b472514454 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:35.638631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 749/1476] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:44:35.645367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4c91f-b96e-4db4-852d-6bb6351bb66f None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:35.645940 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4c91f-b96e-4db4-852d-6bb6351bb66f None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:35.646055 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4c91f-b96e-4db4-852d-6bb6351bb66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:35.718538 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-dee4c91f-b96e-4db4-852d-6bb6351bb66f None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:35.720411 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-dee4c91f-b96e-4db4-852d-6bb6351bb66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:35.831719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 728/1477] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:44:36.118294 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ff483-cf50-420e-82ac-65b472514454 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:36.119874 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-059ff483-cf50-420e-82ac-65b472514454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:36.267230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ff483-cf50-420e-82ac-65b472514454 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:36.326120 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:36.381652 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028b52a-1b39-4228-9d6e-be3c20ed8419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:36.382280 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028b52a-1b39-4228-9d6e-be3c20ed8419 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:36.382553 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028b52a-1b39-4228-9d6e-be3c20ed8419 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:36.382823 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028b52a-1b39-4228-9d6e-be3c20ed8419 admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:36.383477 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028b52a-1b39-4228-9d6e-be3c20ed8419 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:36.385369 dv-cinder-854264-1-smb devstack@keystone.service[93412]: WARNING py.warnings [None req-6028b52a-1b39-4228-9d6e-be3c20ed8419 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:44:36.385369 dv-cinder-854264-1-smb devstack@keystone.service[93412]: warnings.warn(msg) Aug 24 04:44:36.385369 dv-cinder-854264-1-smb devstack@keystone.service[93412]: Aug 24 04:44:36.386618 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028b52a-1b39-4228-9d6e-be3c20ed8419 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:36.410134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 750/1478] 10.222.0.94 () {56 vars in 1108 bytes} [Wed Aug 24 04:44:36 2022] GET /identity/v3/projects => generated 2553 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:44:38.421095 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a565a-6b41-4dbd-8dfd-0579a0b5a68a None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:38.421911 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a565a-6b41-4dbd-8dfd-0579a0b5a68a None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:38.421911 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a565a-6b41-4dbd-8dfd-0579a0b5a68a None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:38.423864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 729/1479] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:44:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:44:38.430719 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc757e-9354-4585-aed6-5c02ae636e3b None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:38.431296 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc757e-9354-4585-aed6-5c02ae636e3b None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:38.431518 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc757e-9354-4585-aed6-5c02ae636e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:38.508465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-3adc757e-9354-4585-aed6-5c02ae636e3b None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:38.518545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-3adc757e-9354-4585-aed6-5c02ae636e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:38.625368 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 751/1480] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:44:38.926658 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a565a-6b41-4dbd-8dfd-0579a0b5a68a None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:38.928242 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-d19a565a-6b41-4dbd-8dfd-0579a0b5a68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:38.938970 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:39.086665 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a565a-6b41-4dbd-8dfd-0579a0b5a68a None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:39.169294 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:39.205817 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe6766-b39e-477e-9c86-d8533b082655 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:39.206394 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe6766-b39e-477e-9c86-d8533b082655 service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:39.206672 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe6766-b39e-477e-9c86-d8533b082655 service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:39.206946 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe6766-b39e-477e-9c86-d8533b082655 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:39.208623 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-57fe6766-b39e-477e-9c86-d8533b082655 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:39.300856 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe6766-b39e-477e-9c86-d8533b082655 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:39.302496 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe6766-b39e-477e-9c86-d8533b082655 service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:39.321123 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 730/1481] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:44:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:44:41.510495 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324508e5-d28d-409c-b9ee-3a6e29f41eb6 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:41.511079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324508e5-d28d-409c-b9ee-3a6e29f41eb6 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:41.511079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324508e5-d28d-409c-b9ee-3a6e29f41eb6 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:41.512540 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 752/1482] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:44:41.518788 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49359bf-6f2e-47ff-83eb-e7c92efc6747 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:41.519319 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49359bf-6f2e-47ff-83eb-e7c92efc6747 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:41.519319 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49359bf-6f2e-47ff-83eb-e7c92efc6747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:41.594225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-e49359bf-6f2e-47ff-83eb-e7c92efc6747 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:41.596371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e49359bf-6f2e-47ff-83eb-e7c92efc6747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:41.660598 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:41.729025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 731/1483] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:44:42.018391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324508e5-d28d-409c-b9ee-3a6e29f41eb6 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:42.020041 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-324508e5-d28d-409c-b9ee-3a6e29f41eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:42.046039 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:42.133708 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324508e5-d28d-409c-b9ee-3a6e29f41eb6 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:42.212161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde96fa-ec6b-4759-950d-8b0e1d2ff502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:42.212694 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde96fa-ec6b-4759-950d-8b0e1d2ff502 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:42.212969 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde96fa-ec6b-4759-950d-8b0e1d2ff502 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:42.213244 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde96fa-ec6b-4759-950d-8b0e1d2ff502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:42.214902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-cdde96fa-ec6b-4759-950d-8b0e1d2ff502 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:42.291859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:42.328118 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde96fa-ec6b-4759-950d-8b0e1d2ff502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:42.330306 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde96fa-ec6b-4759-950d-8b0e1d2ff502 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:42.349087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 753/1484] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:44:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:44:44.356208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669860d-6c01-48c5-81ac-1d88c5d0f133 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:44.356843 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669860d-6c01-48c5-81ac-1d88c5d0f133 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:44.356843 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669860d-6c01-48c5-81ac-1d88c5d0f133 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:44.358130 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 732/1485] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:44:44.363800 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed695a97-01a9-4960-97bf-75181cf632c1 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:44.364292 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed695a97-01a9-4960-97bf-75181cf632c1 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:44.364389 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed695a97-01a9-4960-97bf-75181cf632c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:44.437461 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-ed695a97-01a9-4960-97bf-75181cf632c1 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:44.438930 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ed695a97-01a9-4960-97bf-75181cf632c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:44.537974 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 754/1486] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:44:44.834074 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669860d-6c01-48c5-81ac-1d88c5d0f133 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:44.835620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-c669860d-6c01-48c5-81ac-1d88c5d0f133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:44.946062 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669860d-6c01-48c5-81ac-1d88c5d0f133 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:45.021785 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:45.023683 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e899bf-78a2-49f1-aea7-f09cfeb09750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:45.024302 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e899bf-78a2-49f1-aea7-f09cfeb09750 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:45.024772 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e899bf-78a2-49f1-aea7-f09cfeb09750 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:45.025340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e899bf-78a2-49f1-aea7-f09cfeb09750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:45.027162 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-c2e899bf-78a2-49f1-aea7-f09cfeb09750 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:45.141271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e899bf-78a2-49f1-aea7-f09cfeb09750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:45.142779 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e899bf-78a2-49f1-aea7-f09cfeb09750 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:45.161262 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 733/1487] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:44:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:44:47.229619 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d487987-cedf-414d-8b78-5cc45dbbc2bb None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:47.230174 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d487987-cedf-414d-8b78-5cc45dbbc2bb None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:47.230174 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d487987-cedf-414d-8b78-5cc45dbbc2bb None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:47.231530 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 755/1488] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:44:47.237222 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a7d40-5a9b-4b03-a6db-ae87babaa073 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:47.237764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a7d40-5a9b-4b03-a6db-ae87babaa073 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:47.237863 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a7d40-5a9b-4b03-a6db-ae87babaa073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:47.307568 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-6c6a7d40-5a9b-4b03-a6db-ae87babaa073 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:47.308829 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-6c6a7d40-5a9b-4b03-a6db-ae87babaa073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:47.364378 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:47.412572 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 734/1489] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:44:47.706303 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d487987-cedf-414d-8b78-5cc45dbbc2bb None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:47.707886 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-7d487987-cedf-414d-8b78-5cc45dbbc2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:47.745862 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:47.816963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d487987-cedf-414d-8b78-5cc45dbbc2bb None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:47.892520 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f3048-84d5-4a28-ba76-7c83e20b22e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:47.897437 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f3048-84d5-4a28-ba76-7c83e20b22e1 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:47.897437 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f3048-84d5-4a28-ba76-7c83e20b22e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:47.897437 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f3048-84d5-4a28-ba76-7c83e20b22e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:47.897437 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-d14f3048-84d5-4a28-ba76-7c83e20b22e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:47.981112 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:48.011047 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f3048-84d5-4a28-ba76-7c83e20b22e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:48.012486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f3048-84d5-4a28-ba76-7c83e20b22e1 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:48.032216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 756/1490] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:44:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:44:50.223785 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05338879-3bc9-4ba4-8e42-b72d3a174e46 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:50.224551 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05338879-3bc9-4ba4-8e42-b72d3a174e46 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:50.224551 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05338879-3bc9-4ba4-8e42-b72d3a174e46 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:50.225982 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 735/1491] 10.222.0.94 () {54 vars in 927 bytes} [Wed Aug 24 04:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:44:50.232123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31c969-00aa-4878-bc26-f718e54c49e8 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:50.232594 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31c969-00aa-4878-bc26-f718e54c49e8 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:50.232711 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31c969-00aa-4878-bc26-f718e54c49e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:50.305189 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-ad31c969-00aa-4878-bc26-f718e54c49e8 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:50.306664 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ad31c969-00aa-4878-bc26-f718e54c49e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:50.413376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 757/1492] 10.222.0.94 () {58 vars in 1024 bytes} [Wed Aug 24 04:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:44:50.708429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05338879-3bc9-4ba4-8e42-b72d3a174e46 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:50.710028 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-05338879-3bc9-4ba4-8e42-b72d3a174e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:50.824742 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05338879-3bc9-4ba4-8e42-b72d3a174e46 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:50.912702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ba2a7-d90d-4ae8-ac44-45a8224afe6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:50.913466 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ba2a7-d90d-4ae8-ac44-45a8224afe6c service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:50.913752 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ba2a7-d90d-4ae8-ac44-45a8224afe6c service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:50.914026 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ba2a7-d90d-4ae8-ac44-45a8224afe6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:50.915737 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-901ba2a7-d90d-4ae8-ac44-45a8224afe6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:50.928352 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:51.046784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ba2a7-d90d-4ae8-ac44-45a8224afe6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:51.048621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ba2a7-d90d-4ae8-ac44-45a8224afe6c service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:51.069658 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 736/1493] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:44:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:45:00.411274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=82 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:01.067121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=50 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:04.526278 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b931bbe-deca-4df7-a0a5-77b2582d7a26 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:04.526892 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b931bbe-deca-4df7-a0a5-77b2582d7a26 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:04.526892 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b931bbe-deca-4df7-a0a5-77b2582d7a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:04.606065 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-5b931bbe-deca-4df7-a0a5-77b2582d7a26 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:04.607519 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-5b931bbe-deca-4df7-a0a5-77b2582d7a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:04.712407 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 758/1494] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:46:04.721152 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd245722-def3-4d20-ad65-d3a33b3ce512 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:04.721733 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd245722-def3-4d20-ad65-d3a33b3ce512 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:04.721733 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd245722-def3-4d20-ad65-d3a33b3ce512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:04.926458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-dd245722-def3-4d20-ad65-d3a33b3ce512 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:04.927614 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-dd245722-def3-4d20-ad65-d3a33b3ce512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:05.025397 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 737/1495] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:46:05.030745 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b931bbe-deca-4df7-a0a5-77b2582d7a26 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:46:05.031966 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-5b931bbe-deca-4df7-a0a5-77b2582d7a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:05.043765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b931bbe-deca-4df7-a0a5-77b2582d7a26 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:46:05.106444 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:05.141858 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf56f9f-49d7-48f0-ad22-727d2fb7e6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:46:05.142477 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf56f9f-49d7-48f0-ad22-727d2fb7e6dd admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:05.142757 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf56f9f-49d7-48f0-ad22-727d2fb7e6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:05.143029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf56f9f-49d7-48f0-ad22-727d2fb7e6dd admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:05.143711 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf56f9f-49d7-48f0-ad22-727d2fb7e6dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:46:05.144019 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf56f9f-49d7-48f0-ad22-727d2fb7e6dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:46:05.145030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: WARNING py.warnings [None req-dbf56f9f-49d7-48f0-ad22-727d2fb7e6dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:46:05.145030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: warnings.warn(msg) Aug 24 04:46:05.145030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: Aug 24 04:46:05.145992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf56f9f-49d7-48f0-ad22-727d2fb7e6dd admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:46:05.158184 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 759/1496] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:46:05.166472 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd245722-def3-4d20-ad65-d3a33b3ce512 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:46:05.175792 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd245722-def3-4d20-ad65-d3a33b3ce512 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:46:05.238957 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:05.274086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc68ec-d4df-45b4-8c06-917e07cf8c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:46:05.274693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc68ec-d4df-45b4-8c06-917e07cf8c24 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:05.274975 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc68ec-d4df-45b4-8c06-917e07cf8c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:05.275306 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc68ec-d4df-45b4-8c06-917e07cf8c24 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:05.275871 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc68ec-d4df-45b4-8c06-917e07cf8c24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:46:05.278585 dv-cinder-854264-1-smb devstack@keystone.service[93411]: WARNING py.warnings [None req-e0bc68ec-d4df-45b4-8c06-917e07cf8c24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:46:05.278585 dv-cinder-854264-1-smb devstack@keystone.service[93411]: warnings.warn(msg) Aug 24 04:46:05.278585 dv-cinder-854264-1-smb devstack@keystone.service[93411]: Aug 24 04:46:05.279786 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc68ec-d4df-45b4-8c06-917e07cf8c24 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:46:05.340470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 738/1497] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:46:05 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:46:05.344687 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf56f9f-49d7-48f0-ad22-727d2fb7e6dd admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:46:05.346279 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-dbf56f9f-49d7-48f0-ad22-727d2fb7e6dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:05.380320 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf56f9f-49d7-48f0-ad22-727d2fb7e6dd admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:46:05.497208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011447b-7890-4add-acd0-27deb73a52c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:46:05.497812 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011447b-7890-4add-acd0-27deb73a52c0 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:05.498094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011447b-7890-4add-acd0-27deb73a52c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:05.498370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011447b-7890-4add-acd0-27deb73a52c0 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:05.499028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011447b-7890-4add-acd0-27deb73a52c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:46:05.500404 dv-cinder-854264-1-smb devstack@keystone.service[93412]: WARNING py.warnings [None req-4011447b-7890-4add-acd0-27deb73a52c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:46:05.500404 dv-cinder-854264-1-smb devstack@keystone.service[93412]: warnings.warn(msg) Aug 24 04:46:05.500404 dv-cinder-854264-1-smb devstack@keystone.service[93412]: Aug 24 04:46:05.502465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011447b-7890-4add-acd0-27deb73a52c0 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:46:05.554900 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 760/1498] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:46:05 2022] POST /identity/v3/users => generated 290 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:46:05.560004 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc68ec-d4df-45b4-8c06-917e07cf8c24 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:46:05.561710 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e0bc68ec-d4df-45b4-8c06-917e07cf8c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:05.628737 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc68ec-d4df-45b4-8c06-917e07cf8c24 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:46:05.718227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:05.730701 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2b71a-5c93-4a28-968b-d377ac8ffa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:46:05.731451 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2b71a-5c93-4a28-968b-d377ac8ffa15 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:05.731566 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2b71a-5c93-4a28-968b-d377ac8ffa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:05.731893 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2b71a-5c93-4a28-968b-d377ac8ffa15 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:05.732453 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2b71a-5c93-4a28-968b-d377ac8ffa15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:46:05.733581 dv-cinder-854264-1-smb devstack@keystone.service[93411]: WARNING py.warnings [None req-68a2b71a-5c93-4a28-968b-d377ac8ffa15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:46:05.733581 dv-cinder-854264-1-smb devstack@keystone.service[93411]: warnings.warn(msg) Aug 24 04:46:05.733581 dv-cinder-854264-1-smb devstack@keystone.service[93411]: Aug 24 04:46:05.734349 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2b71a-5c93-4a28-968b-d377ac8ffa15 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:46:05.749573 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 739/1499] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:46:05.753667 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011447b-7890-4add-acd0-27deb73a52c0 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:46:05.755307 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-4011447b-7890-4add-acd0-27deb73a52c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:05.767003 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011447b-7890-4add-acd0-27deb73a52c0 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:46:05.791689 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:05.988286 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30219e5-c13b-4458-bfa1-5ba2dcc5d7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:46:05.989055 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30219e5-c13b-4458-bfa1-5ba2dcc5d7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:05.989306 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30219e5-c13b-4458-bfa1-5ba2dcc5d7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:05.989669 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30219e5-c13b-4458-bfa1-5ba2dcc5d7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:05.990366 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30219e5-c13b-4458-bfa1-5ba2dcc5d7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:46:05.991940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: WARNING py.warnings [None req-c30219e5-c13b-4458-bfa1-5ba2dcc5d7a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:46:05.991940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: warnings.warn(msg) Aug 24 04:46:05.991940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: Aug 24 04:46:05.992907 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30219e5-c13b-4458-bfa1-5ba2dcc5d7a9 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:46:06.007008 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 761/1500] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:46:06.012280 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2b71a-5c93-4a28-968b-d377ac8ffa15 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:46:06.014264 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-68a2b71a-5c93-4a28-968b-d377ac8ffa15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:06.050285 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2b71a-5c93-4a28-968b-d377ac8ffa15 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:46:06.152935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f6203-8eb6-405f-bcfd-585d35172da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:46:06.153628 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f6203-8eb6-405f-bcfd-585d35172da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:06.153921 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f6203-8eb6-405f-bcfd-585d35172da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:06.154194 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f6203-8eb6-405f-bcfd-585d35172da6 admin admin] PATH_INFO: `/v3/projects/ee4687152ab44142a189c3655707c4ec/users/cf1c324822544b01b67af584bca1c18b/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:06.178639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f6203-8eb6-405f-bcfd-585d35172da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee4687152ab44142a189c3655707c4ec, user_id=cf1c324822544b01b67af584bca1c18b, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:46:06.179672 dv-cinder-854264-1-smb devstack@keystone.service[93411]: WARNING py.warnings [None req-534f6203-8eb6-405f-bcfd-585d35172da6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:46:06.179672 dv-cinder-854264-1-smb devstack@keystone.service[93411]: warnings.warn(msg) Aug 24 04:46:06.179672 dv-cinder-854264-1-smb devstack@keystone.service[93411]: Aug 24 04:46:06.181666 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f6203-8eb6-405f-bcfd-585d35172da6 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:46:06.208588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 740/1501] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:46:06 2022] PUT /identity/v3/projects/ee4687152ab44142a189c3655707c4ec/users/cf1c324822544b01b67af584bca1c18b/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:46:06.221163 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad7ab8-9325-4014-a764-5e7eda4842aa None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:06.221489 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad7ab8-9325-4014-a764-5e7eda4842aa None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:06.221750 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad7ab8-9325-4014-a764-5e7eda4842aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:06.281255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-b9ad7ab8-9325-4014-a764-5e7eda4842aa None None] MFA Rules not processed for user `cf1c324822544b01b67af584bca1c18b`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:06.282509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-b9ad7ab8-9325-4014-a764-5e7eda4842aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:06.361988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 762/1502] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:46:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:46:06.376961 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e673e0b-1f2b-439e-89d7-8a0050add645 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:06.377250 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e673e0b-1f2b-439e-89d7-8a0050add645 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:06.377561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e673e0b-1f2b-439e-89d7-8a0050add645 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:06.378915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 741/1503] 10.222.0.94 () {54 vars in 964 bytes} [Wed Aug 24 04:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:46:06.384027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154c115-b5eb-4b33-8b95-5f802aee2eb9 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:06.384309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154c115-b5eb-4b33-8b95-5f802aee2eb9 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:06.384595 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154c115-b5eb-4b33-8b95-5f802aee2eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:06.418726 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:06.469985 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-4154c115-b5eb-4b33-8b95-5f802aee2eb9 None None] MFA Rules not processed for user `6d36675e4e6045158add36ac528d6c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:06.471210 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-4154c115-b5eb-4b33-8b95-5f802aee2eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:06.554970 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 763/1504] 10.222.0.94 () {58 vars in 1061 bytes} [Wed Aug 24 04:46:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:46:06.563908 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e673e0b-1f2b-439e-89d7-8a0050add645 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:46:06.565478 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-5e673e0b-1f2b-439e-89d7-8a0050add645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:06.620014 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:06.682236 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e673e0b-1f2b-439e-89d7-8a0050add645 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:46:06.762880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807f153-aacf-478e-b02d-eeba6ff3946f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:46:06.763592 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807f153-aacf-478e-b02d-eeba6ff3946f service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:06.763775 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807f153-aacf-478e-b02d-eeba6ff3946f service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:06.764051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807f153-aacf-478e-b02d-eeba6ff3946f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:06.765732 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-2807f153-aacf-478e-b02d-eeba6ff3946f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:06.873118 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807f153-aacf-478e-b02d-eeba6ff3946f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:46:06.874515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807f153-aacf-478e-b02d-eeba6ff3946f service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:46:06.878109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:06.894986 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 742/1505] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:46:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:46:06.943123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3e569-991f-466b-9e38-576174e3dffe None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:06.943411 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3e569-991f-466b-9e38-576174e3dffe None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:06.943759 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3e569-991f-466b-9e38-576174e3dffe None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:06.945026 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 764/1506] 10.222.0.94 () {52 vars in 830 bytes} [Wed Aug 24 04:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:46:06.949216 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807f153-aacf-478e-b02d-eeba6ff3946f service cinder] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:46:06.950488 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-2807f153-aacf-478e-b02d-eeba6ff3946f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:07.067075 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807f153-aacf-478e-b02d-eeba6ff3946f service cinder] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:46:07.165679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39161b8-324c-4490-b63f-6c476e1f4522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:46:07.166316 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39161b8-324c-4490-b63f-6c476e1f4522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:07.166608 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39161b8-324c-4490-b63f-6c476e1f4522 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:07.166876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39161b8-324c-4490-b63f-6c476e1f4522 admin admin] PATH_INFO: `/v3/users/cf1c324822544b01b67af584bca1c18b` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:07.180630 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39161b8-324c-4490-b63f-6c476e1f4522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf1c324822544b01b67af584bca1c18b)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:46:07.181682 dv-cinder-854264-1-smb devstack@keystone.service[93411]: WARNING py.warnings [None req-a39161b8-324c-4490-b63f-6c476e1f4522 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:46:07.181682 dv-cinder-854264-1-smb devstack@keystone.service[93411]: warnings.warn(msg) Aug 24 04:46:07.181682 dv-cinder-854264-1-smb devstack@keystone.service[93411]: Aug 24 04:46:07.182888 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39161b8-324c-4490-b63f-6c476e1f4522 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:46:07.193910 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:07.255769 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a39161b8-324c-4490-b63f-6c476e1f4522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf1c324822544b01b67af584bca1c18b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:46:07.256207 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a39161b8-324c-4490-b63f-6c476e1f4522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf1c324822544b01b67af584bca1c18b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:46:07.266574 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a39161b8-324c-4490-b63f-6c476e1f4522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf1c324822544b01b67af584bca1c18b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:46:07.291665 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a39161b8-324c-4490-b63f-6c476e1f4522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf1c324822544b01b67af584bca1c18b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:46:07.306787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a39161b8-324c-4490-b63f-6c476e1f4522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf1c324822544b01b67af584bca1c18b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:46:07.312925 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 743/1507] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:46:06 2022] DELETE /identity/v3/users/cf1c324822544b01b67af584bca1c18b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:46:07.317632 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ee54e-1945-45e9-abd1-4758d2e5345d None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:07.317921 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ee54e-1945-45e9-abd1-4758d2e5345d None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:07.318195 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ee54e-1945-45e9-abd1-4758d2e5345d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:07.379191 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-344ee54e-1945-45e9-abd1-4758d2e5345d None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:07.380404 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-344ee54e-1945-45e9-abd1-4758d2e5345d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:07.461501 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:07.476634 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 765/1508] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:46:07.486661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39161b8-324c-4490-b63f-6c476e1f4522 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:46:07.488177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-a39161b8-324c-4490-b63f-6c476e1f4522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:07.605204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39161b8-324c-4490-b63f-6c476e1f4522 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:46:07.672586 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:07.697242 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd5276-4600-45d4-98a3-a8cb7f239e71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:46:07.697926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd5276-4600-45d4-98a3-a8cb7f239e71 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:07.698204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd5276-4600-45d4-98a3-a8cb7f239e71 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:07.698471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd5276-4600-45d4-98a3-a8cb7f239e71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:07.700790 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-cddd5276-4600-45d4-98a3-a8cb7f239e71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:07.827813 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd5276-4600-45d4-98a3-a8cb7f239e71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:46:07.829270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd5276-4600-45d4-98a3-a8cb7f239e71 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:46:07.853881 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 744/1509] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:46:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:46:08.268598 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ee54e-1945-45e9-abd1-4758d2e5345d None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:46:08.269848 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-344ee54e-1945-45e9-abd1-4758d2e5345d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:08.283205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ee54e-1945-45e9-abd1-4758d2e5345d None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:46:08.388020 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10727c41-9797-465d-b134-e4de29ee731e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:46:08.388566 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10727c41-9797-465d-b134-e4de29ee731e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:08.388842 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10727c41-9797-465d-b134-e4de29ee731e admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:08.389108 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10727c41-9797-465d-b134-e4de29ee731e admin admin] PATH_INFO: `/v3/projects/ee4687152ab44142a189c3655707c4ec` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:08.399352 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10727c41-9797-465d-b134-e4de29ee731e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee4687152ab44142a189c3655707c4ec)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:46:08.400389 dv-cinder-854264-1-smb devstack@keystone.service[93412]: WARNING py.warnings [None req-10727c41-9797-465d-b134-e4de29ee731e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:46:08.400389 dv-cinder-854264-1-smb devstack@keystone.service[93412]: warnings.warn(msg) Aug 24 04:46:08.400389 dv-cinder-854264-1-smb devstack@keystone.service[93412]: Aug 24 04:46:08.401594 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10727c41-9797-465d-b134-e4de29ee731e admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:46:08.464577 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-10727c41-9797-465d-b134-e4de29ee731e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee4687152ab44142a189c3655707c4ec', 'request_id': 'req-10727c41-9797-465d-b134-e4de29ee731e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:46:08.478474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-10727c41-9797-465d-b134-e4de29ee731e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee4687152ab44142a189c3655707c4ec', 'request_id': 'req-10727c41-9797-465d-b134-e4de29ee731e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:46:08.488593 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-10727c41-9797-465d-b134-e4de29ee731e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee4687152ab44142a189c3655707c4ec', 'request_id': 'req-10727c41-9797-465d-b134-e4de29ee731e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:46:08.517780 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-10727c41-9797-465d-b134-e4de29ee731e admin admin] The token cache is being invalidate because project ee4687152ab44142a189c3655707c4ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:46:08.518076 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-10727c41-9797-465d-b134-e4de29ee731e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:46:08.518620 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-10727c41-9797-465d-b134-e4de29ee731e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:46:08.519962 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 766/1510] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:46:08 2022] DELETE /identity/v3/projects/ee4687152ab44142a189c3655707c4ec => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:46:17.851396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=62 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:18.515267 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:47.792880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1b944-d25d-4d9e-9166-98dc69864553 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:47.793557 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1b944-d25d-4d9e-9166-98dc69864553 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:47.793557 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1b944-d25d-4d9e-9166-98dc69864553 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:47.794945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 745/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:47:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:47.799996 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec673873-e337-4cff-a4c6-70cf9c17ac0a None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:47.800459 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec673873-e337-4cff-a4c6-70cf9c17ac0a None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:47.800586 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec673873-e337-4cff-a4c6-70cf9c17ac0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:47.884007 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-ec673873-e337-4cff-a4c6-70cf9c17ac0a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:47.885219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ec673873-e337-4cff-a4c6-70cf9c17ac0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:47.997452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 767/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:48.155128 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1b944-d25d-4d9e-9166-98dc69864553 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:48.157356 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-66a1b944-d25d-4d9e-9166-98dc69864553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:48.278862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1b944-d25d-4d9e-9166-98dc69864553 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:48.285715 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a74e2a-8575-47d1-990c-891879d083ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:48.286384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a74e2a-8575-47d1-990c-891879d083ff service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:48.286664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a74e2a-8575-47d1-990c-891879d083ff service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:48.286995 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a74e2a-8575-47d1-990c-891879d083ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:48.296371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a74e2a-8575-47d1-990c-891879d083ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:48.297988 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a74e2a-8575-47d1-990c-891879d083ff service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:48.307815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 746/1513] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:49.145859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d45209-7e2a-4e7d-abb5-6dcfc1195a60 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:49.146426 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d45209-7e2a-4e7d-abb5-6dcfc1195a60 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:49.146426 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d45209-7e2a-4e7d-abb5-6dcfc1195a60 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:49.147811 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 768/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:49.153546 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65616d-e1bc-4928-870a-a3943be4919e None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:49.153988 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65616d-e1bc-4928-870a-a3943be4919e None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:49.154097 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65616d-e1bc-4928-870a-a3943be4919e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:49.173507 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-6e65616d-e1bc-4928-870a-a3943be4919e None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:49.174714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-6e65616d-e1bc-4928-870a-a3943be4919e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:49.182775 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 747/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:49.333417 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d45209-7e2a-4e7d-abb5-6dcfc1195a60 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:49.348723 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d45209-7e2a-4e7d-abb5-6dcfc1195a60 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:49.354401 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f062720-b29f-4b3f-8736-15445c59390f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:49.355122 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f062720-b29f-4b3f-8736-15445c59390f service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:49.355402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f062720-b29f-4b3f-8736-15445c59390f service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:49.355673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f062720-b29f-4b3f-8736-15445c59390f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:49.363906 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f062720-b29f-4b3f-8736-15445c59390f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:49.365507 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f062720-b29f-4b3f-8736-15445c59390f service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:49.375944 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 769/1516] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:49.927803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b681c-82a3-4868-9ba5-7655323a2f2f None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:49.928095 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b681c-82a3-4868-9ba5-7655323a2f2f None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:49.928368 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b681c-82a3-4868-9ba5-7655323a2f2f None None] PATH_INFO: `/v3` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:49.929701 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 748/1517] 10.222.0.84 () {54 vars in 925 bytes} [Wed Aug 24 04:47:49 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:47:49.936227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384af289-299d-43b8-8d22-47a07dc7161d None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:49.936449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384af289-299d-43b8-8d22-47a07dc7161d None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:49.936749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384af289-299d-43b8-8d22-47a07dc7161d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:49.996897 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-384af289-299d-43b8-8d22-47a07dc7161d None None] MFA Rules not processed for user `3a3274d404cb403bbf272ce023aa5e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:49.998116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-384af289-299d-43b8-8d22-47a07dc7161d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:50.015691 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:50.073852 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 770/1518] 10.222.0.84 () {58 vars in 1015 bytes} [Wed Aug 24 04:47:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:59.168569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=56 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:59.894116 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160dd17-f1d3-409c-966c-dab2ed31f6b3 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:59.894310 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160dd17-f1d3-409c-966c-dab2ed31f6b3 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:59.894610 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160dd17-f1d3-409c-966c-dab2ed31f6b3 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:59.895953 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 749/1519] 10.222.0.94 () {54 vars in 961 bytes} [Wed Aug 24 04:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:47:59.901531 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c6ad1-7fe1-4647-a560-6b47a2f8fc44 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:59.902032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c6ad1-7fe1-4647-a560-6b47a2f8fc44 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:59.902145 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c6ad1-7fe1-4647-a560-6b47a2f8fc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:59.923367 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-4d3c6ad1-7fe1-4647-a560-6b47a2f8fc44 None None] MFA Rules not processed for user `3a3274d404cb403bbf272ce023aa5e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:59.924580 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-4d3c6ad1-7fe1-4647-a560-6b47a2f8fc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:59.934250 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 771/1520] 10.222.0.94 () {58 vars in 1058 bytes} [Wed Aug 24 04:47:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:59.942610 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160dd17-f1d3-409c-966c-dab2ed31f6b3 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:59.957075 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160dd17-f1d3-409c-966c-dab2ed31f6b3 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:59.968788 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d51d64-9767-42f9-a76f-aff9b77b44c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3274d404cb403bbf272ce023aa5e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:59.969298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d51d64-9767-42f9-a76f-aff9b77b44c9 service placement] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:59.969606 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d51d64-9767-42f9-a76f-aff9b77b44c9 service placement] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:59.969878 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d51d64-9767-42f9-a76f-aff9b77b44c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:59.979019 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d51d64-9767-42f9-a76f-aff9b77b44c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:59.980538 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d51d64-9767-42f9-a76f-aff9b77b44c9 service placement] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:59.996131 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 750/1521] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:48:00.639398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85fb34-95b1-433b-b9ba-d93453bfb673 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:00.639676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85fb34-95b1-433b-b9ba-d93453bfb673 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:00.639870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85fb34-95b1-433b-b9ba-d93453bfb673 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:00.641698 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 772/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:48:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:48:00.648134 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a16f6-2658-4e76-a6fa-89c9b3c539b4 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:00.648578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a16f6-2658-4e76-a6fa-89c9b3c539b4 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:00.648731 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a16f6-2658-4e76-a6fa-89c9b3c539b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:00.671855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-311a16f6-2658-4e76-a6fa-89c9b3c539b4 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:48:00.673071 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-311a16f6-2658-4e76-a6fa-89c9b3c539b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:00.686300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 751/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:48:00.852654 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85fb34-95b1-433b-b9ba-d93453bfb673 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:48:00.868970 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85fb34-95b1-433b-b9ba-d93453bfb673 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:48:00.874746 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb348f0-3540-4c91-873e-ff1b32410399 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:48:00.875499 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb348f0-3540-4c91-873e-ff1b32410399 service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:00.875871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb348f0-3540-4c91-873e-ff1b32410399 service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:00.876253 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb348f0-3540-4c91-873e-ff1b32410399 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:00.886377 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb348f0-3540-4c91-873e-ff1b32410399 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:48:00.888757 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb348f0-3540-4c91-873e-ff1b32410399 service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:48:00.900526 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 773/1524] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:48:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:48:01.739308 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed6073-3227-4a15-93c2-f2f6270bc4ff None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:01.739933 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed6073-3227-4a15-93c2-f2f6270bc4ff None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:01.739933 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed6073-3227-4a15-93c2-f2f6270bc4ff None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:01.741196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 752/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:48:01.746503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78eb96-11d7-467b-b391-3280e37c862e None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:01.746503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78eb96-11d7-467b-b391-3280e37c862e None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:01.747528 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78eb96-11d7-467b-b391-3280e37c862e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:01.767915 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-1e78eb96-11d7-467b-b391-3280e37c862e None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:48:01.769180 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-1e78eb96-11d7-467b-b391-3280e37c862e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:01.778321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 774/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:48:01.936614 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed6073-3227-4a15-93c2-f2f6270bc4ff None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:48:01.952616 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed6073-3227-4a15-93c2-f2f6270bc4ff None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:48:01.958345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0cbc5-18d9-4bbf-a792-563756c3d483 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:48:01.958966 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0cbc5-18d9-4bbf-a792-563756c3d483 service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:01.959242 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0cbc5-18d9-4bbf-a792-563756c3d483 service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:01.959521 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0cbc5-18d9-4bbf-a792-563756c3d483 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:01.970211 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0cbc5-18d9-4bbf-a792-563756c3d483 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:48:01.972325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0cbc5-18d9-4bbf-a792-563756c3d483 service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:48:01.987070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 753/1527] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:48:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:48:06.391757 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a881e-1f9f-4b05-b52a-1c2580fc8db1 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:06.392309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a881e-1f9f-4b05-b52a-1c2580fc8db1 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:06.392309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a881e-1f9f-4b05-b52a-1c2580fc8db1 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:06.393653 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 775/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:48:06.399070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b35cb3-66d2-44da-8c5e-e58220044a22 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:06.399517 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b35cb3-66d2-44da-8c5e-e58220044a22 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:06.399685 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b35cb3-66d2-44da-8c5e-e58220044a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:06.419457 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-c1b35cb3-66d2-44da-8c5e-e58220044a22 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:48:06.420706 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-c1b35cb3-66d2-44da-8c5e-e58220044a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:06.428863 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 754/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:48:06.718225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a881e-1f9f-4b05-b52a-1c2580fc8db1 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:48:06.719998 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-623a881e-1f9f-4b05-b52a-1c2580fc8db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:06.799341 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a881e-1f9f-4b05-b52a-1c2580fc8db1 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:48:06.802926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed72fa-a6a2-4c42-93c8-3aa78cb89222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:48:06.803527 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed72fa-a6a2-4c42-93c8-3aa78cb89222 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:06.803803 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed72fa-a6a2-4c42-93c8-3aa78cb89222 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:06.804075 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed72fa-a6a2-4c42-93c8-3aa78cb89222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:06.813710 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed72fa-a6a2-4c42-93c8-3aa78cb89222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:48:06.815140 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed72fa-a6a2-4c42-93c8-3aa78cb89222 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:48:06.824963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 776/1530] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:48:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:48:08.784120 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d7bea-ad51-4fbd-9cd2-9b7450cde115 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:08.784695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d7bea-ad51-4fbd-9cd2-9b7450cde115 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:08.784695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d7bea-ad51-4fbd-9cd2-9b7450cde115 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:08.786058 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 755/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:48:08.791588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145fd56-ae6a-483a-9b86-0191d5e50ac5 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:08.792102 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145fd56-ae6a-483a-9b86-0191d5e50ac5 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:08.792232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145fd56-ae6a-483a-9b86-0191d5e50ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:08.812018 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-c145fd56-ae6a-483a-9b86-0191d5e50ac5 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:48:08.813226 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-c145fd56-ae6a-483a-9b86-0191d5e50ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:08.821428 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 777/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:48:09.107133 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d7bea-ad51-4fbd-9cd2-9b7450cde115 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:48:09.118614 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d7bea-ad51-4fbd-9cd2-9b7450cde115 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:48:09.122769 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d48696-8ba9-48cb-b8c9-1c536cbf80ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:48:09.123369 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d48696-8ba9-48cb-b8c9-1c536cbf80ab service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:09.123647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d48696-8ba9-48cb-b8c9-1c536cbf80ab service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:09.123919 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d48696-8ba9-48cb-b8c9-1c536cbf80ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:09.139713 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d48696-8ba9-48cb-b8c9-1c536cbf80ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:48:09.141359 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d48696-8ba9-48cb-b8c9-1c536cbf80ab service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:48:09.151623 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 756/1533] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:48:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:48:12.624171 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ce85f-9c38-4109-91e4-0185fd40b0e8 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:12.624796 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ce85f-9c38-4109-91e4-0185fd40b0e8 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:12.624796 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ce85f-9c38-4109-91e4-0185fd40b0e8 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:12.626120 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 778/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:48:12.631691 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161c554-1ddf-4ce9-a2d1-d26e6f16f489 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:12.632179 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161c554-1ddf-4ce9-a2d1-d26e6f16f489 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:12.632287 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161c554-1ddf-4ce9-a2d1-d26e6f16f489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:12.652193 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-9161c554-1ddf-4ce9-a2d1-d26e6f16f489 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:48:12.653393 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-9161c554-1ddf-4ce9-a2d1-d26e6f16f489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:12.661795 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 757/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:48:13.224926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ce85f-9c38-4109-91e4-0185fd40b0e8 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:48:13.226655 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-e51ce85f-9c38-4109-91e4-0185fd40b0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:13.300022 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:13.315336 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ce85f-9c38-4109-91e4-0185fd40b0e8 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:48:13.320921 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8f976-ea31-4a7c-9e9b-40956fde1b13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:48:13.321586 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8f976-ea31-4a7c-9e9b-40956fde1b13 service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:13.321888 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8f976-ea31-4a7c-9e9b-40956fde1b13 service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:13.322146 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8f976-ea31-4a7c-9e9b-40956fde1b13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:13.332917 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8f976-ea31-4a7c-9e9b-40956fde1b13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:48:13.334384 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8f976-ea31-4a7c-9e9b-40956fde1b13 service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:48:13.344873 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 779/1536] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:48:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:48:15.324588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06bbf0-99d0-46d4-a0dd-6c02ced89656 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:15.325191 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06bbf0-99d0-46d4-a0dd-6c02ced89656 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:15.325191 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06bbf0-99d0-46d4-a0dd-6c02ced89656 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:15.326539 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 758/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:48:15.331916 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb321e0-85de-4ad3-9c2c-272440e00f94 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:15.332388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb321e0-85de-4ad3-9c2c-272440e00f94 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:15.332498 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb321e0-85de-4ad3-9c2c-272440e00f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:15.352994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-bcb321e0-85de-4ad3-9c2c-272440e00f94 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:48:15.354251 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-bcb321e0-85de-4ad3-9c2c-272440e00f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:15.363206 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 780/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:48:15.929556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06bbf0-99d0-46d4-a0dd-6c02ced89656 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:48:15.931291 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-0f06bbf0-99d0-46d4-a0dd-6c02ced89656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:15.944874 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06bbf0-99d0-46d4-a0dd-6c02ced89656 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:48:15.948896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b701e-a6b3-422c-b3a5-3ccfcb2340e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:48:15.949643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b701e-a6b3-422c-b3a5-3ccfcb2340e6 service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:15.950104 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b701e-a6b3-422c-b3a5-3ccfcb2340e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:15.950385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b701e-a6b3-422c-b3a5-3ccfcb2340e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:15.960237 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b701e-a6b3-422c-b3a5-3ccfcb2340e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:48:15.961706 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b701e-a6b3-422c-b3a5-3ccfcb2340e6 service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:48:15.972848 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 759/1539] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:48:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:48:25.347627 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=11 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:25.968289 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=33 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:00.559051 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab494f7-8b77-4cff-b5ce-3a037e46e351 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:00.560286 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab494f7-8b77-4cff-b5ce-3a037e46e351 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:00.560822 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab494f7-8b77-4cff-b5ce-3a037e46e351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:00.589076 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-7ab494f7-8b77-4cff-b5ce-3a037e46e351 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:00.590649 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-7ab494f7-8b77-4cff-b5ce-3a037e46e351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:00.606711 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 781/1540] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:00.618268 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22577442-1a82-4ef4-976c-e85a8783813f None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:00.618886 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22577442-1a82-4ef4-976c-e85a8783813f None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:00.618886 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22577442-1a82-4ef4-976c-e85a8783813f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:00.651295 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-22577442-1a82-4ef4-976c-e85a8783813f None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:00.652563 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-22577442-1a82-4ef4-976c-e85a8783813f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:00.669053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 760/1541] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:00.674690 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab494f7-8b77-4cff-b5ce-3a037e46e351 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:00.697585 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab494f7-8b77-4cff-b5ce-3a037e46e351 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:00.711175 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebfd20-3f08-4789-979c-d87bcf8a5fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:00.711821 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebfd20-3f08-4789-979c-d87bcf8a5fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:00.715991 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebfd20-3f08-4789-979c-d87bcf8a5fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:00.715991 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebfd20-3f08-4789-979c-d87bcf8a5fc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:00.715991 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ebfd20-3f08-4789-979c-d87bcf8a5fc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:00.715991 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ebfd20-3f08-4789-979c-d87bcf8a5fc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:00.715991 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ebfd20-3f08-4789-979c-d87bcf8a5fc9 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:00.744806 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 782/1542] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:00.747258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea186e9-1cf9-46d4-8aa4-dba69fb33cc8 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:00.747556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea186e9-1cf9-46d4-8aa4-dba69fb33cc8 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:00.747919 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea186e9-1cf9-46d4-8aa4-dba69fb33cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:00.755203 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebfd20-3f08-4789-979c-d87bcf8a5fc9 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:00.777246 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebfd20-3f08-4789-979c-d87bcf8a5fc9 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:00.787289 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-8ea186e9-1cf9-46d4-8aa4-dba69fb33cc8 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:00.790206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-8ea186e9-1cf9-46d4-8aa4-dba69fb33cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:00.795916 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ab0fe-6c2d-4ba0-b1e3-d617835dd839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:00.796615 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ab0fe-6c2d-4ba0-b1e3-d617835dd839 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:00.796901 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ab0fe-6c2d-4ba0-b1e3-d617835dd839 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:00.797216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ab0fe-6c2d-4ba0-b1e3-d617835dd839 admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:00.797892 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ab0fe-6c2d-4ba0-b1e3-d617835dd839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:00.798976 dv-cinder-854264-1-smb devstack@keystone.service[93412]: WARNING py.warnings [None req-646ab0fe-6c2d-4ba0-b1e3-d617835dd839 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:50:00.798976 dv-cinder-854264-1-smb devstack@keystone.service[93412]: warnings.warn(msg) Aug 24 04:50:00.798976 dv-cinder-854264-1-smb devstack@keystone.service[93412]: Aug 24 04:50:00.801529 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ab0fe-6c2d-4ba0-b1e3-d617835dd839 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:00.806358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 761/1543] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:00.816370 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce496c-c50e-4608-8c28-1fb9f7e337ea None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:00.816671 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce496c-c50e-4608-8c28-1fb9f7e337ea None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:00.816840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce496c-c50e-4608-8c28-1fb9f7e337ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:00.852114 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-17ce496c-c50e-4608-8c28-1fb9f7e337ea None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:00.853524 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-17ce496c-c50e-4608-8c28-1fb9f7e337ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:00.868412 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 762/1544] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:00.875291 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce496c-c50e-4608-8c28-1fb9f7e337ea None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:00.889183 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce496c-c50e-4608-8c28-1fb9f7e337ea None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:00.900527 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc55a74-5f80-4969-bc02-aa2d7cd81023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:00.901310 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc55a74-5f80-4969-bc02-aa2d7cd81023 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:00.901634 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc55a74-5f80-4969-bc02-aa2d7cd81023 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:00.901903 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc55a74-5f80-4969-bc02-aa2d7cd81023 admin admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:00.902578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc55a74-5f80-4969-bc02-aa2d7cd81023 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:00.902882 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc55a74-5f80-4969-bc02-aa2d7cd81023 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:00.904423 dv-cinder-854264-1-smb devstack@keystone.service[93411]: WARNING py.warnings [None req-bdc55a74-5f80-4969-bc02-aa2d7cd81023 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:50:00.904423 dv-cinder-854264-1-smb devstack@keystone.service[93411]: warnings.warn(msg) Aug 24 04:50:00.904423 dv-cinder-854264-1-smb devstack@keystone.service[93411]: Aug 24 04:50:00.905810 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc55a74-5f80-4969-bc02-aa2d7cd81023 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:00.919670 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 783/1545] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:00 2022] POST /identity/v3/projects => generated 375 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:50:00.932240 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 763/1546] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:00.932901 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ab0fe-6c2d-4ba0-b1e3-d617835dd839 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:00.942589 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc55a74-5f80-4969-bc02-aa2d7cd81023 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:00.954561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc55a74-5f80-4969-bc02-aa2d7cd81023 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:01.074846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf709c31-8ffe-4475-8220-23ceb7613f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:01.075435 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf709c31-8ffe-4475-8220-23ceb7613f1c admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.075738 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf709c31-8ffe-4475-8220-23ceb7613f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.075995 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf709c31-8ffe-4475-8220-23ceb7613f1c admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.076654 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf709c31-8ffe-4475-8220-23ceb7613f1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:01.078732 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf709c31-8ffe-4475-8220-23ceb7613f1c admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:01.130624 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 764/1547] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:00 2022] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:50:01.134118 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ab0fe-6c2d-4ba0-b1e3-d617835dd839 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:01.135141 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29cfbb-004a-4b6b-8028-563ad4de15c9 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.135568 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29cfbb-004a-4b6b-8028-563ad4de15c9 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.137309 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29cfbb-004a-4b6b-8028-563ad4de15c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.194569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-ea29cfbb-004a-4b6b-8028-563ad4de15c9 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:01.195870 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-ea29cfbb-004a-4b6b-8028-563ad4de15c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:01.302265 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d953f-491c-4180-a189-b798b8f4f209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:01.303054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d953f-491c-4180-a189-b798b8f4f209 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.303339 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d953f-491c-4180-a189-b798b8f4f209 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.303615 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d953f-491c-4180-a189-b798b8f4f209 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.304544 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d953f-491c-4180-a189-b798b8f4f209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:01.308664 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d953f-491c-4180-a189-b798b8f4f209 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:01.337543 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 784/1548] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:00 2022] POST /identity/v3/users => generated 288 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:01.338543 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d953f-491c-4180-a189-b798b8f4f209 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:01.346378 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 765/1549] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:01.348204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ef807-782b-4ee5-8a29-394ea6d1b96e None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.348582 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ef807-782b-4ee5-8a29-394ea6d1b96e None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.348743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ef807-782b-4ee5-8a29-394ea6d1b96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.359106 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d953f-491c-4180-a189-b798b8f4f209 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:01.365659 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa241d-3fdc-40b8-a33a-ae282ed12cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:01.366309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa241d-3fdc-40b8-a33a-ae282ed12cfb admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.366581 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa241d-3fdc-40b8-a33a-ae282ed12cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.366852 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa241d-3fdc-40b8-a33a-ae282ed12cfb admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.367491 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa241d-3fdc-40b8-a33a-ae282ed12cfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:01.369492 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa241d-3fdc-40b8-a33a-ae282ed12cfb admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:01.374624 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-ab7ef807-782b-4ee5-8a29-394ea6d1b96e None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:01.375839 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-ab7ef807-782b-4ee5-8a29-394ea6d1b96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:01.388255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 766/1550] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:01.390626 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adcd5b-0e4f-4818-8d33-caa4c4eb4cbc None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.391089 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adcd5b-0e4f-4818-8d33-caa4c4eb4cbc None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.391552 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adcd5b-0e4f-4818-8d33-caa4c4eb4cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.402358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 785/1551] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:01 2022] POST /identity/v3/users => generated 293 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:01.404410 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94050c14-3add-4fc6-b3df-fed807d5bfdd None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.405586 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94050c14-3add-4fc6-b3df-fed807d5bfdd None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.405586 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94050c14-3add-4fc6-b3df-fed807d5bfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.422039 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-e2adcd5b-0e4f-4818-8d33-caa4c4eb4cbc None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:01.423709 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e2adcd5b-0e4f-4818-8d33-caa4c4eb4cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:01.430484 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-94050c14-3add-4fc6-b3df-fed807d5bfdd None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:01.431790 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-94050c14-3add-4fc6-b3df-fed807d5bfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:01.435993 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 767/1552] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:01.439793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d819c-b50f-429b-8b60-93123f6069af None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.440302 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d819c-b50f-429b-8b60-93123f6069af None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.448144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d819c-b50f-429b-8b60-93123f6069af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.448404 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 786/1553] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:01.448404 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94050c14-3add-4fc6-b3df-fed807d5bfdd None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:01.459371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94050c14-3add-4fc6-b3df-fed807d5bfdd None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:01.464353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31377c-cd59-422a-854a-f7e8cb11f0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:01.464980 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31377c-cd59-422a-854a-f7e8cb11f0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.465265 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31377c-cd59-422a-854a-f7e8cb11f0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.465622 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31377c-cd59-422a-854a-f7e8cb11f0a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.466288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31377c-cd59-422a-854a-f7e8cb11f0a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:01.467930 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31377c-cd59-422a-854a-f7e8cb11f0a6 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:01.474029 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-902d819c-b50f-429b-8b60-93123f6069af None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:01.475333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-902d819c-b50f-429b-8b60-93123f6069af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:01.481281 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 787/1554] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:01.482515 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48e3ab-5c84-4e43-bec6-15640eea4eec None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.482810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48e3ab-5c84-4e43-bec6-15640eea4eec None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.483086 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48e3ab-5c84-4e43-bec6-15640eea4eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.486878 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 768/1555] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:01.488810 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d119ae7-bc21-4196-80e3-1191e2d5a4f4 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.489092 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d119ae7-bc21-4196-80e3-1191e2d5a4f4 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.489907 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d119ae7-bc21-4196-80e3-1191e2d5a4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.507847 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-ed48e3ab-5c84-4e43-bec6-15640eea4eec None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:01.509102 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ed48e3ab-5c84-4e43-bec6-15640eea4eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:01.510533 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-1d119ae7-bc21-4196-80e3-1191e2d5a4f4 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:01.511722 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-1d119ae7-bc21-4196-80e3-1191e2d5a4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:01.518111 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 788/1556] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:01.519521 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf3b86-7b97-4647-add6-1b0fd4304740 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.520088 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf3b86-7b97-4647-add6-1b0fd4304740 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.520450 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf3b86-7b97-4647-add6-1b0fd4304740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.525535 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 769/1557] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:01.525535 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d119ae7-bc21-4196-80e3-1191e2d5a4f4 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:01.532514 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:01.537465 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d119ae7-bc21-4196-80e3-1191e2d5a4f4 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:01.543411 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84732e71-ad38-401e-bd34-e873d1510f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:01.544223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84732e71-ad38-401e-bd34-e873d1510f33 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.544507 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84732e71-ad38-401e-bd34-e873d1510f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.544784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84732e71-ad38-401e-bd34-e873d1510f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.545468 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84732e71-ad38-401e-bd34-e873d1510f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:01.547088 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84732e71-ad38-401e-bd34-e873d1510f33 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:01.548822 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-e1cf3b86-7b97-4647-add6-1b0fd4304740 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:01.550773 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-e1cf3b86-7b97-4647-add6-1b0fd4304740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:01.558905 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 789/1559] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:01.560234 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2dca76-2338-4b9b-80e5-483c3c624208 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.560823 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2dca76-2338-4b9b-80e5-483c3c624208 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.560823 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2dca76-2338-4b9b-80e5-483c3c624208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.561939 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 770/1559] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:01.563258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22eae1-daf4-4897-ae10-593596aa474f None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.563570 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22eae1-daf4-4897-ae10-593596aa474f None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.564127 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22eae1-daf4-4897-ae10-593596aa474f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.585186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-4e2dca76-2338-4b9b-80e5-483c3c624208 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:01.587358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-4e2dca76-2338-4b9b-80e5-483c3c624208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:01.587512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-6f22eae1-daf4-4897-ae10-593596aa474f None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:01.588742 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-6f22eae1-daf4-4897-ae10-593596aa474f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:01.601925 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 790/1560] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:01.602229 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 771/1561] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:01.602554 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2dca76-2338-4b9b-80e5-483c3c624208 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:01.602720 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e00132-b140-4b7f-a9d2-1d0f8831a871 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.602720 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e00132-b140-4b7f-a9d2-1d0f8831a871 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.602720 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e00132-b140-4b7f-a9d2-1d0f8831a871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.613968 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2dca76-2338-4b9b-80e5-483c3c624208 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:01.619630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d02af-31a0-46db-8926-65e8778e609b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:01.620648 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d02af-31a0-46db-8926-65e8778e609b admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.620648 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d02af-31a0-46db-8926-65e8778e609b admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.620912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-86e00132-b140-4b7f-a9d2-1d0f8831a871 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:01.621415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d02af-31a0-46db-8926-65e8778e609b admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.621635 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d02af-31a0-46db-8926-65e8778e609b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:01.622185 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-86e00132-b140-4b7f-a9d2-1d0f8831a871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:01.623279 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d02af-31a0-46db-8926-65e8778e609b admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:01.633027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 772/1562] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:01.634107 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e00132-b140-4b7f-a9d2-1d0f8831a871 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:01.639508 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 791/1563] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:01.639508 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b951f4e-1064-48f6-80f1-d9e0ed920dbe None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.639508 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b951f4e-1064-48f6-80f1-d9e0ed920dbe None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.639508 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b951f4e-1064-48f6-80f1-d9e0ed920dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.640141 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:01.648915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e00132-b140-4b7f-a9d2-1d0f8831a871 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:01.655047 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e47cf-1bda-457a-b467-2b25c9208a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:01.656061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e47cf-1bda-457a-b467-2b25c9208a36 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.656356 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e47cf-1bda-457a-b467-2b25c9208a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.657137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e47cf-1bda-457a-b467-2b25c9208a36 admin admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.657837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e47cf-1bda-457a-b467-2b25c9208a36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:01.658145 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e47cf-1bda-457a-b467-2b25c9208a36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:01.660208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e47cf-1bda-457a-b467-2b25c9208a36 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:01.667415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-2b951f4e-1064-48f6-80f1-d9e0ed920dbe None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:01.668945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-2b951f4e-1064-48f6-80f1-d9e0ed920dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:01.675935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 773/1564] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:01.676911 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e47cf-1bda-457a-b467-2b25c9208a36 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:01.678343 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 792/1565] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:01.678945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b951f4e-1064-48f6-80f1-d9e0ed920dbe None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:01.697469 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e47cf-1bda-457a-b467-2b25c9208a36 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:01.698964 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b951f4e-1064-48f6-80f1-d9e0ed920dbe None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:01.702723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07784b36-cc21-452c-ae41-c3f7049926d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:01.703500 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07784b36-cc21-452c-ae41-c3f7049926d1 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.703830 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07784b36-cc21-452c-ae41-c3f7049926d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.704102 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07784b36-cc21-452c-ae41-c3f7049926d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.704774 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07784b36-cc21-452c-ae41-c3f7049926d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:01.704880 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6674270-0ede-4d4f-bce4-b51226ae2d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:01.705521 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6674270-0ede-4d4f-bce4-b51226ae2d2b admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.705816 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6674270-0ede-4d4f-bce4-b51226ae2d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.706115 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6674270-0ede-4d4f-bce4-b51226ae2d2b admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.707171 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07784b36-cc21-452c-ae41-c3f7049926d1 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:01.707516 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6674270-0ede-4d4f-bce4-b51226ae2d2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:01.708026 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6674270-0ede-4d4f-bce4-b51226ae2d2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:01.710103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6674270-0ede-4d4f-bce4-b51226ae2d2b admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:01.723379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 774/1566] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:01.723379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07784b36-cc21-452c-ae41-c3f7049926d1 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:01.729470 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 793/1567] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:01.729470 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6674270-0ede-4d4f-bce4-b51226ae2d2b admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:01.738421 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6674270-0ede-4d4f-bce4-b51226ae2d2b admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:01.739615 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07784b36-cc21-452c-ae41-c3f7049926d1 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:01.742883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a0556-9c13-4598-b45c-ad8b240ce29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:01.743510 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a0556-9c13-4598-b45c-ad8b240ce29a admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.743929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a0556-9c13-4598-b45c-ad8b240ce29a admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.744206 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a0556-9c13-4598-b45c-ad8b240ce29a admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.744865 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a0556-9c13-4598-b45c-ad8b240ce29a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:01.745170 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a0556-9c13-4598-b45c-ad8b240ce29a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:01.745806 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4931bb5-f69c-486a-bbaf-f86768678e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:01.746485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4931bb5-f69c-486a-bbaf-f86768678e4f admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.746797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4931bb5-f69c-486a-bbaf-f86768678e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.746914 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a0556-9c13-4598-b45c-ad8b240ce29a admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:01.747075 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4931bb5-f69c-486a-bbaf-f86768678e4f admin admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.747743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4931bb5-f69c-486a-bbaf-f86768678e4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:01.748050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4931bb5-f69c-486a-bbaf-f86768678e4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:01.749971 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4931bb5-f69c-486a-bbaf-f86768678e4f admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:01.765048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 794/1568] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:01.766374 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a0556-9c13-4598-b45c-ad8b240ce29a admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:01.776986 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 775/1569] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:01.776986 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4931bb5-f69c-486a-bbaf-f86768678e4f admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:01.783101 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4931bb5-f69c-486a-bbaf-f86768678e4f admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:01.783887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a0556-9c13-4598-b45c-ad8b240ce29a admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:01.788453 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4ebc1-a029-476f-8988-1e266507da99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:01.789208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4ebc1-a029-476f-8988-1e266507da99 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.789545 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4ebc1-a029-476f-8988-1e266507da99 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.789646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacae8ac-fccc-4323-a0c3-097227e66e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:01.789779 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4ebc1-a029-476f-8988-1e266507da99 admin admin] PATH_INFO: `/v3/projects/a2ec47ad08a1414c84013ca724f2515e/users/22debcb00f1b45058f528fe393451c31/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.790262 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacae8ac-fccc-4323-a0c3-097227e66e78 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.790572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacae8ac-fccc-4323-a0c3-097227e66e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.790851 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacae8ac-fccc-4323-a0c3-097227e66e78 admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.791511 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacae8ac-fccc-4323-a0c3-097227e66e78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:01.791817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacae8ac-fccc-4323-a0c3-097227e66e78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:01.793479 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacae8ac-fccc-4323-a0c3-097227e66e78 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:01.806636 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 795/1570] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:01.807510 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacae8ac-fccc-4323-a0c3-097227e66e78 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:01.812877 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4ebc1-a029-476f-8988-1e266507da99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ec47ad08a1414c84013ca724f2515e, user_id=22debcb00f1b45058f528fe393451c31, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:01.817829 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4ebc1-a029-476f-8988-1e266507da99 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:01.818609 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacae8ac-fccc-4323-a0c3-097227e66e78 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:01.823556 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a01b3-d167-474d-a5ca-f9fa592d7142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:01.824239 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a01b3-d167-474d-a5ca-f9fa592d7142 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.824520 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a01b3-d167-474d-a5ca-f9fa592d7142 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.824810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a01b3-d167-474d-a5ca-f9fa592d7142 admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.825572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a01b3-d167-474d-a5ca-f9fa592d7142 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:01.825973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a01b3-d167-474d-a5ca-f9fa592d7142 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:01.827722 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a01b3-d167-474d-a5ca-f9fa592d7142 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:01.835242 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 776/1571] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:01 2022] PUT /identity/v3/projects/a2ec47ad08a1414c84013ca724f2515e/users/22debcb00f1b45058f528fe393451c31/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:01.838338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4ebc1-a029-476f-8988-1e266507da99 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:01.854145 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 796/1572] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:01.855011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a01b3-d167-474d-a5ca-f9fa592d7142 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:01.866616 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a01b3-d167-474d-a5ca-f9fa592d7142 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:01.926848 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4ebc1-a029-476f-8988-1e266507da99 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:01.931294 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed8074-1c2a-4af3-9368-f7d8b29e6d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:01.931943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed8074-1c2a-4af3-9368-f7d8b29e6d37 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.932224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed8074-1c2a-4af3-9368-f7d8b29e6d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.932582 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed8074-1c2a-4af3-9368-f7d8b29e6d37 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.933210 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed8074-1c2a-4af3-9368-f7d8b29e6d37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:01.935233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed8074-1c2a-4af3-9368-f7d8b29e6d37 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:01.945830 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944e31a-42bf-4639-a8ea-dd63f756eee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:01.946857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944e31a-42bf-4639-a8ea-dd63f756eee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.947276 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944e31a-42bf-4639-a8ea-dd63f756eee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.947664 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944e31a-42bf-4639-a8ea-dd63f756eee0 admin admin] PATH_INFO: `/v3/projects/e1914f809a2a4dc996bc768050cef17b/users/052e427fb0b84fe7b31705fbfb708533/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.966940 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 777/1573] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:01 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:01.967879 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed8074-1c2a-4af3-9368-f7d8b29e6d37 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:01.968664 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944e31a-42bf-4639-a8ea-dd63f756eee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1914f809a2a4dc996bc768050cef17b, user_id=052e427fb0b84fe7b31705fbfb708533, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:01.969810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: WARNING py.warnings [None req-c944e31a-42bf-4639-a8ea-dd63f756eee0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:50:01.969810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: warnings.warn(msg) Aug 24 04:50:01.969810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: Aug 24 04:50:01.972018 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944e31a-42bf-4639-a8ea-dd63f756eee0 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:01.991370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 797/1574] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:01 2022] PUT /identity/v3/projects/e1914f809a2a4dc996bc768050cef17b/users/052e427fb0b84fe7b31705fbfb708533/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:01.992402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944e31a-42bf-4639-a8ea-dd63f756eee0 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.046600 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed8074-1c2a-4af3-9368-f7d8b29e6d37 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.065026 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944e31a-42bf-4639-a8ea-dd63f756eee0 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.071138 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96917d3-3905-4d01-b9a4-3e638636affe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.071834 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96917d3-3905-4d01-b9a4-3e638636affe admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.072203 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96917d3-3905-4d01-b9a4-3e638636affe admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.072474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96917d3-3905-4d01-b9a4-3e638636affe admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.073104 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96917d3-3905-4d01-b9a4-3e638636affe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.075062 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96917d3-3905-4d01-b9a4-3e638636affe admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.081146 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:02.086179 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:02.115094 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bc444-dc44-4ea4-9ff2-d1e50f9c6a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.115739 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bc444-dc44-4ea4-9ff2-d1e50f9c6a11 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.115918 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 798/1575] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:01 2022] POST /identity/v3/projects => generated 391 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:02.117433 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96917d3-3905-4d01-b9a4-3e638636affe admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.117878 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bc444-dc44-4ea4-9ff2-d1e50f9c6a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.118289 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bc444-dc44-4ea4-9ff2-d1e50f9c6a11 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.120084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bc444-dc44-4ea4-9ff2-d1e50f9c6a11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.123071 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bc444-dc44-4ea4-9ff2-d1e50f9c6a11 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.164507 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 778/1576] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:01 2022] POST /identity/v3/projects => generated 379 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:02.166300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bc444-dc44-4ea4-9ff2-d1e50f9c6a11 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.204949 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96917d3-3905-4d01-b9a4-3e638636affe admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.247305 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bc444-dc44-4ea4-9ff2-d1e50f9c6a11 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.255097 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63155c-b380-42a6-b466-f6643c0dc72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.255846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63155c-b380-42a6-b466-f6643c0dc72a admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.256131 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63155c-b380-42a6-b466-f6643c0dc72a admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.256438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63155c-b380-42a6-b466-f6643c0dc72a admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.257103 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63155c-b380-42a6-b466-f6643c0dc72a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.260185 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63155c-b380-42a6-b466-f6643c0dc72a admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.274808 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20500364-b0e5-4a77-a755-268541640a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.275754 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20500364-b0e5-4a77-a755-268541640a78 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.275954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20500364-b0e5-4a77-a755-268541640a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.277193 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20500364-b0e5-4a77-a755-268541640a78 admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.277193 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20500364-b0e5-4a77-a755-268541640a78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.278840 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20500364-b0e5-4a77-a755-268541640a78 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.300098 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 779/1577] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:02 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:02.302370 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6b79e-217e-42ee-ad37-d7105ef0ec55 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.302738 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6b79e-217e-42ee-ad37-d7105ef0ec55 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.303021 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6b79e-217e-42ee-ad37-d7105ef0ec55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.330739 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 799/1578] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:02 2022] POST /identity/v3/projects => generated 403 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:02.332041 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20500364-b0e5-4a77-a755-268541640a78 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.345787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-16f6b79e-217e-42ee-ad37-d7105ef0ec55 None None] MFA Rules not processed for user `22debcb00f1b45058f528fe393451c31`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:02.348320 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-16f6b79e-217e-42ee-ad37-d7105ef0ec55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:02.421220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20500364-b0e5-4a77-a755-268541640a78 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.427005 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a80e9d-343b-4488-a5ed-8136f8ef20cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.427660 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a80e9d-343b-4488-a5ed-8136f8ef20cb admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.427943 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a80e9d-343b-4488-a5ed-8136f8ef20cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.428223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a80e9d-343b-4488-a5ed-8136f8ef20cb admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.428893 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a80e9d-343b-4488-a5ed-8136f8ef20cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.431377 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a80e9d-343b-4488-a5ed-8136f8ef20cb admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.437560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 780/1579] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:02.439112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6b79e-217e-42ee-ad37-d7105ef0ec55 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.454102 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6b79e-217e-42ee-ad37-d7105ef0ec55 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.465028 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7df4ca-959c-43de-8faa-4ac3c2cde9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.470270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7df4ca-959c-43de-8faa-4ac3c2cde9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.470508 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 800/1580] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:02 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:02.470670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7df4ca-959c-43de-8faa-4ac3c2cde9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.470670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7df4ca-959c-43de-8faa-4ac3c2cde9f3 admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.470865 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d483ca2-5e89-4969-ac85-b75dde148ad3 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.470865 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d483ca2-5e89-4969-ac85-b75dde148ad3 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.470865 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d483ca2-5e89-4969-ac85-b75dde148ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.471113 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7df4ca-959c-43de-8faa-4ac3c2cde9f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.471113 dv-cinder-854264-1-smb devstack@keystone.service[93411]: WARNING py.warnings [None req-ef7df4ca-959c-43de-8faa-4ac3c2cde9f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:50:02.471113 dv-cinder-854264-1-smb devstack@keystone.service[93411]: warnings.warn(msg) Aug 24 04:50:02.471113 dv-cinder-854264-1-smb devstack@keystone.service[93411]: Aug 24 04:50:02.474944 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7df4ca-959c-43de-8faa-4ac3c2cde9f3 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.485958 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:02.494122 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-8d483ca2-5e89-4969-ac85-b75dde148ad3 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:02.496901 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-8d483ca2-5e89-4969-ac85-b75dde148ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:02.511122 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 781/1581] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:02 2022] POST /identity/v3/users => generated 289 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:02.512702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7df4ca-959c-43de-8faa-4ac3c2cde9f3 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.524154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7df4ca-959c-43de-8faa-4ac3c2cde9f3 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.536843 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:02.587035 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 801/1582] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:02.587935 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d483ca2-5e89-4969-ac85-b75dde148ad3 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.597785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d483ca2-5e89-4969-ac85-b75dde148ad3 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.602786 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5e657-912a-4253-8307-02a9736e902f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.603576 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5e657-912a-4253-8307-02a9736e902f admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.603793 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5e657-912a-4253-8307-02a9736e902f admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.603959 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5e657-912a-4253-8307-02a9736e902f admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.604580 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5e657-912a-4253-8307-02a9736e902f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.606547 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5e657-912a-4253-8307-02a9736e902f admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.611942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c597f8d-11e5-4118-89cf-058be09f290c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.613078 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c597f8d-11e5-4118-89cf-058be09f290c admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.613353 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c597f8d-11e5-4118-89cf-058be09f290c admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.613653 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c597f8d-11e5-4118-89cf-058be09f290c admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.614327 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c597f8d-11e5-4118-89cf-058be09f290c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.616260 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c597f8d-11e5-4118-89cf-058be09f290c admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.632286 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 802/1583] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:02 2022] POST /identity/v3/users => generated 290 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:02.633386 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5e657-912a-4253-8307-02a9736e902f admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.646392 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5e657-912a-4253-8307-02a9736e902f admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.646823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 782/1584] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:02 2022] POST /identity/v3/users => generated 296 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:02.648286 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c597f8d-11e5-4118-89cf-058be09f290c admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.653620 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027fd39-9456-433b-b4dd-2cef5f8b3a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.654276 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027fd39-9456-433b-b4dd-2cef5f8b3a10 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.654559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027fd39-9456-433b-b4dd-2cef5f8b3a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.654829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027fd39-9456-433b-b4dd-2cef5f8b3a10 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.655478 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027fd39-9456-433b-b4dd-2cef5f8b3a10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.657575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027fd39-9456-433b-b4dd-2cef5f8b3a10 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.659011 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c597f8d-11e5-4118-89cf-058be09f290c admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.664550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e6505-9e49-429b-a760-227f412e2b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.665254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e6505-9e49-429b-a760-227f412e2b9d admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.665580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e6505-9e49-429b-a760-227f412e2b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.665862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e6505-9e49-429b-a760-227f412e2b9d admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.666673 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e6505-9e49-429b-a760-227f412e2b9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.669231 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e6505-9e49-429b-a760-227f412e2b9d admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.690267 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 803/1585] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:02 2022] POST /identity/v3/users => generated 291 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:02.693083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027fd39-9456-433b-b4dd-2cef5f8b3a10 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.700455 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 783/1586] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:02 2022] POST /identity/v3/users => generated 302 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:02.702560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a950b-d825-44e0-8fa6-e346944fffad None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.703048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a950b-d825-44e0-8fa6-e346944fffad None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.703535 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a950b-d825-44e0-8fa6-e346944fffad None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.706050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 784/1587] 10.222.0.94 () {54 vars in 962 bytes} [Wed Aug 24 04:50:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:50:02.706607 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027fd39-9456-433b-b4dd-2cef5f8b3a10 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.707326 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a950b-d825-44e0-8fa6-e346944fffad None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.712547 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3d12f-4951-46c1-b741-064fb7a360ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.713194 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3d12f-4951-46c1-b741-064fb7a360ce admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.713517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3d12f-4951-46c1-b741-064fb7a360ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.713787 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3d12f-4951-46c1-b741-064fb7a360ce admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.714450 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3d12f-4951-46c1-b741-064fb7a360ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.716541 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3d12f-4951-46c1-b741-064fb7a360ce admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.725868 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a950b-d825-44e0-8fa6-e346944fffad None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.731080 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea743a1-2cda-4eb4-b679-b15ee00cf680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.731723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea743a1-2cda-4eb4-b679-b15ee00cf680 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.732228 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea743a1-2cda-4eb4-b679-b15ee00cf680 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.732430 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea743a1-2cda-4eb4-b679-b15ee00cf680 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.732943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea743a1-2cda-4eb4-b679-b15ee00cf680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.734668 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea743a1-2cda-4eb4-b679-b15ee00cf680 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.745053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 804/1588] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:02 2022] POST /identity/v3/users => generated 287 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:02.746148 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3d12f-4951-46c1-b741-064fb7a360ce admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.754935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 785/1589] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:02.755940 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea743a1-2cda-4eb4-b679-b15ee00cf680 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.767342 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea743a1-2cda-4eb4-b679-b15ee00cf680 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.772809 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae806b19-e475-4e7c-926e-49b79faa487a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.773468 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae806b19-e475-4e7c-926e-49b79faa487a admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.773743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae806b19-e475-4e7c-926e-49b79faa487a admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.774017 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae806b19-e475-4e7c-926e-49b79faa487a admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.774691 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae806b19-e475-4e7c-926e-49b79faa487a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.776348 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae806b19-e475-4e7c-926e-49b79faa487a admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.787997 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 786/1590] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:02.788941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae806b19-e475-4e7c-926e-49b79faa487a admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.801218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae806b19-e475-4e7c-926e-49b79faa487a admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.806630 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0637d-0c71-4ad2-b414-da43fb5a6c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.807577 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0637d-0c71-4ad2-b414-da43fb5a6c15 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.807969 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0637d-0c71-4ad2-b414-da43fb5a6c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.808226 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0637d-0c71-4ad2-b414-da43fb5a6c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.808888 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce0637d-0c71-4ad2-b414-da43fb5a6c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.810571 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce0637d-0c71-4ad2-b414-da43fb5a6c15 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.825261 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 787/1591] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:02.827226 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0637d-0c71-4ad2-b414-da43fb5a6c15 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.838239 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3d12f-4951-46c1-b741-064fb7a360ce admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.843951 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0637d-0c71-4ad2-b414-da43fb5a6c15 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.845113 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b608199-a048-41f8-97fc-4b70d54fb7ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.846203 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b608199-a048-41f8-97fc-4b70d54fb7ec service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.846738 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b608199-a048-41f8-97fc-4b70d54fb7ec service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.847657 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b608199-a048-41f8-97fc-4b70d54fb7ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.853717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62406703-2196-4463-8734-df09bbd406da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.854549 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62406703-2196-4463-8734-df09bbd406da admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.855037 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62406703-2196-4463-8734-df09bbd406da admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.855372 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62406703-2196-4463-8734-df09bbd406da admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.856184 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62406703-2196-4463-8734-df09bbd406da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.858298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62406703-2196-4463-8734-df09bbd406da admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.861289 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b608199-a048-41f8-97fc-4b70d54fb7ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.863176 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b608199-a048-41f8-97fc-4b70d54fb7ec service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.875684 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 788/1592] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:02.877396 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 805/1593] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:02.878504 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62406703-2196-4463-8734-df09bbd406da admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.881944 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc004d-0d13-48d7-aff0-7291736f9eab None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.882376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc004d-0d13-48d7-aff0-7291736f9eab None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.882859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc004d-0d13-48d7-aff0-7291736f9eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.897870 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62406703-2196-4463-8734-df09bbd406da admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.905784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854b6d4-51ef-47ef-9159-d502219fb1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.906761 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854b6d4-51ef-47ef-9159-d502219fb1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.907219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854b6d4-51ef-47ef-9159-d502219fb1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.907688 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854b6d4-51ef-47ef-9159-d502219fb1f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.908771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854b6d4-51ef-47ef-9159-d502219fb1f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.911863 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854b6d4-51ef-47ef-9159-d502219fb1f7 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.932600 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 789/1594] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:02.934194 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854b6d4-51ef-47ef-9159-d502219fb1f7 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.958416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854b6d4-51ef-47ef-9159-d502219fb1f7 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.958876 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-b5cc004d-0d13-48d7-aff0-7291736f9eab None None] MFA Rules not processed for user `5bdbda2b9c8f48338c5117585a229cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:02.960838 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-b5cc004d-0d13-48d7-aff0-7291736f9eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:02.963859 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e7d91-3454-4a73-95ee-bed786c7a4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.964604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e7d91-3454-4a73-95ee-bed786c7a4da admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.964920 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e7d91-3454-4a73-95ee-bed786c7a4da admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.965213 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e7d91-3454-4a73-95ee-bed786c7a4da admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.966053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e7d91-3454-4a73-95ee-bed786c7a4da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.967738 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e7d91-3454-4a73-95ee-bed786c7a4da admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.980400 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 790/1595] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:02.981460 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e7d91-3454-4a73-95ee-bed786c7a4da admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.996991 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e7d91-3454-4a73-95ee-bed786c7a4da admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:03.004726 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3b488-1911-44ff-beb9-d13171203308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:03.005493 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3b488-1911-44ff-beb9-d13171203308 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.005852 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3b488-1911-44ff-beb9-d13171203308 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.006203 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3b488-1911-44ff-beb9-d13171203308 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.006943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3b488-1911-44ff-beb9-d13171203308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:03.008659 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3b488-1911-44ff-beb9-d13171203308 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:03.025483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 791/1596] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:03.025483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3b488-1911-44ff-beb9-d13171203308 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:03.029628 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:03.035497 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3b488-1911-44ff-beb9-d13171203308 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:03.041375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3f40b-ba0d-49f9-8cc2-c5ba87e1feb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:03.042045 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3f40b-ba0d-49f9-8cc2-c5ba87e1feb9 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.042322 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3f40b-ba0d-49f9-8cc2-c5ba87e1feb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.042630 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3f40b-ba0d-49f9-8cc2-c5ba87e1feb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.043250 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3f40b-ba0d-49f9-8cc2-c5ba87e1feb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:03.045283 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3f40b-ba0d-49f9-8cc2-c5ba87e1feb9 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:03.061791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 792/1597] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:03.062752 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3f40b-ba0d-49f9-8cc2-c5ba87e1feb9 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:03.074619 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3f40b-ba0d-49f9-8cc2-c5ba87e1feb9 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:03.079866 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf27957-125f-45b3-b835-f4965144e459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:03.080515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf27957-125f-45b3-b835-f4965144e459 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.080930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf27957-125f-45b3-b835-f4965144e459 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.081188 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf27957-125f-45b3-b835-f4965144e459 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.081971 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf27957-125f-45b3-b835-f4965144e459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:03.083645 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf27957-125f-45b3-b835-f4965144e459 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:03.084877 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 806/1598] 10.222.0.94 () {58 vars in 1059 bytes} [Wed Aug 24 04:50:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:03.086158 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc004d-0d13-48d7-aff0-7291736f9eab None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:03.106076 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc004d-0d13-48d7-aff0-7291736f9eab None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:03.114560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a365cb8-46d2-4008-9b5e-9db742aee673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:03.115211 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a365cb8-46d2-4008-9b5e-9db742aee673 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.115683 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a365cb8-46d2-4008-9b5e-9db742aee673 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.117034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a365cb8-46d2-4008-9b5e-9db742aee673 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.117973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a365cb8-46d2-4008-9b5e-9db742aee673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:03.118834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 793/1599] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:03.122103 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf27957-125f-45b3-b835-f4965144e459 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:03.123413 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a365cb8-46d2-4008-9b5e-9db742aee673 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:03.147084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf27957-125f-45b3-b835-f4965144e459 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:03.150008 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 807/1600] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:03.151667 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a365cb8-46d2-4008-9b5e-9db742aee673 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:03.161191 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07adc2a-6430-4504-8da7-3d04e32ee386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:03.163148 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07adc2a-6430-4504-8da7-3d04e32ee386 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.163560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07adc2a-6430-4504-8da7-3d04e32ee386 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.163900 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07adc2a-6430-4504-8da7-3d04e32ee386 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.164637 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07adc2a-6430-4504-8da7-3d04e32ee386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:03.166735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07adc2a-6430-4504-8da7-3d04e32ee386 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:03.167157 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a365cb8-46d2-4008-9b5e-9db742aee673 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:03.174251 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a82f6-0280-428d-be53-f02c797d69e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:03.174737 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a82f6-0280-428d-be53-f02c797d69e9 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.175237 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a82f6-0280-428d-be53-f02c797d69e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.175694 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a82f6-0280-428d-be53-f02c797d69e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.176654 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a82f6-0280-428d-be53-f02c797d69e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:03.178955 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a82f6-0280-428d-be53-f02c797d69e9 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:03.186207 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 794/1601] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:03.191119 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07adc2a-6430-4504-8da7-3d04e32ee386 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:03.195674 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 808/1602] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:03.197744 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a82f6-0280-428d-be53-f02c797d69e9 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:03.206197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07adc2a-6430-4504-8da7-3d04e32ee386 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:03.211723 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a82f6-0280-428d-be53-f02c797d69e9 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:03.215052 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd1121-c0b8-4519-8e4a-0328e2ee0252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:03.215968 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd1121-c0b8-4519-8e4a-0328e2ee0252 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.216405 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd1121-c0b8-4519-8e4a-0328e2ee0252 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.216684 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd1121-c0b8-4519-8e4a-0328e2ee0252 admin admin] PATH_INFO: `/v3/projects/f5dcfc8632b7487e9157ac85305b8b85/users/cab4c264979e46a39cc0ddd2df8ee8df/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.226368 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d475afb-8242-4469-baf4-23816cd2e81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:03.227731 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d475afb-8242-4469-baf4-23816cd2e81b admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.228384 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d475afb-8242-4469-baf4-23816cd2e81b admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.229242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d475afb-8242-4469-baf4-23816cd2e81b admin admin] PATH_INFO: `/v3/projects/3fb2586133ad455a87e944bc64026343/users/6891fc142bc84f0aa30062bc90f06b7d/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.245519 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd1121-c0b8-4519-8e4a-0328e2ee0252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5dcfc8632b7487e9157ac85305b8b85, user_id=cab4c264979e46a39cc0ddd2df8ee8df, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:03.248904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd1121-c0b8-4519-8e4a-0328e2ee0252 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:03.260882 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d475afb-8242-4469-baf4-23816cd2e81b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fb2586133ad455a87e944bc64026343, user_id=6891fc142bc84f0aa30062bc90f06b7d, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:03.266733 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d475afb-8242-4469-baf4-23816cd2e81b admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:03.275176 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 795/1603] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:03 2022] PUT /identity/v3/projects/f5dcfc8632b7487e9157ac85305b8b85/users/cab4c264979e46a39cc0ddd2df8ee8df/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:03.276897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd1121-c0b8-4519-8e4a-0328e2ee0252 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:03.293276 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 809/1604] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:03 2022] PUT /identity/v3/projects/3fb2586133ad455a87e944bc64026343/users/6891fc142bc84f0aa30062bc90f06b7d/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:03.293276 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d475afb-8242-4469-baf4-23816cd2e81b admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:03.304651 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:03.407406 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d475afb-8242-4469-baf4-23816cd2e81b admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:03.417629 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd1121-c0b8-4519-8e4a-0328e2ee0252 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:03.417894 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a36e60-15d2-4292-8135-649ec6649813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:03.419191 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a36e60-15d2-4292-8135-649ec6649813 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.419788 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a36e60-15d2-4292-8135-649ec6649813 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.420371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a36e60-15d2-4292-8135-649ec6649813 admin admin] PATH_INFO: `/v3/projects/aed35c2ce9cf4d32af3df06fca282995/users/a4493625af43482a88023a2aecd73b27/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.455360 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a36e60-15d2-4292-8135-649ec6649813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aed35c2ce9cf4d32af3df06fca282995, user_id=a4493625af43482a88023a2aecd73b27, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:03.461943 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a36e60-15d2-4292-8135-649ec6649813 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:03.486428 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 810/1605] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:03 2022] PUT /identity/v3/projects/aed35c2ce9cf4d32af3df06fca282995/users/a4493625af43482a88023a2aecd73b27/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:03.491085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a36e60-15d2-4292-8135-649ec6649813 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:03.560928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14004a-a091-40a0-8e2d-ccfe56205c82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:03.561699 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14004a-a091-40a0-8e2d-ccfe56205c82 service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.562052 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14004a-a091-40a0-8e2d-ccfe56205c82 service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.562396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14004a-a091-40a0-8e2d-ccfe56205c82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.594699 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a36e60-15d2-4292-8135-649ec6649813 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:03.601148 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da440b75-34a7-49e2-b7d4-d9bae186e8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:03.602090 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da440b75-34a7-49e2-b7d4-d9bae186e8b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.602468 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da440b75-34a7-49e2-b7d4-d9bae186e8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.602840 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da440b75-34a7-49e2-b7d4-d9bae186e8b3 admin admin] PATH_INFO: `/v3/projects/d73d1ed0d5b44b37948f2aeb18ed9237/users/f3376c9a419d44da8046b536b3a06af0/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.622235 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da440b75-34a7-49e2-b7d4-d9bae186e8b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d73d1ed0d5b44b37948f2aeb18ed9237, user_id=f3376c9a419d44da8046b536b3a06af0, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:03.625854 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da440b75-34a7-49e2-b7d4-d9bae186e8b3 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:03.631060 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:03.661219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 811/1606] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:03 2022] PUT /identity/v3/projects/d73d1ed0d5b44b37948f2aeb18ed9237/users/f3376c9a419d44da8046b536b3a06af0/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:03.661219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da440b75-34a7-49e2-b7d4-d9bae186e8b3 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:03.680718 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14004a-a091-40a0-8e2d-ccfe56205c82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:03.682644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14004a-a091-40a0-8e2d-ccfe56205c82 service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:03.699402 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 796/1607] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:03.700298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14004a-a091-40a0-8e2d-ccfe56205c82 service nova] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:03.721714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14004a-a091-40a0-8e2d-ccfe56205c82 service nova] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:03.782193 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da440b75-34a7-49e2-b7d4-d9bae186e8b3 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:03.802389 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e739956-5623-45e4-83f0-56e0379ac852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:03.804373 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e739956-5623-45e4-83f0-56e0379ac852 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.806060 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e739956-5623-45e4-83f0-56e0379ac852 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.806429 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e739956-5623-45e4-83f0-56e0379ac852 admin admin] PATH_INFO: `/v3/projects/9b7b6960f798444ab23de2a8866eec66/users/c15e5cb5ed304733ba3dadad1a6a01a3/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.820372 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:03.836567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509891f-ef55-4290-bc13-dbd3737959ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:03.838026 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509891f-ef55-4290-bc13-dbd3737959ad admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.838517 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509891f-ef55-4290-bc13-dbd3737959ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.838861 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509891f-ef55-4290-bc13-dbd3737959ad admin admin] PATH_INFO: `/v3/projects/a0ab2f1493dc4f89ba49016ec7c4c78f/users/c1c11d3532f849e38fb3fd0a793f26bc/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.860897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509891f-ef55-4290-bc13-dbd3737959ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0ab2f1493dc4f89ba49016ec7c4c78f, user_id=c1c11d3532f849e38fb3fd0a793f26bc, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:03.865491 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509891f-ef55-4290-bc13-dbd3737959ad admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:03.872593 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e739956-5623-45e4-83f0-56e0379ac852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b7b6960f798444ab23de2a8866eec66, user_id=c15e5cb5ed304733ba3dadad1a6a01a3, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:03.880402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e739956-5623-45e4-83f0-56e0379ac852 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:03.901238 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 797/1608] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:03 2022] PUT /identity/v3/projects/a0ab2f1493dc4f89ba49016ec7c4c78f/users/c1c11d3532f849e38fb3fd0a793f26bc/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:03.904154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551078c5-21e8-410a-b025-5c352fc18d7b None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.904372 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551078c5-21e8-410a-b025-5c352fc18d7b None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.905045 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551078c5-21e8-410a-b025-5c352fc18d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.922071 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 812/1609] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:03 2022] PUT /identity/v3/projects/9b7b6960f798444ab23de2a8866eec66/users/c15e5cb5ed304733ba3dadad1a6a01a3/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:03.927003 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca62ce-be51-4673-bdfe-bcbfaa5d8926 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.927584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca62ce-be51-4673-bdfe-bcbfaa5d8926 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.928094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca62ce-be51-4673-bdfe-bcbfaa5d8926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.944331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-551078c5-21e8-410a-b025-5c352fc18d7b None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:03.946826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-551078c5-21e8-410a-b025-5c352fc18d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:04.005831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-d1ca62ce-be51-4673-bdfe-bcbfaa5d8926 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:04.008069 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-d1ca62ce-be51-4673-bdfe-bcbfaa5d8926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:04.084533 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 798/1610] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:04.084533 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0268c3-9c5d-4f54-8ef4-7d67ca5ba37b None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.084533 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0268c3-9c5d-4f54-8ef4-7d67ca5ba37b None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.084533 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0268c3-9c5d-4f54-8ef4-7d67ca5ba37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.108247 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-ca0268c3-9c5d-4f54-8ef4-7d67ca5ba37b None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:04.109588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-ca0268c3-9c5d-4f54-8ef4-7d67ca5ba37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:04.124077 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 799/1611] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:04.125859 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a893be0-90c9-419c-a514-8ae960b6cda5 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.126522 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a893be0-90c9-419c-a514-8ae960b6cda5 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.126522 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a893be0-90c9-419c-a514-8ae960b6cda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.166976 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-3a893be0-90c9-419c-a514-8ae960b6cda5 None None] MFA Rules not processed for user `f3376c9a419d44da8046b536b3a06af0`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:04.168439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-3a893be0-90c9-419c-a514-8ae960b6cda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:04.226306 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 813/1612] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:04.241593 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6029280-5b23-40a5-8ae8-4465380f45b6 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.244147 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6029280-5b23-40a5-8ae8-4465380f45b6 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.244771 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6029280-5b23-40a5-8ae8-4465380f45b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.264068 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 800/1613] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:04.264068 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722dc87-9590-44b2-8ddc-5fda0f620e4e None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.264068 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722dc87-9590-44b2-8ddc-5fda0f620e4e None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.264068 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722dc87-9590-44b2-8ddc-5fda0f620e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.290436 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-a722dc87-9590-44b2-8ddc-5fda0f620e4e None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:04.292117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-a722dc87-9590-44b2-8ddc-5fda0f620e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:04.302430 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 801/1614] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:04.303745 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722dc87-9590-44b2-8ddc-5fda0f620e4e None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:04.305050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-a722dc87-9590-44b2-8ddc-5fda0f620e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:04.384766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-a6029280-5b23-40a5-8ae8-4465380f45b6 None None] MFA Rules not processed for user `c1c11d3532f849e38fb3fd0a793f26bc`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:04.386713 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-a6029280-5b23-40a5-8ae8-4465380f45b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:04.396643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:04.405339 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722dc87-9590-44b2-8ddc-5fda0f620e4e None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:04.415697 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d1a59-49cc-4cdd-a4e5-41401a63a479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:04.416626 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d1a59-49cc-4cdd-a4e5-41401a63a479 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.416921 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d1a59-49cc-4cdd-a4e5-41401a63a479 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.417192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d1a59-49cc-4cdd-a4e5-41401a63a479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.433031 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d1a59-49cc-4cdd-a4e5-41401a63a479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:04.435858 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d1a59-49cc-4cdd-a4e5-41401a63a479 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:04.450736 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 802/1615] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:04.451788 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d1a59-49cc-4cdd-a4e5-41401a63a479 service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:04.464923 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d1a59-49cc-4cdd-a4e5-41401a63a479 service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:04.475667 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91441b8d-922d-4ceb-9dde-d75797e898d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:04.476177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91441b8d-922d-4ceb-9dde-d75797e898d8 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.476910 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91441b8d-922d-4ceb-9dde-d75797e898d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.477349 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91441b8d-922d-4ceb-9dde-d75797e898d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.498942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91441b8d-922d-4ceb-9dde-d75797e898d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:04.501869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91441b8d-922d-4ceb-9dde-d75797e898d8 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:04.526342 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 803/1616] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:04.529916 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91441b8d-922d-4ceb-9dde-d75797e898d8 service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:04.550523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91441b8d-922d-4ceb-9dde-d75797e898d8 service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:04.557827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70826a-401b-4dd9-8692-94f6d253514b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:04.559329 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70826a-401b-4dd9-8692-94f6d253514b service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.561215 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70826a-401b-4dd9-8692-94f6d253514b service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.562389 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70826a-401b-4dd9-8692-94f6d253514b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.591321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 814/1617] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:04.592927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6029280-5b23-40a5-8ae8-4465380f45b6 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:04.614439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:04.628179 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70826a-401b-4dd9-8692-94f6d253514b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:04.637425 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70826a-401b-4dd9-8692-94f6d253514b service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:04.683272 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 804/1618] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:04.686511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70826a-401b-4dd9-8692-94f6d253514b service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:04.712157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70826a-401b-4dd9-8692-94f6d253514b service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:04.723999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0b32a-69d7-467b-a9a4-905d2b545a9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:04.724793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0b32a-69d7-467b-a9a4-905d2b545a9e service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.725082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0b32a-69d7-467b-a9a4-905d2b545a9e service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.725355 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0b32a-69d7-467b-a9a4-905d2b545a9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.748008 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0b32a-69d7-467b-a9a4-905d2b545a9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:04.750199 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6029280-5b23-40a5-8ae8-4465380f45b6 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:04.753757 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0b32a-69d7-467b-a9a4-905d2b545a9e service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:04.756746 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a7aa5-e5fe-4885-a091-e99b1f6b7399 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:04.757653 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a7aa5-e5fe-4885-a091-e99b1f6b7399 service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.758065 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a7aa5-e5fe-4885-a091-e99b1f6b7399 service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.759155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a7aa5-e5fe-4885-a091-e99b1f6b7399 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.770768 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a7aa5-e5fe-4885-a091-e99b1f6b7399 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:04.772586 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a7aa5-e5fe-4885-a091-e99b1f6b7399 service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:04.781140 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 805/1619] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:04.783771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcc4f0-36d6-4c44-92db-9d77a98b0a59 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.784049 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcc4f0-36d6-4c44-92db-9d77a98b0a59 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.785240 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 815/1620] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:04.786599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a7aa5-e5fe-4885-a091-e99b1f6b7399 service nova] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:04.799213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a7aa5-e5fe-4885-a091-e99b1f6b7399 service nova] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:04.799360 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcc4f0-36d6-4c44-92db-9d77a98b0a59 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.802335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 806/1621] 10.222.0.94 () {54 vars in 962 bytes} [Wed Aug 24 04:50:04 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:50:04.805292 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb23ccf-9e4e-4f24-9646-8dafe56a4c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:04.806090 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb23ccf-9e4e-4f24-9646-8dafe56a4c74 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.806601 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb23ccf-9e4e-4f24-9646-8dafe56a4c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.806973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb23ccf-9e4e-4f24-9646-8dafe56a4c74 admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.808140 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb23ccf-9e4e-4f24-9646-8dafe56a4c74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:04.810576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c23cf-b7d8-4c36-a74d-3e8d3dd823f5 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.810576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c23cf-b7d8-4c36-a74d-3e8d3dd823f5 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.810884 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c23cf-b7d8-4c36-a74d-3e8d3dd823f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.811238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb23ccf-9e4e-4f24-9646-8dafe56a4c74 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:04.858092 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-937c23cf-b7d8-4c36-a74d-3e8d3dd823f5 None None] MFA Rules not processed for user `5bdbda2b9c8f48338c5117585a229cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:04.859383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-937c23cf-b7d8-4c36-a74d-3e8d3dd823f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:04.881647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 807/1622] 10.222.0.94 () {58 vars in 1059 bytes} [Wed Aug 24 04:50:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:04.883865 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d2b21-7be4-43b2-8a1f-648d372f4ae1 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.884932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d2b21-7be4-43b2-8a1f-648d372f4ae1 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.885369 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d2b21-7be4-43b2-8a1f-648d372f4ae1 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.887365 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 808/1623] 10.222.0.94 () {54 vars in 912 bytes} [Wed Aug 24 04:50:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:50:04.895789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 816/1624] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:04 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:04.899254 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424097d4-79be-410c-852c-da6cd0f02c62 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.899489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d2b21-7be4-43b2-8a1f-648d372f4ae1 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:04.899626 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424097d4-79be-410c-852c-da6cd0f02c62 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.899863 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424097d4-79be-410c-852c-da6cd0f02c62 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.911467 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 817/1625] 10.222.0.94 () {54 vars in 912 bytes} [Wed Aug 24 04:50:04 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:50:04.915166 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a91144-37a0-453d-8a41-36f9d92af56a None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.916581 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a91144-37a0-453d-8a41-36f9d92af56a None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.917783 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a91144-37a0-453d-8a41-36f9d92af56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.966840 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-23a91144-37a0-453d-8a41-36f9d92af56a None None] MFA Rules not processed for user `5bdbda2b9c8f48338c5117585a229cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:04.971586 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-23a91144-37a0-453d-8a41-36f9d92af56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:05.000768 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d2b21-7be4-43b2-8a1f-648d372f4ae1 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:05.007950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60317d22-fe48-4af9-8578-74ae977db584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:05.008586 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60317d22-fe48-4af9-8578-74ae977db584 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:05.008865 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60317d22-fe48-4af9-8578-74ae977db584 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:05.009181 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60317d22-fe48-4af9-8578-74ae977db584 admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:05.009924 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60317d22-fe48-4af9-8578-74ae977db584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:05.012121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60317d22-fe48-4af9-8578-74ae977db584 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:05.045075 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 809/1626] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:04 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:05.046686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caff869-2638-43b8-9b18-6a703c513bb2 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:05.047082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caff869-2638-43b8-9b18-6a703c513bb2 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:05.047424 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caff869-2638-43b8-9b18-6a703c513bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:05.089220 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-5caff869-2638-43b8-9b18-6a703c513bb2 None None] MFA Rules not processed for user `5bdbda2b9c8f48338c5117585a229cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:05.094971 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-5caff869-2638-43b8-9b18-6a703c513bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:05.101251 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 818/1627] 10.222.0.94 () {58 vars in 1009 bytes} [Wed Aug 24 04:50:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:05.102665 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a91144-37a0-453d-8a41-36f9d92af56a None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:05.125238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a91144-37a0-453d-8a41-36f9d92af56a None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:05.131935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 810/1628] 10.222.0.94 () {58 vars in 1009 bytes} [Wed Aug 24 04:50:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:05.133621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caff869-2638-43b8-9b18-6a703c513bb2 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:05.143435 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f474b9e-5d72-4a60-8b90-6f0faba6a5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:05.144559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f474b9e-5d72-4a60-8b90-6f0faba6a5ba admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:05.144913 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f474b9e-5d72-4a60-8b90-6f0faba6a5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:05.145334 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f474b9e-5d72-4a60-8b90-6f0faba6a5ba admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:05.146340 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f474b9e-5d72-4a60-8b90-6f0faba6a5ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:05.148152 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f474b9e-5d72-4a60-8b90-6f0faba6a5ba admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:05.179985 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 819/1629] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:05.180869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f474b9e-5d72-4a60-8b90-6f0faba6a5ba admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:05.219601 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caff869-2638-43b8-9b18-6a703c513bb2 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:05.224533 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35538d1d-8f6e-4249-b481-246d0272b9a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:05.226056 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35538d1d-8f6e-4249-b481-246d0272b9a0 service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:05.226341 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35538d1d-8f6e-4249-b481-246d0272b9a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:05.226617 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35538d1d-8f6e-4249-b481-246d0272b9a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:05.255060 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35538d1d-8f6e-4249-b481-246d0272b9a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:05.256869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35538d1d-8f6e-4249-b481-246d0272b9a0 service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:05.287695 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f474b9e-5d72-4a60-8b90-6f0faba6a5ba admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:05.296123 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 811/1630] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:05.355788 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35538d1d-8f6e-4249-b481-246d0272b9a0 service cinder] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:05.394943 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5431081-aada-4cba-a2a5-6c43a5dbc8e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:05.394943 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5431081-aada-4cba-a2a5-6c43a5dbc8e9 service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:05.394943 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5431081-aada-4cba-a2a5-6c43a5dbc8e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:05.394943 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5431081-aada-4cba-a2a5-6c43a5dbc8e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:05.397700 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35538d1d-8f6e-4249-b481-246d0272b9a0 service cinder] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:05.398226 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:05.398305 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aaa31f-2315-447e-9b4a-dee56a64c84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:05.398305 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aaa31f-2315-447e-9b4a-dee56a64c84a admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:05.398305 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aaa31f-2315-447e-9b4a-dee56a64c84a admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:05.398305 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aaa31f-2315-447e-9b4a-dee56a64c84a admin admin] PATH_INFO: `/v3/projects/f2d09569980344be98f93f7f5a758ac8/users/34a16d7284d2481d8a70d5c298a832e7/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:05.398590 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5431081-aada-4cba-a2a5-6c43a5dbc8e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:05.398590 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5431081-aada-4cba-a2a5-6c43a5dbc8e9 service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:05.398733 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aaa31f-2315-447e-9b4a-dee56a64c84a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d09569980344be98f93f7f5a758ac8, user_id=34a16d7284d2481d8a70d5c298a832e7, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:05.398733 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aaa31f-2315-447e-9b4a-dee56a64c84a admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:05.398877 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 820/1631] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:05.429992 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 812/1632] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:05 2022] PUT /identity/v3/projects/f2d09569980344be98f93f7f5a758ac8/users/34a16d7284d2481d8a70d5c298a832e7/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:05.430953 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5431081-aada-4cba-a2a5-6c43a5dbc8e9 service cinder] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:05.451625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5431081-aada-4cba-a2a5-6c43a5dbc8e9 service cinder] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:05.608728 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e44e7-ae5a-4566-a808-e6c7b8b7e22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:05.609516 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e44e7-ae5a-4566-a808-e6c7b8b7e22e admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:05.609931 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e44e7-ae5a-4566-a808-e6c7b8b7e22e admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:05.610586 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e44e7-ae5a-4566-a808-e6c7b8b7e22e admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:05.611907 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e44e7-ae5a-4566-a808-e6c7b8b7e22e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:05.614414 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e44e7-ae5a-4566-a808-e6c7b8b7e22e admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:05.631281 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 821/1633] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:05.635123 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aaa31f-2315-447e-9b4a-dee56a64c84a admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:05.657119 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aaa31f-2315-447e-9b4a-dee56a64c84a admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:05.667843 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b73b0-bebb-40a3-800a-0bf3845590a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:05.669207 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b73b0-bebb-40a3-800a-0bf3845590a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:05.672258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b73b0-bebb-40a3-800a-0bf3845590a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:05.672715 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b73b0-bebb-40a3-800a-0bf3845590a2 admin admin] PATH_INFO: `/v3/projects/f2d09569980344be98f93f7f5a758ac8/users/34a16d7284d2481d8a70d5c298a832e7/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:05.675949 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b73b0-bebb-40a3-800a-0bf3845590a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d09569980344be98f93f7f5a758ac8, user_id=34a16d7284d2481d8a70d5c298a832e7, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:05.684496 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b73b0-bebb-40a3-800a-0bf3845590a2 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:05.688634 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:05.727144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 813/1634] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:05 2022] PUT /identity/v3/projects/f2d09569980344be98f93f7f5a758ac8/users/34a16d7284d2481d8a70d5c298a832e7/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:05.754431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824ead1-d507-4b63-9cf1-7efb93278ccd None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:05.754431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824ead1-d507-4b63-9cf1-7efb93278ccd None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:05.754431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824ead1-d507-4b63-9cf1-7efb93278ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:05.755173 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b73b0-bebb-40a3-800a-0bf3845590a2 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:05.812165 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-6824ead1-d507-4b63-9cf1-7efb93278ccd None None] MFA Rules not processed for user `34a16d7284d2481d8a70d5c298a832e7`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:05.813884 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-6824ead1-d507-4b63-9cf1-7efb93278ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:05.907801 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b73b0-bebb-40a3-800a-0bf3845590a2 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:05.922225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848276b-6123-4794-8c04-18e012124eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:05.923958 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848276b-6123-4794-8c04-18e012124eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:05.923958 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848276b-6123-4794-8c04-18e012124eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:05.923958 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848276b-6123-4794-8c04-18e012124eb9 admin admin] PATH_INFO: `/v3/users/22debcb00f1b45058f528fe393451c31` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:05.926123 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848276b-6123-4794-8c04-18e012124eb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22debcb00f1b45058f528fe393451c31)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:05.931080 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848276b-6123-4794-8c04-18e012124eb9 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:06.054044 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 822/1635] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:06.059722 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-6848276b-6123-4794-8c04-18e012124eb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22debcb00f1b45058f528fe393451c31'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:06.062971 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-6848276b-6123-4794-8c04-18e012124eb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22debcb00f1b45058f528fe393451c31'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:06.085087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824ead1-d507-4b63-9cf1-7efb93278ccd None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:06.090022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-6848276b-6123-4794-8c04-18e012124eb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22debcb00f1b45058f528fe393451c31'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:06.115770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-6848276b-6123-4794-8c04-18e012124eb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22debcb00f1b45058f528fe393451c31'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:06.124791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-6848276b-6123-4794-8c04-18e012124eb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22debcb00f1b45058f528fe393451c31'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:06.136833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 814/1636] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:05 2022] DELETE /identity/v3/users/22debcb00f1b45058f528fe393451c31 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:06.138381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285e5af-fc3a-4906-a6ba-5d70a1f8b23b None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:06.138726 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285e5af-fc3a-4906-a6ba-5d70a1f8b23b None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:06.139005 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285e5af-fc3a-4906-a6ba-5d70a1f8b23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:06.179401 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-4285e5af-fc3a-4906-a6ba-5d70a1f8b23b None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:06.184365 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-4285e5af-fc3a-4906-a6ba-5d70a1f8b23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:06.259993 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824ead1-d507-4b63-9cf1-7efb93278ccd None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:06.340573 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:06.362776 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 815/1637] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:06.393215 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285e5af-fc3a-4906-a6ba-5d70a1f8b23b None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:06.397557 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-4285e5af-fc3a-4906-a6ba-5d70a1f8b23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:06.406744 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dde2db-7d63-4113-9c47-fbb19121b6e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:06.407514 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dde2db-7d63-4113-9c47-fbb19121b6e1 service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:06.407840 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dde2db-7d63-4113-9c47-fbb19121b6e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:06.409347 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dde2db-7d63-4113-9c47-fbb19121b6e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:06.419605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-07dde2db-7d63-4113-9c47-fbb19121b6e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:06.448998 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:06.560346 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285e5af-fc3a-4906-a6ba-5d70a1f8b23b None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:06.574790 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357eac1f-7a2c-4a9d-b54b-0899f11e34bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:06.575455 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357eac1f-7a2c-4a9d-b54b-0899f11e34bc service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:06.575734 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357eac1f-7a2c-4a9d-b54b-0899f11e34bc service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:06.576003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357eac1f-7a2c-4a9d-b54b-0899f11e34bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:06.606868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dde2db-7d63-4113-9c47-fbb19121b6e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:06.611878 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dde2db-7d63-4113-9c47-fbb19121b6e1 service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:06.617638 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357eac1f-7a2c-4a9d-b54b-0899f11e34bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:06.619341 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357eac1f-7a2c-4a9d-b54b-0899f11e34bc service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:06.633098 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 823/1638] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:06.676338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 816/1639] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:50:07.561756 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dde2db-7d63-4113-9c47-fbb19121b6e1 service cinder] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:07.563907 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-07dde2db-7d63-4113-9c47-fbb19121b6e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:07.583892 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dde2db-7d63-4113-9c47-fbb19121b6e1 service cinder] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:07.591108 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7164b0-914f-4d9d-824b-57c35d23d481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:07.592141 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7164b0-914f-4d9d-824b-57c35d23d481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:07.592487 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7164b0-914f-4d9d-824b-57c35d23d481 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:07.592842 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7164b0-914f-4d9d-824b-57c35d23d481 admin admin] PATH_INFO: `/v3/users/c1c11d3532f849e38fb3fd0a793f26bc` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:07.594504 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7164b0-914f-4d9d-824b-57c35d23d481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1c11d3532f849e38fb3fd0a793f26bc)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:07.596300 dv-cinder-854264-1-smb devstack@keystone.service[93412]: WARNING py.warnings [None req-ba7164b0-914f-4d9d-824b-57c35d23d481 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:50:07.596300 dv-cinder-854264-1-smb devstack@keystone.service[93412]: warnings.warn(msg) Aug 24 04:50:07.596300 dv-cinder-854264-1-smb devstack@keystone.service[93412]: Aug 24 04:50:07.598698 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7164b0-914f-4d9d-824b-57c35d23d481 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:07.729642 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ba7164b0-914f-4d9d-824b-57c35d23d481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1c11d3532f849e38fb3fd0a793f26bc'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:07.787308 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ba7164b0-914f-4d9d-824b-57c35d23d481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1c11d3532f849e38fb3fd0a793f26bc'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:07.858707 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ba7164b0-914f-4d9d-824b-57c35d23d481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1c11d3532f849e38fb3fd0a793f26bc'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:07.861888 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ba7164b0-914f-4d9d-824b-57c35d23d481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1c11d3532f849e38fb3fd0a793f26bc'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:07.989808 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ba7164b0-914f-4d9d-824b-57c35d23d481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1c11d3532f849e38fb3fd0a793f26bc'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:08.028317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 824/1640] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:07 2022] DELETE /identity/v3/users/c1c11d3532f849e38fb3fd0a793f26bc => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:08.036315 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b49d8-4b3d-4685-aa75-8611318e430c None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:08.038142 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b49d8-4b3d-4685-aa75-8611318e430c None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:08.038766 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b49d8-4b3d-4685-aa75-8611318e430c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:08.117236 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7164b0-914f-4d9d-824b-57c35d23d481 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:08.120524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ba7164b0-914f-4d9d-824b-57c35d23d481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:08.131249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-429b49d8-4b3d-4685-aa75-8611318e430c None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:08.143920 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-429b49d8-4b3d-4685-aa75-8611318e430c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:08.306015 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:08.321022 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7164b0-914f-4d9d-824b-57c35d23d481 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:08.338615 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaddf4a-bb61-46cf-bf57-e56390c93cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:08.339193 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaddf4a-bb61-46cf-bf57-e56390c93cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:08.339528 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaddf4a-bb61-46cf-bf57-e56390c93cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:08.339809 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaddf4a-bb61-46cf-bf57-e56390c93cc2 admin admin] PATH_INFO: `/v3/projects/a2ec47ad08a1414c84013ca724f2515e` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:08.341914 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaddf4a-bb61-46cf-bf57-e56390c93cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2ec47ad08a1414c84013ca724f2515e)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:08.346058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaddf4a-bb61-46cf-bf57-e56390c93cc2 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:08.388093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 817/1641] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:08.446783 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b49d8-4b3d-4685-aa75-8611318e430c None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:08.448092 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-429b49d8-4b3d-4685-aa75-8611318e430c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:08.528724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-abaddf4a-bb61-46cf-bf57-e56390c93cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2ec47ad08a1414c84013ca724f2515e', 'request_id': 'req-abaddf4a-bb61-46cf-bf57-e56390c93cc2'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:08.555355 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-abaddf4a-bb61-46cf-bf57-e56390c93cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2ec47ad08a1414c84013ca724f2515e', 'request_id': 'req-abaddf4a-bb61-46cf-bf57-e56390c93cc2'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:08.582646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-abaddf4a-bb61-46cf-bf57-e56390c93cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2ec47ad08a1414c84013ca724f2515e', 'request_id': 'req-abaddf4a-bb61-46cf-bf57-e56390c93cc2'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:08.630306 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-abaddf4a-bb61-46cf-bf57-e56390c93cc2 admin admin] The token cache is being invalidate because project a2ec47ad08a1414c84013ca724f2515e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:08.630953 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-abaddf4a-bb61-46cf-bf57-e56390c93cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:08.632968 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-abaddf4a-bb61-46cf-bf57-e56390c93cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:08.638850 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 825/1642] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:08 2022] DELETE /identity/v3/projects/a2ec47ad08a1414c84013ca724f2515e => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:08.649117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd1c1e-dbfb-4bb8-9fff-b38d060fd0e7 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:08.650058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd1c1e-dbfb-4bb8-9fff-b38d060fd0e7 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:08.665647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd1c1e-dbfb-4bb8-9fff-b38d060fd0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:08.702285 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b49d8-4b3d-4685-aa75-8611318e430c None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:08.789932 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-dfbd1c1e-dbfb-4bb8-9fff-b38d060fd0e7 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:08.795116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-dfbd1c1e-dbfb-4bb8-9fff-b38d060fd0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:08.934951 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf9c19-9df2-4c64-92da-de6cb747e0ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:08.936495 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf9c19-9df2-4c64-92da-de6cb747e0ab service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:08.937250 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf9c19-9df2-4c64-92da-de6cb747e0ab service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:08.937856 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf9c19-9df2-4c64-92da-de6cb747e0ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:08.944726 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-6cbf9c19-9df2-4c64-92da-de6cb747e0ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:08.973621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 826/1643] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:08.978371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965779e-ceb1-4902-941a-8778ea6d0eab None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:08.978667 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965779e-ceb1-4902-941a-8778ea6d0eab None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:08.979633 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965779e-ceb1-4902-941a-8778ea6d0eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:09.009180 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-9965779e-ceb1-4902-941a-8778ea6d0eab None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:09.012136 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-9965779e-ceb1-4902-941a-8778ea6d0eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:09.048171 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 827/1644] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:09.049278 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965779e-ceb1-4902-941a-8778ea6d0eab None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:09.055713 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:09.070991 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965779e-ceb1-4902-941a-8778ea6d0eab None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:09.086032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ca95c-4329-4da2-b389-bfbd74eef2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:09.091814 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ca95c-4329-4da2-b389-bfbd74eef2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:09.094669 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ca95c-4329-4da2-b389-bfbd74eef2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:09.095772 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ca95c-4329-4da2-b389-bfbd74eef2a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:09.097808 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ca95c-4329-4da2-b389-bfbd74eef2a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:09.099232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ca95c-4329-4da2-b389-bfbd74eef2a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:09.110560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf9c19-9df2-4c64-92da-de6cb747e0ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:09.111550 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ca95c-4329-4da2-b389-bfbd74eef2a9 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:09.113398 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf9c19-9df2-4c64-92da-de6cb747e0ab service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:09.126161 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 818/1645] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:09.151899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 828/1646] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:09.156710 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf9c19-9df2-4c64-92da-de6cb747e0ab service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:09.172529 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf9c19-9df2-4c64-92da-de6cb747e0ab service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:09.187013 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae05f7c-5519-489f-8abf-c53eda69cf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:09.187373 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae05f7c-5519-489f-8abf-c53eda69cf3a admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:09.187652 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae05f7c-5519-489f-8abf-c53eda69cf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:09.187926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae05f7c-5519-489f-8abf-c53eda69cf3a admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:09.188583 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae05f7c-5519-489f-8abf-c53eda69cf3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:09.193831 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae05f7c-5519-489f-8abf-c53eda69cf3a admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:09.259776 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 819/1647] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:09 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:09.262352 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ca95c-4329-4da2-b389-bfbd74eef2a9 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:09.298741 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ca95c-4329-4da2-b389-bfbd74eef2a9 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:09.506345 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128be59a-1ff0-4ee0-a483-6c7bf1a9d2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:09.507950 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128be59a-1ff0-4ee0-a483-6c7bf1a9d2ba admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:09.508362 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128be59a-1ff0-4ee0-a483-6c7bf1a9d2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:09.508683 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128be59a-1ff0-4ee0-a483-6c7bf1a9d2ba admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:09.512241 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128be59a-1ff0-4ee0-a483-6c7bf1a9d2ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:09.512413 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891feb3a-9f43-4015-86f9-23ee0f2d0920 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:09.512648 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891feb3a-9f43-4015-86f9-23ee0f2d0920 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:09.512970 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891feb3a-9f43-4015-86f9-23ee0f2d0920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:09.515307 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128be59a-1ff0-4ee0-a483-6c7bf1a9d2ba admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:09.542425 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:09.576889 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 829/1648] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:09 2022] POST /identity/v3/users => generated 288 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:09.585613 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128be59a-1ff0-4ee0-a483-6c7bf1a9d2ba admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:09.618929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128be59a-1ff0-4ee0-a483-6c7bf1a9d2ba admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:09.640426 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8640dc4-04cd-4663-a9d3-750544cf775b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:09.642135 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8640dc4-04cd-4663-a9d3-750544cf775b admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:09.643213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8640dc4-04cd-4663-a9d3-750544cf775b admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:09.644116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8640dc4-04cd-4663-a9d3-750544cf775b admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:09.645311 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8640dc4-04cd-4663-a9d3-750544cf775b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:09.648564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8640dc4-04cd-4663-a9d3-750544cf775b admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:09.665104 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-891feb3a-9f43-4015-86f9-23ee0f2d0920 None None] MFA Rules not processed for user `c15e5cb5ed304733ba3dadad1a6a01a3`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:09.667655 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-891feb3a-9f43-4015-86f9-23ee0f2d0920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:09.701729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 830/1649] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:50:09.702675 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8640dc4-04cd-4663-a9d3-750544cf775b admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:09.723765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8640dc4-04cd-4663-a9d3-750544cf775b admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:09.739008 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51aa57f-4a05-405e-87be-3d89d58f9435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:09.739642 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51aa57f-4a05-405e-87be-3d89d58f9435 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:09.739944 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51aa57f-4a05-405e-87be-3d89d58f9435 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:09.740763 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51aa57f-4a05-405e-87be-3d89d58f9435 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:09.740879 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51aa57f-4a05-405e-87be-3d89d58f9435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:09.745749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51aa57f-4a05-405e-87be-3d89d58f9435 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:09.774757 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 831/1650] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:09.781583 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51aa57f-4a05-405e-87be-3d89d58f9435 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:09.809966 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51aa57f-4a05-405e-87be-3d89d58f9435 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:09.820704 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d7477-0cc4-4ea1-b902-a41e1fcf5213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:09.821576 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d7477-0cc4-4ea1-b902-a41e1fcf5213 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:09.822179 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d7477-0cc4-4ea1-b902-a41e1fcf5213 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:09.823448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d7477-0cc4-4ea1-b902-a41e1fcf5213 admin admin] PATH_INFO: `/v3/projects/6d694555cfea413ea7426ce8a5b3b875/users/d5afc1f833744008ad246b7d32230ed0/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:09.856494 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d7477-0cc4-4ea1-b902-a41e1fcf5213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d694555cfea413ea7426ce8a5b3b875, user_id=d5afc1f833744008ad246b7d32230ed0, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:09.860464 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d7477-0cc4-4ea1-b902-a41e1fcf5213 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:09.887116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 832/1651] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:09 2022] PUT /identity/v3/projects/6d694555cfea413ea7426ce8a5b3b875/users/d5afc1f833744008ad246b7d32230ed0/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:09.910676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6133b2-7572-44d6-a115-f4dca21e38a5 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:09.911621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6133b2-7572-44d6-a115-f4dca21e38a5 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:09.912054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6133b2-7572-44d6-a115-f4dca21e38a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:09.970289 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 820/1652] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:09 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:09.973142 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891feb3a-9f43-4015-86f9-23ee0f2d0920 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:09.976125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-891feb3a-9f43-4015-86f9-23ee0f2d0920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:10.016100 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891feb3a-9f43-4015-86f9-23ee0f2d0920 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:10.090593 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-5c6133b2-7572-44d6-a115-f4dca21e38a5 None None] MFA Rules not processed for user `d5afc1f833744008ad246b7d32230ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:10.093014 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-5c6133b2-7572-44d6-a115-f4dca21e38a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:10.201327 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5379c8-6125-4e8e-b1ed-343e01c33a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:10.203009 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5379c8-6125-4e8e-b1ed-343e01c33a34 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:10.207299 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5379c8-6125-4e8e-b1ed-343e01c33a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:10.209169 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5379c8-6125-4e8e-b1ed-343e01c33a34 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:10.210120 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5379c8-6125-4e8e-b1ed-343e01c33a34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:10.215086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5379c8-6125-4e8e-b1ed-343e01c33a34 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:10.298522 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 821/1653] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:09 2022] POST /identity/v3/projects => generated 405 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:50:10.304696 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5379c8-6125-4e8e-b1ed-343e01c33a34 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:10.329813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 833/1654] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:10.337496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6133b2-7572-44d6-a115-f4dca21e38a5 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:10.360012 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6133b2-7572-44d6-a115-f4dca21e38a5 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:10.393090 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:10.534959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5379c8-6125-4e8e-b1ed-343e01c33a34 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:10.547873 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17aed84-6091-47d1-a4ff-ec02866353e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:10.548051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be64b16-c4e7-4a9d-b903-0f6b4445d548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:10.548435 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be64b16-c4e7-4a9d-b903-0f6b4445d548 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:10.548581 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17aed84-6091-47d1-a4ff-ec02866353e4 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:10.548701 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be64b16-c4e7-4a9d-b903-0f6b4445d548 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:10.548848 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17aed84-6091-47d1-a4ff-ec02866353e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:10.548965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be64b16-c4e7-4a9d-b903-0f6b4445d548 admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:10.549079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17aed84-6091-47d1-a4ff-ec02866353e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:10.549632 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be64b16-c4e7-4a9d-b903-0f6b4445d548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:10.549772 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17aed84-6091-47d1-a4ff-ec02866353e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:10.553001 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be64b16-c4e7-4a9d-b903-0f6b4445d548 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:10.559913 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17aed84-6091-47d1-a4ff-ec02866353e4 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:10.601484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 822/1655] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:10 2022] POST /identity/v3/users => generated 309 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:10.607012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be64b16-c4e7-4a9d-b903-0f6b4445d548 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:10.631979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be64b16-c4e7-4a9d-b903-0f6b4445d548 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:10.646143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a775fc4-27cd-425e-8843-96e65f054743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:10.646434 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a775fc4-27cd-425e-8843-96e65f054743 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:10.646727 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a775fc4-27cd-425e-8843-96e65f054743 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:10.646942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a775fc4-27cd-425e-8843-96e65f054743 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:10.650360 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a775fc4-27cd-425e-8843-96e65f054743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:10.657351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a775fc4-27cd-425e-8843-96e65f054743 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:10.663027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 834/1656] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:10 2022] POST /identity/v3/projects => generated 377 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:50:10.666254 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17aed84-6091-47d1-a4ff-ec02866353e4 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:10.692954 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 823/1657] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:10.703480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a775fc4-27cd-425e-8843-96e65f054743 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:10.738691 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a775fc4-27cd-425e-8843-96e65f054743 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:10.762133 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:10.913024 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17aed84-6091-47d1-a4ff-ec02866353e4 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:10.939123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44db6b-faf7-4498-ade4-4976411e1b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:10.941971 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44db6b-faf7-4498-ade4-4976411e1b60 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:10.949063 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44db6b-faf7-4498-ade4-4976411e1b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:10.951607 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44db6b-faf7-4498-ade4-4976411e1b60 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:10.952531 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44db6b-faf7-4498-ade4-4976411e1b60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:10.959216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44db6b-faf7-4498-ade4-4976411e1b60 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:10.973131 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b70dae-d604-4da5-bef8-c5b9297aabc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:10.974670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b70dae-d604-4da5-bef8-c5b9297aabc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:10.976480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b70dae-d604-4da5-bef8-c5b9297aabc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:10.976922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b70dae-d604-4da5-bef8-c5b9297aabc7 admin admin] PATH_INFO: `/v3/projects/c927f4f0798242448da4f1d06f70330d/users/35cb5db1043344b6a2847a9fb0bfa707/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:11.015643 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 835/1658] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:10 2022] POST /identity/v3/users => generated 295 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:11.017061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44db6b-faf7-4498-ade4-4976411e1b60 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:11.023915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b70dae-d604-4da5-bef8-c5b9297aabc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c927f4f0798242448da4f1d06f70330d, user_id=35cb5db1043344b6a2847a9fb0bfa707, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:11.024225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-da44db6b-faf7-4498-ade4-4976411e1b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:11.031555 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b70dae-d604-4da5-bef8-c5b9297aabc7 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:11.049145 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44db6b-faf7-4498-ade4-4976411e1b60 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:11.060937 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 824/1659] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:10 2022] PUT /identity/v3/projects/c927f4f0798242448da4f1d06f70330d/users/35cb5db1043344b6a2847a9fb0bfa707/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:11.065254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b70dae-d604-4da5-bef8-c5b9297aabc7 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:11.230119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d75b75-a4eb-4fb8-a9ca-ab8fa5fa766a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:11.232299 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d75b75-a4eb-4fb8-a9ca-ab8fa5fa766a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:11.232851 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d75b75-a4eb-4fb8-a9ca-ab8fa5fa766a admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:11.233974 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d75b75-a4eb-4fb8-a9ca-ab8fa5fa766a admin admin] PATH_INFO: `/v3/projects/a0ab2f1493dc4f89ba49016ec7c4c78f` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:11.237938 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d75b75-a4eb-4fb8-a9ca-ab8fa5fa766a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0ab2f1493dc4f89ba49016ec7c4c78f)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:11.243602 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d75b75-a4eb-4fb8-a9ca-ab8fa5fa766a admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:11.257533 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b70dae-d604-4da5-bef8-c5b9297aabc7 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:11.275043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1d94c-d1dc-4177-a77a-f2f9256cce4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:11.277587 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1d94c-d1dc-4177-a77a-f2f9256cce4b admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:11.278173 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1d94c-d1dc-4177-a77a-f2f9256cce4b admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:11.280050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1d94c-d1dc-4177-a77a-f2f9256cce4b admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:11.281486 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1d94c-d1dc-4177-a77a-f2f9256cce4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:11.286016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1d94c-d1dc-4177-a77a-f2f9256cce4b admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:11.313884 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 825/1660] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:11.317105 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1d94c-d1dc-4177-a77a-f2f9256cce4b admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:11.348621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1d94c-d1dc-4177-a77a-f2f9256cce4b admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:11.376922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:11.386117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-f1d75b75-a4eb-4fb8-a9ca-ab8fa5fa766a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0ab2f1493dc4f89ba49016ec7c4c78f', 'request_id': 'req-f1d75b75-a4eb-4fb8-a9ca-ab8fa5fa766a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:11.411906 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-f1d75b75-a4eb-4fb8-a9ca-ab8fa5fa766a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0ab2f1493dc4f89ba49016ec7c4c78f', 'request_id': 'req-f1d75b75-a4eb-4fb8-a9ca-ab8fa5fa766a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:11.433883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-f1d75b75-a4eb-4fb8-a9ca-ab8fa5fa766a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0ab2f1493dc4f89ba49016ec7c4c78f', 'request_id': 'req-f1d75b75-a4eb-4fb8-a9ca-ab8fa5fa766a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:11.458322 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-f1d75b75-a4eb-4fb8-a9ca-ab8fa5fa766a admin admin] The token cache is being invalidate because project a0ab2f1493dc4f89ba49016ec7c4c78f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:11.458675 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-f1d75b75-a4eb-4fb8-a9ca-ab8fa5fa766a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:11.464164 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-f1d75b75-a4eb-4fb8-a9ca-ab8fa5fa766a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:11.466390 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 836/1661] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:11 2022] DELETE /identity/v3/projects/a0ab2f1493dc4f89ba49016ec7c4c78f => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:11.467236 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d75b75-a4eb-4fb8-a9ca-ab8fa5fa766a admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:11.474097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-f1d75b75-a4eb-4fb8-a9ca-ab8fa5fa766a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:11.520515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6fba3-e11c-4114-ba06-3cc0950f0999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:11.521625 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6fba3-e11c-4114-ba06-3cc0950f0999 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:11.522530 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6fba3-e11c-4114-ba06-3cc0950f0999 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:11.522816 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6fba3-e11c-4114-ba06-3cc0950f0999 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:11.523508 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6fba3-e11c-4114-ba06-3cc0950f0999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:11.527994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6fba3-e11c-4114-ba06-3cc0950f0999 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:11.564182 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 826/1662] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:11.568852 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6fba3-e11c-4114-ba06-3cc0950f0999 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:11.572214 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-aee6fba3-e11c-4114-ba06-3cc0950f0999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:11.596114 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:11.616015 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6fba3-e11c-4114-ba06-3cc0950f0999 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:11.636044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538293f-87a5-4ef7-81eb-57d102a23d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:11.640688 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d75b75-a4eb-4fb8-a9ca-ab8fa5fa766a admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:11.643668 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538293f-87a5-4ef7-81eb-57d102a23d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:11.648302 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538293f-87a5-4ef7-81eb-57d102a23d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:11.648741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538293f-87a5-4ef7-81eb-57d102a23d39 admin admin] PATH_INFO: `/v3/users/34a16d7284d2481d8a70d5c298a832e7` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:11.650839 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538293f-87a5-4ef7-81eb-57d102a23d39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a16d7284d2481d8a70d5c298a832e7)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:11.651704 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cec23-5bcc-4cd0-9e80-bc2916fd2ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:11.652701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cec23-5bcc-4cd0-9e80-bc2916fd2ee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:11.653136 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cec23-5bcc-4cd0-9e80-bc2916fd2ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:11.653604 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cec23-5bcc-4cd0-9e80-bc2916fd2ee0 admin admin] PATH_INFO: `/v3/projects/f3e6d0587b2648fcb9d59ea0e28da9f5/users/65a40a0dc16a4828871450529f878cf0/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:11.654357 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538293f-87a5-4ef7-81eb-57d102a23d39 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:11.707503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2cec23-5bcc-4cd0-9e80-bc2916fd2ee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e6d0587b2648fcb9d59ea0e28da9f5, user_id=65a40a0dc16a4828871450529f878cf0, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:11.712603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2cec23-5bcc-4cd0-9e80-bc2916fd2ee0 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:11.783740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 837/1663] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:11 2022] PUT /identity/v3/projects/f3e6d0587b2648fcb9d59ea0e28da9f5/users/65a40a0dc16a4828871450529f878cf0/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:11.796487 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cec23-5bcc-4cd0-9e80-bc2916fd2ee0 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:11.800868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-4c2cec23-5bcc-4cd0-9e80-bc2916fd2ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:11.857764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e538293f-87a5-4ef7-81eb-57d102a23d39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a16d7284d2481d8a70d5c298a832e7'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:11.865109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e538293f-87a5-4ef7-81eb-57d102a23d39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a16d7284d2481d8a70d5c298a832e7'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:11.883128 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e538293f-87a5-4ef7-81eb-57d102a23d39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a16d7284d2481d8a70d5c298a832e7'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:11.904980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e538293f-87a5-4ef7-81eb-57d102a23d39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a16d7284d2481d8a70d5c298a832e7'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:11.914846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e538293f-87a5-4ef7-81eb-57d102a23d39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a16d7284d2481d8a70d5c298a832e7'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:11.928060 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 827/1664] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:11 2022] DELETE /identity/v3/users/34a16d7284d2481d8a70d5c298a832e7 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:11.929461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538293f-87a5-4ef7-81eb-57d102a23d39 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:11.933566 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e538293f-87a5-4ef7-81eb-57d102a23d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:12.055150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cec23-5bcc-4cd0-9e80-bc2916fd2ee0 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:12.142055 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b57ce-69df-41a6-b9fb-37650f59e248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:12.143001 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b57ce-69df-41a6-b9fb-37650f59e248 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:12.143643 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b57ce-69df-41a6-b9fb-37650f59e248 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:12.143984 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b57ce-69df-41a6-b9fb-37650f59e248 admin admin] PATH_INFO: `/v3/projects/c927f4f0798242448da4f1d06f70330d/users/35cb5db1043344b6a2847a9fb0bfa707/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:12.146293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b57ce-69df-41a6-b9fb-37650f59e248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c927f4f0798242448da4f1d06f70330d, user_id=35cb5db1043344b6a2847a9fb0bfa707, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:12.149313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b57ce-69df-41a6-b9fb-37650f59e248 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:12.163945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 838/1665] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:11 2022] PUT /identity/v3/projects/c927f4f0798242448da4f1d06f70330d/users/35cb5db1043344b6a2847a9fb0bfa707/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:12.275774 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538293f-87a5-4ef7-81eb-57d102a23d39 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:12.400692 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:12.463220 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48565ca1-d5ef-4ac3-93b0-76c984ca4cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:12.463846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48565ca1-d5ef-4ac3-93b0-76c984ca4cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:12.464380 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48565ca1-d5ef-4ac3-93b0-76c984ca4cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:12.464380 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48565ca1-d5ef-4ac3-93b0-76c984ca4cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:12.465038 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48565ca1-d5ef-4ac3-93b0-76c984ca4cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:12.467536 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48565ca1-d5ef-4ac3-93b0-76c984ca4cd3 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:12.488943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 828/1666] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 560 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:12.493734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b57ce-69df-41a6-b9fb-37650f59e248 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:12.513778 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b57ce-69df-41a6-b9fb-37650f59e248 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:12.528632 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e5ecd-5822-4071-8eee-97434472cda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:12.530930 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e5ecd-5822-4071-8eee-97434472cda8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:12.532794 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e5ecd-5822-4071-8eee-97434472cda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:12.533209 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e5ecd-5822-4071-8eee-97434472cda8 admin admin] PATH_INFO: `/v3/projects/f3e6d0587b2648fcb9d59ea0e28da9f5/users/65a40a0dc16a4828871450529f878cf0/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:12.538557 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e5ecd-5822-4071-8eee-97434472cda8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e6d0587b2648fcb9d59ea0e28da9f5, user_id=65a40a0dc16a4828871450529f878cf0, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:12.546944 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e5ecd-5822-4071-8eee-97434472cda8 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:12.584563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 839/1667] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:12 2022] PUT /identity/v3/projects/f3e6d0587b2648fcb9d59ea0e28da9f5/users/65a40a0dc16a4828871450529f878cf0/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:12.596643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccade2-cce8-46a0-8e9a-3bc7f66b8c8f None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:12.597494 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccade2-cce8-46a0-8e9a-3bc7f66b8c8f None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:12.597954 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccade2-cce8-46a0-8e9a-3bc7f66b8c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:12.680097 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-83ccade2-cce8-46a0-8e9a-3bc7f66b8c8f None None] MFA Rules not processed for user `65a40a0dc16a4828871450529f878cf0`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:12.682706 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-83ccade2-cce8-46a0-8e9a-3bc7f66b8c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:12.966189 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 829/1668] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:12.981452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e5ecd-5822-4071-8eee-97434472cda8 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:12.983817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-393e5ecd-5822-4071-8eee-97434472cda8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:13.092470 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e5ecd-5822-4071-8eee-97434472cda8 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:13.096958 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239a9fe-5163-484e-879c-86b28922ad8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:13.099712 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239a9fe-5163-484e-879c-86b28922ad8f service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:13.100120 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239a9fe-5163-484e-879c-86b28922ad8f service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:13.100497 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239a9fe-5163-484e-879c-86b28922ad8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:13.105206 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-9239a9fe-5163-484e-879c-86b28922ad8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:13.150599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:13.227090 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239a9fe-5163-484e-879c-86b28922ad8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:13.231221 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239a9fe-5163-484e-879c-86b28922ad8f service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:13.259659 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 840/1669] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:13.623396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccade2-cce8-46a0-8e9a-3bc7f66b8c8f None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:13.626900 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-83ccade2-cce8-46a0-8e9a-3bc7f66b8c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:13.842385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccade2-cce8-46a0-8e9a-3bc7f66b8c8f None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:13.853453 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4f047-95c0-4531-8bbd-7899c90a4245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:13.854403 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4f047-95c0-4531-8bbd-7899c90a4245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:13.854690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4f047-95c0-4531-8bbd-7899c90a4245 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:13.854963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4f047-95c0-4531-8bbd-7899c90a4245 admin admin] PATH_INFO: `/v3/users/f3376c9a419d44da8046b536b3a06af0` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:13.856815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4f047-95c0-4531-8bbd-7899c90a4245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3376c9a419d44da8046b536b3a06af0)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:13.859212 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4f047-95c0-4531-8bbd-7899c90a4245 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:14.084430 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-22e4f047-95c0-4531-8bbd-7899c90a4245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3376c9a419d44da8046b536b3a06af0'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:14.085211 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-22e4f047-95c0-4531-8bbd-7899c90a4245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3376c9a419d44da8046b536b3a06af0'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:14.092995 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:14.121249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-22e4f047-95c0-4531-8bbd-7899c90a4245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3376c9a419d44da8046b536b3a06af0'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:14.145451 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-22e4f047-95c0-4531-8bbd-7899c90a4245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3376c9a419d44da8046b536b3a06af0'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:14.157856 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-22e4f047-95c0-4531-8bbd-7899c90a4245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3376c9a419d44da8046b536b3a06af0'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:14.170580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 830/1670] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:13 2022] DELETE /identity/v3/users/f3376c9a419d44da8046b536b3a06af0 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:14.172530 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64362071-f741-4d95-a455-16b867d0d227 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:14.173017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64362071-f741-4d95-a455-16b867d0d227 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:14.173122 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64362071-f741-4d95-a455-16b867d0d227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:14.237719 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-64362071-f741-4d95-a455-16b867d0d227 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:14.244534 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-64362071-f741-4d95-a455-16b867d0d227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:14.536656 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 841/1671] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:14.646505 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4f047-95c0-4531-8bbd-7899c90a4245 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:14.650092 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-22e4f047-95c0-4531-8bbd-7899c90a4245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:14.848594 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4f047-95c0-4531-8bbd-7899c90a4245 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:14.859869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e833e-83ff-4e04-ab37-3099851d7feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:14.860597 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e833e-83ff-4e04-ab37-3099851d7feb service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:14.860949 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e833e-83ff-4e04-ab37-3099851d7feb service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:14.861286 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e833e-83ff-4e04-ab37-3099851d7feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:14.889372 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e833e-83ff-4e04-ab37-3099851d7feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:14.892563 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e833e-83ff-4e04-ab37-3099851d7feb service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:14.907082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 831/1672] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:15.495695 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64362071-f741-4d95-a455-16b867d0d227 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:15.497817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-64362071-f741-4d95-a455-16b867d0d227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:15.540438 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64362071-f741-4d95-a455-16b867d0d227 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:15.566207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c08dd1-4c40-4091-a8cf-2ed508b5d80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:15.566935 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c08dd1-4c40-4091-a8cf-2ed508b5d80a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:15.567238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c08dd1-4c40-4091-a8cf-2ed508b5d80a admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:15.567502 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c08dd1-4c40-4091-a8cf-2ed508b5d80a admin admin] PATH_INFO: `/v3/projects/f2d09569980344be98f93f7f5a758ac8` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:15.576287 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c08dd1-4c40-4091-a8cf-2ed508b5d80a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2d09569980344be98f93f7f5a758ac8)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:15.579144 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c08dd1-4c40-4091-a8cf-2ed508b5d80a admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:15.828895 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-06c08dd1-4c40-4091-a8cf-2ed508b5d80a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2d09569980344be98f93f7f5a758ac8', 'request_id': 'req-06c08dd1-4c40-4091-a8cf-2ed508b5d80a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:15.876717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-06c08dd1-4c40-4091-a8cf-2ed508b5d80a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2d09569980344be98f93f7f5a758ac8', 'request_id': 'req-06c08dd1-4c40-4091-a8cf-2ed508b5d80a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:15.912222 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-06c08dd1-4c40-4091-a8cf-2ed508b5d80a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2d09569980344be98f93f7f5a758ac8', 'request_id': 'req-06c08dd1-4c40-4091-a8cf-2ed508b5d80a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:15.979377 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-06c08dd1-4c40-4091-a8cf-2ed508b5d80a admin admin] The token cache is being invalidate because project f2d09569980344be98f93f7f5a758ac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:15.979909 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-06c08dd1-4c40-4091-a8cf-2ed508b5d80a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:15.998810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-06c08dd1-4c40-4091-a8cf-2ed508b5d80a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:16.019145 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 842/1673] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:15 2022] DELETE /identity/v3/projects/f2d09569980344be98f93f7f5a758ac8 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:16.025520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bf511-cd8e-43c9-a9a2-f78ded7aa32b None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:16.026099 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bf511-cd8e-43c9-a9a2-f78ded7aa32b None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:16.026330 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bf511-cd8e-43c9-a9a2-f78ded7aa32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:16.068199 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-350bf511-cd8e-43c9-a9a2-f78ded7aa32b None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:16.070169 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-350bf511-cd8e-43c9-a9a2-f78ded7aa32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:16.301458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 832/1674] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:16.306340 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db2296-5faa-423a-97be-22fa87d59297 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:16.306724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db2296-5faa-423a-97be-22fa87d59297 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:16.307806 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db2296-5faa-423a-97be-22fa87d59297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:16.359646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-f8db2296-5faa-423a-97be-22fa87d59297 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:16.364341 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-f8db2296-5faa-423a-97be-22fa87d59297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:16.386881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 843/1675] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:16.388877 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bf511-cd8e-43c9-a9a2-f78ded7aa32b None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:16.404525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bf511-cd8e-43c9-a9a2-f78ded7aa32b None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:16.421952 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ec954-6810-4a50-93b0-b3b5cc021616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:16.422514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ec954-6810-4a50-93b0-b3b5cc021616 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:16.422799 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ec954-6810-4a50-93b0-b3b5cc021616 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:16.423076 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ec954-6810-4a50-93b0-b3b5cc021616 admin admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:16.424764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ec954-6810-4a50-93b0-b3b5cc021616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:16.425040 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ec954-6810-4a50-93b0-b3b5cc021616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:16.428751 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ec954-6810-4a50-93b0-b3b5cc021616 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:16.467357 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 833/1676] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:16.468717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db2296-5faa-423a-97be-22fa87d59297 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:16.484049 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db2296-5faa-423a-97be-22fa87d59297 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:16.504973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430458e-fd54-4445-bb9b-45f237c5743f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:16.505945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430458e-fd54-4445-bb9b-45f237c5743f admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:16.506308 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430458e-fd54-4445-bb9b-45f237c5743f admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:16.506661 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430458e-fd54-4445-bb9b-45f237c5743f admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:16.507402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430458e-fd54-4445-bb9b-45f237c5743f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:16.509498 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430458e-fd54-4445-bb9b-45f237c5743f admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:16.584801 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 844/1677] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:16 2022] POST /identity/v3/projects => generated 363 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:16.589998 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ec954-6810-4a50-93b0-b3b5cc021616 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:16.609700 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ec954-6810-4a50-93b0-b3b5cc021616 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:16.823436 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f4e0b-6e04-48d2-9991-da07527ff58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:16.824068 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f4e0b-6e04-48d2-9991-da07527ff58d admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:16.825142 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f4e0b-6e04-48d2-9991-da07527ff58d admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:16.825445 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f4e0b-6e04-48d2-9991-da07527ff58d admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:16.826434 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f4e0b-6e04-48d2-9991-da07527ff58d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:16.829497 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f4e0b-6e04-48d2-9991-da07527ff58d admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:16.849109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:16.875733 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 834/1678] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:16 2022] POST /identity/v3/users => generated 282 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:16.881369 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430458e-fd54-4445-bb9b-45f237c5743f admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:16.905046 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:16.931589 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430458e-fd54-4445-bb9b-45f237c5743f admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:16.947448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c16d9-e047-41eb-9382-c1d5f86584cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:16.948482 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c16d9-e047-41eb-9382-c1d5f86584cb admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:16.949163 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c16d9-e047-41eb-9382-c1d5f86584cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:16.949911 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c16d9-e047-41eb-9382-c1d5f86584cb admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:16.951524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c16d9-e047-41eb-9382-c1d5f86584cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:16.956666 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c16d9-e047-41eb-9382-c1d5f86584cb admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:16.977740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 845/1679] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:16.981719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f4e0b-6e04-48d2-9991-da07527ff58d admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:17.008160 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733597e-0d93-4981-8bea-399689d215e8 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:17.009782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733597e-0d93-4981-8bea-399689d215e8 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:17.010310 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733597e-0d93-4981-8bea-399689d215e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:17.015983 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f4e0b-6e04-48d2-9991-da07527ff58d admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:17.027419 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c0fb4-d5e0-415f-b8f1-171e58c1fd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:17.031529 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c0fb4-d5e0-415f-b8f1-171e58c1fd13 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:17.046630 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c0fb4-d5e0-415f-b8f1-171e58c1fd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:17.047725 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c0fb4-d5e0-415f-b8f1-171e58c1fd13 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:17.049466 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c0fb4-d5e0-415f-b8f1-171e58c1fd13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:17.052950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c0fb4-d5e0-415f-b8f1-171e58c1fd13 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:17.081314 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 835/1680] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:50:17.083316 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a39473-d06f-489a-82ff-4c00870a5b50 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:17.083824 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a39473-d06f-489a-82ff-4c00870a5b50 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:17.084364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a39473-d06f-489a-82ff-4c00870a5b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:17.113248 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-c733597e-0d93-4981-8bea-399689d215e8 None None] MFA Rules not processed for user `052e427fb0b84fe7b31705fbfb708533`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:17.119361 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-c733597e-0d93-4981-8bea-399689d215e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:17.129795 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-e1a39473-d06f-489a-82ff-4c00870a5b50 None None] MFA Rules not processed for user `35cb5db1043344b6a2847a9fb0bfa707`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:17.131543 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e1a39473-d06f-489a-82ff-4c00870a5b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:17.311049 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 836/1681] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:17 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:17.320436 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a39473-d06f-489a-82ff-4c00870a5b50 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:17.355685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 846/1682] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:17.371612 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a39473-d06f-489a-82ff-4c00870a5b50 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:17.387113 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733597e-0d93-4981-8bea-399689d215e8 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:17.389817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-c733597e-0d93-4981-8bea-399689d215e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:17.397160 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295304de-b773-4d71-a648-638d12a6e8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:17.398432 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295304de-b773-4d71-a648-638d12a6e8c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:17.398945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295304de-b773-4d71-a648-638d12a6e8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:17.399449 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295304de-b773-4d71-a648-638d12a6e8c4 admin admin] PATH_INFO: `/v3/projects/4c1d812ad1e14e38bed0ce6002793dde/users/78f9f0e68afe40709bca691ffff6ad5d/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:17.460991 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295304de-b773-4d71-a648-638d12a6e8c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1d812ad1e14e38bed0ce6002793dde, user_id=78f9f0e68afe40709bca691ffff6ad5d, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:17.466890 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295304de-b773-4d71-a648-638d12a6e8c4 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:17.505827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 837/1683] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:17 2022] PUT /identity/v3/projects/4c1d812ad1e14e38bed0ce6002793dde/users/78f9f0e68afe40709bca691ffff6ad5d/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:17.507098 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295304de-b773-4d71-a648-638d12a6e8c4 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:17.527171 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-295304de-b773-4d71-a648-638d12a6e8c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:17.668540 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733597e-0d93-4981-8bea-399689d215e8 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:17.676060 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295304de-b773-4d71-a648-638d12a6e8c4 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:17.688932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7363ac-ce83-415d-a062-0faba35097ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:17.690437 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7363ac-ce83-415d-a062-0faba35097ec service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:17.691202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7363ac-ce83-415d-a062-0faba35097ec service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:17.691489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7363ac-ce83-415d-a062-0faba35097ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:17.694692 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-cb7363ac-ce83-415d-a062-0faba35097ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:17.765054 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:17.779078 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f754ae-8392-4b91-b047-9b35f85e23ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:17.779893 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f754ae-8392-4b91-b047-9b35f85e23ed service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:17.782063 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f754ae-8392-4b91-b047-9b35f85e23ed service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:17.787737 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7363ac-ce83-415d-a062-0faba35097ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:17.788266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f754ae-8392-4b91-b047-9b35f85e23ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:17.790540 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7363ac-ce83-415d-a062-0faba35097ec service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:17.804178 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 838/1684] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:17.806702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56020cf0-1615-48c3-8d96-218d02a009fc None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:17.807216 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56020cf0-1615-48c3-8d96-218d02a009fc None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:17.807770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56020cf0-1615-48c3-8d96-218d02a009fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:17.836880 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:17.884662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-56020cf0-1615-48c3-8d96-218d02a009fc None None] MFA Rules not processed for user `78f9f0e68afe40709bca691ffff6ad5d`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:17.885996 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-56020cf0-1615-48c3-8d96-218d02a009fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:18.022000 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f754ae-8392-4b91-b047-9b35f85e23ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:18.027775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f754ae-8392-4b91-b047-9b35f85e23ed service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:18.064042 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 847/1685] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:50:18.151622 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 839/1686] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:18.153260 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f754ae-8392-4b91-b047-9b35f85e23ed service nova] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:18.178021 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56020cf0-1615-48c3-8d96-218d02a009fc None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:18.179604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-56020cf0-1615-48c3-8d96-218d02a009fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:18.399896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56020cf0-1615-48c3-8d96-218d02a009fc None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:18.402261 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f754ae-8392-4b91-b047-9b35f85e23ed service nova] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:18.423452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8699801-8286-4be4-954b-58e2cc5e40d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:18.425755 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8699801-8286-4be4-954b-58e2cc5e40d1 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:18.427534 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8699801-8286-4be4-954b-58e2cc5e40d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:18.428419 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bc44b-2894-4e57-9126-7567f1ec904d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:18.428562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8699801-8286-4be4-954b-58e2cc5e40d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:18.429585 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bc44b-2894-4e57-9126-7567f1ec904d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:18.430192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bc44b-2894-4e57-9126-7567f1ec904d admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:18.430703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8699801-8286-4be4-954b-58e2cc5e40d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:18.430815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bc44b-2894-4e57-9126-7567f1ec904d admin admin] PATH_INFO: `/v3/projects/d73d1ed0d5b44b37948f2aeb18ed9237` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:18.436609 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8699801-8286-4be4-954b-58e2cc5e40d1 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:18.441345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bc44b-2894-4e57-9126-7567f1ec904d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d73d1ed0d5b44b37948f2aeb18ed9237)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:18.443916 dv-cinder-854264-1-smb devstack@keystone.service[93411]: WARNING py.warnings [None req-d95bc44b-2894-4e57-9126-7567f1ec904d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:50:18.443916 dv-cinder-854264-1-smb devstack@keystone.service[93411]: warnings.warn(msg) Aug 24 04:50:18.443916 dv-cinder-854264-1-smb devstack@keystone.service[93411]: Aug 24 04:50:18.451245 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bc44b-2894-4e57-9126-7567f1ec904d admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:18.526283 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 848/1687] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:18 2022] POST /identity/v3/projects => generated 365 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:50:18.529972 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8699801-8286-4be4-954b-58e2cc5e40d1 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:18.731832 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-d95bc44b-2894-4e57-9126-7567f1ec904d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd73d1ed0d5b44b37948f2aeb18ed9237', 'request_id': 'req-d95bc44b-2894-4e57-9126-7567f1ec904d'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:18.781550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-d95bc44b-2894-4e57-9126-7567f1ec904d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd73d1ed0d5b44b37948f2aeb18ed9237', 'request_id': 'req-d95bc44b-2894-4e57-9126-7567f1ec904d'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:18.803885 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-d95bc44b-2894-4e57-9126-7567f1ec904d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd73d1ed0d5b44b37948f2aeb18ed9237', 'request_id': 'req-d95bc44b-2894-4e57-9126-7567f1ec904d'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:18.827303 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8699801-8286-4be4-954b-58e2cc5e40d1 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:18.884435 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-d95bc44b-2894-4e57-9126-7567f1ec904d admin admin] The token cache is being invalidate because project d73d1ed0d5b44b37948f2aeb18ed9237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:18.885306 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-d95bc44b-2894-4e57-9126-7567f1ec904d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:18.888935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-d95bc44b-2894-4e57-9126-7567f1ec904d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:18.896183 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 840/1688] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:18 2022] DELETE /identity/v3/projects/d73d1ed0d5b44b37948f2aeb18ed9237 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:18.901965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040aff7-c409-4f0a-8d3e-7bd751044363 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:18.902591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040aff7-c409-4f0a-8d3e-7bd751044363 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:18.904717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040aff7-c409-4f0a-8d3e-7bd751044363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:18.962333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-e040aff7-c409-4f0a-8d3e-7bd751044363 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:18.964248 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e040aff7-c409-4f0a-8d3e-7bd751044363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:18.972212 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:18.993686 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:19.025182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515e32a-454b-479b-ba5d-fa94367a444a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:19.026412 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515e32a-454b-479b-ba5d-fa94367a444a admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:19.026936 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515e32a-454b-479b-ba5d-fa94367a444a admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:19.027564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515e32a-454b-479b-ba5d-fa94367a444a admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:19.028600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515e32a-454b-479b-ba5d-fa94367a444a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:19.033003 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515e32a-454b-479b-ba5d-fa94367a444a admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:19.084885 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 849/1689] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:18 2022] POST /identity/v3/users => generated 289 bytes in 556 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:19.091152 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515e32a-454b-479b-ba5d-fa94367a444a admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:19.096619 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-c515e32a-454b-479b-ba5d-fa94367a444a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:19.108093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 841/1690] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:19.117200 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256055b4-8fd0-42a6-8918-8c87dd881148 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:19.117591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256055b4-8fd0-42a6-8918-8c87dd881148 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:19.117819 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256055b4-8fd0-42a6-8918-8c87dd881148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:19.130228 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515e32a-454b-479b-ba5d-fa94367a444a admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:19.146225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bd381-5581-4f2a-a015-1b12ae665623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:19.147887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bd381-5581-4f2a-a015-1b12ae665623 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:19.148454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bd381-5581-4f2a-a015-1b12ae665623 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:19.148978 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bd381-5581-4f2a-a015-1b12ae665623 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:19.150476 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793bd381-5581-4f2a-a015-1b12ae665623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:19.154797 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793bd381-5581-4f2a-a015-1b12ae665623 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:19.161879 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-256055b4-8fd0-42a6-8918-8c87dd881148 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:19.163183 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-256055b4-8fd0-42a6-8918-8c87dd881148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:19.185087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 842/1691] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:19.189364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256055b4-8fd0-42a6-8918-8c87dd881148 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:19.193093 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 850/1692] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:50:19.199447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bd381-5581-4f2a-a015-1b12ae665623 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:19.207911 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256055b4-8fd0-42a6-8918-8c87dd881148 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:19.228811 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07040e7-f9d3-403b-aa91-57f7f753081c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:19.229487 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07040e7-f9d3-403b-aa91-57f7f753081c admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:19.229772 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07040e7-f9d3-403b-aa91-57f7f753081c admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:19.230110 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07040e7-f9d3-403b-aa91-57f7f753081c admin admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:19.230792 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07040e7-f9d3-403b-aa91-57f7f753081c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:19.231100 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07040e7-f9d3-403b-aa91-57f7f753081c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:19.232739 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bd381-5581-4f2a-a015-1b12ae665623 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:19.233573 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07040e7-f9d3-403b-aa91-57f7f753081c admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:19.263192 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb635f-e850-4d5a-b65f-d86fdc05b520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:19.264088 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb635f-e850-4d5a-b65f-d86fdc05b520 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:19.264683 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb635f-e850-4d5a-b65f-d86fdc05b520 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:19.265107 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb635f-e850-4d5a-b65f-d86fdc05b520 admin admin] PATH_INFO: `/v3/projects/0af17ff0a6f746c89044ad990809db96/users/2f4358c60fd04fb89778570c3209f5b8/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:19.269355 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 843/1693] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:50:19.273902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07040e7-f9d3-403b-aa91-57f7f753081c admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:19.290225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07040e7-f9d3-403b-aa91-57f7f753081c admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:19.305963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230368d-3b51-4982-ac85-aed566abc9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:19.306627 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230368d-3b51-4982-ac85-aed566abc9b7 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:19.306899 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230368d-3b51-4982-ac85-aed566abc9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:19.307184 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230368d-3b51-4982-ac85-aed566abc9b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:19.308685 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230368d-3b51-4982-ac85-aed566abc9b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:19.311444 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230368d-3b51-4982-ac85-aed566abc9b7 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:19.329256 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb635f-e850-4d5a-b65f-d86fdc05b520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af17ff0a6f746c89044ad990809db96, user_id=2f4358c60fd04fb89778570c3209f5b8, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:19.339443 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb635f-e850-4d5a-b65f-d86fdc05b520 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:19.384234 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 851/1694] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:19 2022] PUT /identity/v3/projects/0af17ff0a6f746c89044ad990809db96/users/2f4358c60fd04fb89778570c3209f5b8/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:19.384907 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 844/1695] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:19 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:50:19.389617 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230368d-3b51-4982-ac85-aed566abc9b7 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:19.389845 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb635f-e850-4d5a-b65f-d86fdc05b520 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:19.536250 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230368d-3b51-4982-ac85-aed566abc9b7 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:19.557521 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184209db-7543-4836-8a18-ac921fe1d4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:19.558175 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184209db-7543-4836-8a18-ac921fe1d4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:19.558464 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184209db-7543-4836-8a18-ac921fe1d4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:19.558772 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184209db-7543-4836-8a18-ac921fe1d4f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:19.559477 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184209db-7543-4836-8a18-ac921fe1d4f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:19.561217 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184209db-7543-4836-8a18-ac921fe1d4f2 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:19.585392 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 845/1696] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:19.594613 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184209db-7543-4836-8a18-ac921fe1d4f2 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:19.607986 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184209db-7543-4836-8a18-ac921fe1d4f2 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:19.631509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9da6b-15b9-49ac-8fd7-fdbe4ee1a81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:19.632231 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9da6b-15b9-49ac-8fd7-fdbe4ee1a81b admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:19.632519 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9da6b-15b9-49ac-8fd7-fdbe4ee1a81b admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:19.632836 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9da6b-15b9-49ac-8fd7-fdbe4ee1a81b admin admin] PATH_INFO: `/v3/projects/0af17ff0a6f746c89044ad990809db96/users/2f4358c60fd04fb89778570c3209f5b8/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:19.635030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb635f-e850-4d5a-b65f-d86fdc05b520 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:19.635685 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9da6b-15b9-49ac-8fd7-fdbe4ee1a81b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af17ff0a6f746c89044ad990809db96, user_id=2f4358c60fd04fb89778570c3209f5b8, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:19.638508 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9da6b-15b9-49ac-8fd7-fdbe4ee1a81b admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:19.650716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43102bad-30fb-4359-8118-e2bcf789a504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:19.651464 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43102bad-30fb-4359-8118-e2bcf789a504 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:19.651747 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43102bad-30fb-4359-8118-e2bcf789a504 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:19.652025 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43102bad-30fb-4359-8118-e2bcf789a504 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:19.654396 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43102bad-30fb-4359-8118-e2bcf789a504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:19.660851 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 846/1697] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:19 2022] PUT /identity/v3/projects/0af17ff0a6f746c89044ad990809db96/users/2f4358c60fd04fb89778570c3209f5b8/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:19.662853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43102bad-30fb-4359-8118-e2bcf789a504 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:19.673393 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d54eb-26ea-4ab3-b76a-f67eb72bea24 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:19.674269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d54eb-26ea-4ab3-b76a-f67eb72bea24 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:19.674625 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d54eb-26ea-4ab3-b76a-f67eb72bea24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:19.731578 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 852/1698] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:19 2022] POST /identity/v3/users => generated 283 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:19.735080 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43102bad-30fb-4359-8118-e2bcf789a504 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:19.762298 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43102bad-30fb-4359-8118-e2bcf789a504 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:19.786693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-6a2d54eb-26ea-4ab3-b76a-f67eb72bea24 None None] MFA Rules not processed for user `2f4358c60fd04fb89778570c3209f5b8`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:19.788282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-6a2d54eb-26ea-4ab3-b76a-f67eb72bea24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:19.852265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:19.905974 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 847/1699] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:19.915260 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d54eb-26ea-4ab3-b76a-f67eb72bea24 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:19.917259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-6a2d54eb-26ea-4ab3-b76a-f67eb72bea24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:19.984833 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188ca6d-eea8-46fd-8e87-9eb03af7760f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:19.985498 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188ca6d-eea8-46fd-8e87-9eb03af7760f admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:19.985785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188ca6d-eea8-46fd-8e87-9eb03af7760f admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:19.986736 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188ca6d-eea8-46fd-8e87-9eb03af7760f admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:19.987636 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188ca6d-eea8-46fd-8e87-9eb03af7760f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:19.991282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188ca6d-eea8-46fd-8e87-9eb03af7760f admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:20.028794 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 853/1700] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:20.030109 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188ca6d-eea8-46fd-8e87-9eb03af7760f admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:20.053955 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188ca6d-eea8-46fd-8e87-9eb03af7760f admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:20.065947 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d54eb-26ea-4ab3-b76a-f67eb72bea24 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:20.069185 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ca22c-1e7f-4890-8143-3bd49759c8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:20.069185 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ca22c-1e7f-4890-8143-3bd49759c8cc admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:20.069185 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ca22c-1e7f-4890-8143-3bd49759c8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:20.069185 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ca22c-1e7f-4890-8143-3bd49759c8cc admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:20.069608 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ca22c-1e7f-4890-8143-3bd49759c8cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:20.073638 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ca22c-1e7f-4890-8143-3bd49759c8cc admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:20.082644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb662c-2cf1-4ef9-919d-a10f45cec8d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:20.083120 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb662c-2cf1-4ef9-919d-a10f45cec8d0 service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:20.083483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb662c-2cf1-4ef9-919d-a10f45cec8d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:20.083839 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb662c-2cf1-4ef9-919d-a10f45cec8d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:20.108460 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb662c-2cf1-4ef9-919d-a10f45cec8d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:20.109043 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 854/1701] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:20.110058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ca22c-1e7f-4890-8143-3bd49759c8cc admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:20.110524 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb662c-2cf1-4ef9-919d-a10f45cec8d0 service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:20.138115 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ca22c-1e7f-4890-8143-3bd49759c8cc admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:20.139383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 848/1702] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:50:20.152664 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8736c7a-4c38-41b0-916b-62ec10c13ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:20.153494 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8736c7a-4c38-41b0-916b-62ec10c13ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:20.153781 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8736c7a-4c38-41b0-916b-62ec10c13ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:20.154058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8736c7a-4c38-41b0-916b-62ec10c13ecb admin admin] PATH_INFO: `/v3/projects/b600b5d919ba4388a9e264474e569139/users/27f5543e0ccd4f349c12dc5826c6beb8/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:20.193903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8736c7a-4c38-41b0-916b-62ec10c13ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b600b5d919ba4388a9e264474e569139, user_id=27f5543e0ccd4f349c12dc5826c6beb8, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:20.197365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8736c7a-4c38-41b0-916b-62ec10c13ecb admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:20.216710 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:20.247584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 855/1703] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:20 2022] PUT /identity/v3/projects/b600b5d919ba4388a9e264474e569139/users/27f5543e0ccd4f349c12dc5826c6beb8/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:20.261765 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d335b-10c5-4544-9d34-1689c93d2a6b None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:20.263587 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d335b-10c5-4544-9d34-1689c93d2a6b None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:20.264371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d335b-10c5-4544-9d34-1689c93d2a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:20.378963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-2f1d335b-10c5-4544-9d34-1689c93d2a6b None None] MFA Rules not processed for user `27f5543e0ccd4f349c12dc5826c6beb8`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:20.384927 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-2f1d335b-10c5-4544-9d34-1689c93d2a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:20.405572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8736c7a-4c38-41b0-916b-62ec10c13ecb admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:20.653771 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8736c7a-4c38-41b0-916b-62ec10c13ecb admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:20.657761 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 849/1704] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:20.662821 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d335b-10c5-4544-9d34-1689c93d2a6b None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:20.674020 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5f35b-2dff-40c8-84f0-1b1103ddf850 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:20.676893 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5f35b-2dff-40c8-84f0-1b1103ddf850 service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:20.677428 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5f35b-2dff-40c8-84f0-1b1103ddf850 service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:20.692441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5f35b-2dff-40c8-84f0-1b1103ddf850 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:20.702942 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-7aa5f35b-2dff-40c8-84f0-1b1103ddf850 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:20.804294 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5f35b-2dff-40c8-84f0-1b1103ddf850 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:20.805972 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5f35b-2dff-40c8-84f0-1b1103ddf850 service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:20.808877 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d335b-10c5-4544-9d34-1689c93d2a6b None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:20.832744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc52d4-088f-4b43-92d7-69c1ed831440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:20.833644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc52d4-088f-4b43-92d7-69c1ed831440 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:20.834216 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc52d4-088f-4b43-92d7-69c1ed831440 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:20.834712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc52d4-088f-4b43-92d7-69c1ed831440 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:20.835559 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc52d4-088f-4b43-92d7-69c1ed831440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:20.836606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 856/1705] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:20.838858 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc52d4-088f-4b43-92d7-69c1ed831440 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:20.843217 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87366c72-50b4-47fa-ba82-9bf1039393c8 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:20.843816 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87366c72-50b4-47fa-ba82-9bf1039393c8 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:20.844233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87366c72-50b4-47fa-ba82-9bf1039393c8 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:20.854546 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 857/1706] 10.222.0.94 () {54 vars in 921 bytes} [Wed Aug 24 04:50:20 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:50:20.860111 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:20.886417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 850/1707] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:20 2022] POST /identity/v3/projects => generated 363 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:20.888195 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87366c72-50b4-47fa-ba82-9bf1039393c8 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:20.926232 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdb989-cd3d-4d73-b2c6-0fc5a45d480e None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:20.927275 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdb989-cd3d-4d73-b2c6-0fc5a45d480e None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:20.928660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdb989-cd3d-4d73-b2c6-0fc5a45d480e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:20.967788 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-25cdb989-cd3d-4d73-b2c6-0fc5a45d480e None None] MFA Rules not processed for user `3a3274d404cb403bbf272ce023aa5e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:20.969724 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-25cdb989-cd3d-4d73-b2c6-0fc5a45d480e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:21.099846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 851/1708] 10.222.0.94 () {58 vars in 1018 bytes} [Wed Aug 24 04:50:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:21.112340 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87366c72-50b4-47fa-ba82-9bf1039393c8 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:21.121183 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c63acf-e058-40d5-936b-de7297bffcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:21.122605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c63acf-e058-40d5-936b-de7297bffcf1 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:21.123523 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c63acf-e058-40d5-936b-de7297bffcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:21.124068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c63acf-e058-40d5-936b-de7297bffcf1 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:21.125145 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c63acf-e058-40d5-936b-de7297bffcf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:21.128878 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c63acf-e058-40d5-936b-de7297bffcf1 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:21.170570 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27de50-9d65-427e-9b3e-e11c480675e3 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:21.171655 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27de50-9d65-427e-9b3e-e11c480675e3 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:21.171655 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27de50-9d65-427e-9b3e-e11c480675e3 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:21.173761 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 852/1709] 10.222.0.94 () {54 vars in 961 bytes} [Wed Aug 24 04:50:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:50:21.193578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59200f7-3e3f-40b9-a139-199a979e7afd None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:21.193991 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59200f7-3e3f-40b9-a139-199a979e7afd None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:21.194623 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59200f7-3e3f-40b9-a139-199a979e7afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:21.209331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 858/1710] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:20 2022] POST /identity/v3/users => generated 288 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:50:21.217138 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c63acf-e058-40d5-936b-de7297bffcf1 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:21.246800 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c63acf-e058-40d5-936b-de7297bffcf1 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:21.247771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-e59200f7-3e3f-40b9-a139-199a979e7afd None None] MFA Rules not processed for user `3a3274d404cb403bbf272ce023aa5e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:21.250551 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e59200f7-3e3f-40b9-a139-199a979e7afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:21.257846 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ef889-2e26-4f9a-b185-080048cf09f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:21.258989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ef889-2e26-4f9a-b185-080048cf09f7 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:21.259486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ef889-2e26-4f9a-b185-080048cf09f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:21.260026 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ef889-2e26-4f9a-b185-080048cf09f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:21.261271 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ef889-2e26-4f9a-b185-080048cf09f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:21.265222 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ef889-2e26-4f9a-b185-080048cf09f7 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:21.277862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 853/1711] 10.222.0.94 () {58 vars in 1058 bytes} [Wed Aug 24 04:50:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:21.284025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59200f7-3e3f-40b9-a139-199a979e7afd None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:21.292982 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 859/1712] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:50:21.298335 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ef889-2e26-4f9a-b185-080048cf09f7 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:21.311288 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59200f7-3e3f-40b9-a139-199a979e7afd None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:21.318282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19135f5b-d315-4fe3-a4b0-ec710d08cc69 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3274d404cb403bbf272ce023aa5e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:21.319325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19135f5b-d315-4fe3-a4b0-ec710d08cc69 service placement] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:21.320472 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19135f5b-d315-4fe3-a4b0-ec710d08cc69 service placement] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:21.320972 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19135f5b-d315-4fe3-a4b0-ec710d08cc69 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:21.337308 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ef889-2e26-4f9a-b185-080048cf09f7 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:21.355568 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19135f5b-d315-4fe3-a4b0-ec710d08cc69 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:21.365154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19135f5b-d315-4fe3-a4b0-ec710d08cc69 service placement] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:21.379559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdc7f2-e8a8-45a0-a5fd-63a4211bdcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:21.380859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdc7f2-e8a8-45a0-a5fd-63a4211bdcd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:21.381354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdc7f2-e8a8-45a0-a5fd-63a4211bdcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:21.381881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdc7f2-e8a8-45a0-a5fd-63a4211bdcd9 admin admin] PATH_INFO: `/v3/projects/37f4a5581312475c9208aa7561d2e20d/users/c8790d57b67a4d77bf30e565aab331f5/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:21.399053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 854/1713] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:21.444945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdc7f2-e8a8-45a0-a5fd-63a4211bdcd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f4a5581312475c9208aa7561d2e20d, user_id=c8790d57b67a4d77bf30e565aab331f5, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:21.449652 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdc7f2-e8a8-45a0-a5fd-63a4211bdcd9 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:21.490904 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 860/1714] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:21 2022] PUT /identity/v3/projects/37f4a5581312475c9208aa7561d2e20d/users/c8790d57b67a4d77bf30e565aab331f5/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:21.495034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19135f5b-d315-4fe3-a4b0-ec710d08cc69 service placement] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:21.519814 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19135f5b-d315-4fe3-a4b0-ec710d08cc69 service placement] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:21.669326 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6545736-a437-47a1-bd6b-3357b89fefb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:21.670283 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6545736-a437-47a1-bd6b-3357b89fefb5 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:21.671071 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6545736-a437-47a1-bd6b-3357b89fefb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:21.671982 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6545736-a437-47a1-bd6b-3357b89fefb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:21.672444 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6545736-a437-47a1-bd6b-3357b89fefb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:21.692156 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6545736-a437-47a1-bd6b-3357b89fefb5 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:21.729271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 855/1715] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:21.732560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdc7f2-e8a8-45a0-a5fd-63a4211bdcd9 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:21.750404 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:21.772883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdc7f2-e8a8-45a0-a5fd-63a4211bdcd9 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:21.798072 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89548aed-c75c-4d85-a92b-da7312254db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:21.799398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89548aed-c75c-4d85-a92b-da7312254db9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:21.800175 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89548aed-c75c-4d85-a92b-da7312254db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:21.800746 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89548aed-c75c-4d85-a92b-da7312254db9 admin admin] PATH_INFO: `/v3/projects/37f4a5581312475c9208aa7561d2e20d/users/c8790d57b67a4d77bf30e565aab331f5/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:21.810448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89548aed-c75c-4d85-a92b-da7312254db9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f4a5581312475c9208aa7561d2e20d, user_id=c8790d57b67a4d77bf30e565aab331f5, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:21.832787 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89548aed-c75c-4d85-a92b-da7312254db9 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:21.880893 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 861/1716] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:21 2022] PUT /identity/v3/projects/37f4a5581312475c9208aa7561d2e20d/users/c8790d57b67a4d77bf30e565aab331f5/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:21.893881 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e54ce9-0fc6-4bdb-bbcc-22dc0c5501ac None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:21.895230 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e54ce9-0fc6-4bdb-bbcc-22dc0c5501ac None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:21.895715 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e54ce9-0fc6-4bdb-bbcc-22dc0c5501ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:22.052916 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-c0e54ce9-0fc6-4bdb-bbcc-22dc0c5501ac None None] MFA Rules not processed for user `c8790d57b67a4d77bf30e565aab331f5`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:22.059242 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-c0e54ce9-0fc6-4bdb-bbcc-22dc0c5501ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:22.494311 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:22.570339 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 856/1717] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 679 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:22.586341 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89548aed-c75c-4d85-a92b-da7312254db9 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:22.589276 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-89548aed-c75c-4d85-a92b-da7312254db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:22.777618 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89548aed-c75c-4d85-a92b-da7312254db9 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:22.793012 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466cc03-536d-4039-83b5-6b19e189f949 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:22.794456 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466cc03-536d-4039-83b5-6b19e189f949 service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:22.796076 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466cc03-536d-4039-83b5-6b19e189f949 service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:22.796442 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466cc03-536d-4039-83b5-6b19e189f949 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:22.856832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466cc03-536d-4039-83b5-6b19e189f949 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:22.864158 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466cc03-536d-4039-83b5-6b19e189f949 service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:22.913884 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 862/1718] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:24.552987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e54ce9-0fc6-4bdb-bbcc-22dc0c5501ac None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:24.809208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e54ce9-0fc6-4bdb-bbcc-22dc0c5501ac None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:24.835950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2650b-ea2d-44ad-a375-9c4d4ccb2735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:24.840847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2650b-ea2d-44ad-a375-9c4d4ccb2735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:24.842003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2650b-ea2d-44ad-a375-9c4d4ccb2735 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:24.842865 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2650b-ea2d-44ad-a375-9c4d4ccb2735 admin admin] PATH_INFO: `/v3/users/27f5543e0ccd4f349c12dc5826c6beb8` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:24.850937 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2650b-ea2d-44ad-a375-9c4d4ccb2735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27f5543e0ccd4f349c12dc5826c6beb8)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:24.854606 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2650b-ea2d-44ad-a375-9c4d4ccb2735 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:25.011512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-83f2650b-ea2d-44ad-a375-9c4d4ccb2735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27f5543e0ccd4f349c12dc5826c6beb8'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.018439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-83f2650b-ea2d-44ad-a375-9c4d4ccb2735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27f5543e0ccd4f349c12dc5826c6beb8'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.044312 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-83f2650b-ea2d-44ad-a375-9c4d4ccb2735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27f5543e0ccd4f349c12dc5826c6beb8'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.086541 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-83f2650b-ea2d-44ad-a375-9c4d4ccb2735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27f5543e0ccd4f349c12dc5826c6beb8'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.087359 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88dd083-3502-40ed-8e82-483c9ac42d83 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:25.087878 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88dd083-3502-40ed-8e82-483c9ac42d83 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:25.087878 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88dd083-3502-40ed-8e82-483c9ac42d83 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:25.089722 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 863/1719] 10.222.0.94 () {54 vars in 921 bytes} [Wed Aug 24 04:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:50:25.117705 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-83f2650b-ea2d-44ad-a375-9c4d4ccb2735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27f5543e0ccd4f349c12dc5826c6beb8'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.132694 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec6e23-abd6-4866-8e30-8f4726cd2616 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:25.133246 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec6e23-abd6-4866-8e30-8f4726cd2616 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:25.133694 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec6e23-abd6-4866-8e30-8f4726cd2616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:25.144051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 857/1720] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:24 2022] DELETE /identity/v3/users/27f5543e0ccd4f349c12dc5826c6beb8 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:25.149197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a39a9-1c5e-4c51-971b-ba2c6c695f27 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:25.149666 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a39a9-1c5e-4c51-971b-ba2c6c695f27 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:25.150553 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a39a9-1c5e-4c51-971b-ba2c6c695f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:25.185144 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-aeec6e23-abd6-4866-8e30-8f4726cd2616 None None] MFA Rules not processed for user `3a3274d404cb403bbf272ce023aa5e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:25.188513 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-aeec6e23-abd6-4866-8e30-8f4726cd2616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:25.215770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-cc6a39a9-1c5e-4c51-971b-ba2c6c695f27 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:25.223341 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-cc6a39a9-1c5e-4c51-971b-ba2c6c695f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:25.442339 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 864/1721] 10.222.0.94 () {58 vars in 1018 bytes} [Wed Aug 24 04:50:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:25.444330 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec6e23-abd6-4866-8e30-8f4726cd2616 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:25.448358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-aeec6e23-abd6-4866-8e30-8f4726cd2616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:25.476300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 858/1722] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:25.479416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb4ca6-897d-454d-b2be-7c71bf91e457 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:25.479738 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb4ca6-897d-454d-b2be-7c71bf91e457 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:25.480151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb4ca6-897d-454d-b2be-7c71bf91e457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:25.541667 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-99cb4ca6-897d-454d-b2be-7c71bf91e457 None None] MFA Rules not processed for user `052e427fb0b84fe7b31705fbfb708533`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:25.548088 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-99cb4ca6-897d-454d-b2be-7c71bf91e457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:25.568410 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:25.723810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec6e23-abd6-4866-8e30-8f4726cd2616 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:25.738371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 859/1723] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:25.741205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb4ca6-897d-454d-b2be-7c71bf91e457 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:25.743926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-99cb4ca6-897d-454d-b2be-7c71bf91e457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:25.754618 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c6984-a8f9-4529-af19-a83561eb1cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:25.757952 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c6984-a8f9-4529-af19-a83561eb1cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:25.758804 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c6984-a8f9-4529-af19-a83561eb1cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:25.760695 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c6984-a8f9-4529-af19-a83561eb1cd7 admin admin] PATH_INFO: `/v3/users/78f9f0e68afe40709bca691ffff6ad5d` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:25.765262 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c6984-a8f9-4529-af19-a83561eb1cd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f9f0e68afe40709bca691ffff6ad5d)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:25.775414 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c6984-a8f9-4529-af19-a83561eb1cd7 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:25.813584 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb4ca6-897d-454d-b2be-7c71bf91e457 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:25.841720 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edcf26-2f74-4414-adc3-887e86359473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:25.842381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edcf26-2f74-4414-adc3-887e86359473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:25.842685 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edcf26-2f74-4414-adc3-887e86359473 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:25.843036 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edcf26-2f74-4414-adc3-887e86359473 admin admin] PATH_INFO: `/v3/users/c15e5cb5ed304733ba3dadad1a6a01a3` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:25.855755 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2edcf26-2f74-4414-adc3-887e86359473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c15e5cb5ed304733ba3dadad1a6a01a3)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:25.858872 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2edcf26-2f74-4414-adc3-887e86359473 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:25.958497 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:25.985324 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ff6c6984-a8f9-4529-af19-a83561eb1cd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f9f0e68afe40709bca691ffff6ad5d'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:26.012615 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ff6c6984-a8f9-4529-af19-a83561eb1cd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f9f0e68afe40709bca691ffff6ad5d'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:26.028404 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ff6c6984-a8f9-4529-af19-a83561eb1cd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f9f0e68afe40709bca691ffff6ad5d'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:26.030262 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ff6c6984-a8f9-4529-af19-a83561eb1cd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f9f0e68afe40709bca691ffff6ad5d'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:26.094280 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ff6c6984-a8f9-4529-af19-a83561eb1cd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f9f0e68afe40709bca691ffff6ad5d'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:26.123702 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 865/1724] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:25 2022] DELETE /identity/v3/users/78f9f0e68afe40709bca691ffff6ad5d => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:26.125453 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c6984-a8f9-4529-af19-a83561eb1cd7 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:26.130560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a2edcf26-2f74-4414-adc3-887e86359473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c15e5cb5ed304733ba3dadad1a6a01a3'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:26.131739 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a2edcf26-2f74-4414-adc3-887e86359473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c15e5cb5ed304733ba3dadad1a6a01a3'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:26.132185 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ff6c6984-a8f9-4529-af19-a83561eb1cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:26.151050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a2edcf26-2f74-4414-adc3-887e86359473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c15e5cb5ed304733ba3dadad1a6a01a3'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:26.179763 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a2edcf26-2f74-4414-adc3-887e86359473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c15e5cb5ed304733ba3dadad1a6a01a3'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:26.205729 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a2edcf26-2f74-4414-adc3-887e86359473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c15e5cb5ed304733ba3dadad1a6a01a3'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:26.235367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 860/1725] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:25 2022] DELETE /identity/v3/users/c15e5cb5ed304733ba3dadad1a6a01a3 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:26.239402 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edcf26-2f74-4414-adc3-887e86359473 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:26.245681 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-a2edcf26-2f74-4414-adc3-887e86359473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:26.450300 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c6984-a8f9-4529-af19-a83561eb1cd7 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:26.454684 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edcf26-2f74-4414-adc3-887e86359473 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:26.464960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5bed94-ffa1-40b9-b640-1f7ba5076ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:26.467867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bed94-ffa1-40b9-b640-1f7ba5076ebc service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:26.468196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bed94-ffa1-40b9-b640-1f7ba5076ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:26.469670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bed94-ffa1-40b9-b640-1f7ba5076ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:26.477008 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-1a5bed94-ffa1-40b9-b640-1f7ba5076ebc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:26.601802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:26.641184 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5bed94-ffa1-40b9-b640-1f7ba5076ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:26.643160 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5bed94-ffa1-40b9-b640-1f7ba5076ebc service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:26.655716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da068b9-39dc-4a3c-a007-308eae8fc5e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3274d404cb403bbf272ce023aa5e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:26.659606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da068b9-39dc-4a3c-a007-308eae8fc5e9 service placement] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:26.660347 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da068b9-39dc-4a3c-a007-308eae8fc5e9 service placement] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:26.661215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da068b9-39dc-4a3c-a007-308eae8fc5e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:26.670985 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-4da068b9-39dc-4a3c-a007-308eae8fc5e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:26.672154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 861/1726] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:26.676455 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d70b2-2215-4bb4-a4fb-c0fdc9fdbffc None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:26.685171 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d70b2-2215-4bb4-a4fb-c0fdc9fdbffc None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:26.685171 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d70b2-2215-4bb4-a4fb-c0fdc9fdbffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:26.717293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da068b9-39dc-4a3c-a007-308eae8fc5e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:26.717293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da068b9-39dc-4a3c-a007-308eae8fc5e9 service placement] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:26.750069 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 866/1727] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:26.803801 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-f73d70b2-2215-4bb4-a4fb-c0fdc9fdbffc None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:26.807788 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-f73d70b2-2215-4bb4-a4fb-c0fdc9fdbffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:26.850901 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 862/1728] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:26.977938 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da068b9-39dc-4a3c-a007-308eae8fc5e9 service placement] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:27.012354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da068b9-39dc-4a3c-a007-308eae8fc5e9 service placement] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:27.022841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25207b-d38b-4e3c-b528-0984e505bfaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:27.024507 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25207b-d38b-4e3c-b528-0984e505bfaf service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:27.025574 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25207b-d38b-4e3c-b528-0984e505bfaf service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:27.025574 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25207b-d38b-4e3c-b528-0984e505bfaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:27.092815 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25207b-d38b-4e3c-b528-0984e505bfaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:27.111500 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25207b-d38b-4e3c-b528-0984e505bfaf service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:27.178549 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 867/1729] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:27.649880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d70b2-2215-4bb4-a4fb-c0fdc9fdbffc None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:27.652221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-f73d70b2-2215-4bb4-a4fb-c0fdc9fdbffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:27.722296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d70b2-2215-4bb4-a4fb-c0fdc9fdbffc None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:27.775001 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dced4e-f022-467a-ad51-cf0f7537432a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:27.776127 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dced4e-f022-467a-ad51-cf0f7537432a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:27.776598 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dced4e-f022-467a-ad51-cf0f7537432a admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:27.777338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dced4e-f022-467a-ad51-cf0f7537432a admin admin] PATH_INFO: `/v3/projects/9b7b6960f798444ab23de2a8866eec66` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:27.780140 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dced4e-f022-467a-ad51-cf0f7537432a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b7b6960f798444ab23de2a8866eec66)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:27.784982 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dced4e-f022-467a-ad51-cf0f7537432a admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:27.908825 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e5dced4e-f022-467a-ad51-cf0f7537432a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b7b6960f798444ab23de2a8866eec66', 'request_id': 'req-e5dced4e-f022-467a-ad51-cf0f7537432a'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:27.942732 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e5dced4e-f022-467a-ad51-cf0f7537432a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b7b6960f798444ab23de2a8866eec66', 'request_id': 'req-e5dced4e-f022-467a-ad51-cf0f7537432a'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:27.967133 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e5dced4e-f022-467a-ad51-cf0f7537432a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b7b6960f798444ab23de2a8866eec66', 'request_id': 'req-e5dced4e-f022-467a-ad51-cf0f7537432a'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:28.010149 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e5dced4e-f022-467a-ad51-cf0f7537432a admin admin] The token cache is being invalidate because project 9b7b6960f798444ab23de2a8866eec66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:28.011934 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e5dced4e-f022-467a-ad51-cf0f7537432a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:28.014847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e5dced4e-f022-467a-ad51-cf0f7537432a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:28.019819 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 863/1730] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:27 2022] DELETE /identity/v3/projects/9b7b6960f798444ab23de2a8866eec66 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:28.025143 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25207b-d38b-4e3c-b528-0984e505bfaf service neutron] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:28.063688 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25207b-d38b-4e3c-b528-0984e505bfaf service neutron] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:28.226080 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c7407-7605-47b3-b590-adfa6baa7350 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:28.228529 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c7407-7605-47b3-b590-adfa6baa7350 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:28.229080 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c7407-7605-47b3-b590-adfa6baa7350 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:28.232491 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 864/1731] 10.222.0.94 () {54 vars in 912 bytes} [Wed Aug 24 04:50:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:50:28.242190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1817bf2-a72f-4bfe-b1fa-5c6502122235 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:28.243060 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1817bf2-a72f-4bfe-b1fa-5c6502122235 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:28.244002 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1817bf2-a72f-4bfe-b1fa-5c6502122235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:28.245051 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:28.386197 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb86f04-9252-4512-82db-7469cf803e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:28.386880 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb86f04-9252-4512-82db-7469cf803e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:28.389012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-b1817bf2-a72f-4bfe-b1fa-5c6502122235 None None] MFA Rules not processed for user `0742c7ecf68d40a38c8947a05eee2797`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:28.393795 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb86f04-9252-4512-82db-7469cf803e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:28.394110 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb86f04-9252-4512-82db-7469cf803e10 admin admin] PATH_INFO: `/v3/users/35cb5db1043344b6a2847a9fb0bfa707` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:28.397070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-b1817bf2-a72f-4bfe-b1fa-5c6502122235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:28.399291 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb86f04-9252-4512-82db-7469cf803e10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35cb5db1043344b6a2847a9fb0bfa707)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:28.411683 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb86f04-9252-4512-82db-7469cf803e10 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:28.613878 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-fbb86f04-9252-4512-82db-7469cf803e10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35cb5db1043344b6a2847a9fb0bfa707'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:28.637604 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-fbb86f04-9252-4512-82db-7469cf803e10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35cb5db1043344b6a2847a9fb0bfa707'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:28.661671 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 865/1732] 10.222.0.94 () {58 vars in 1009 bytes} [Wed Aug 24 04:50:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 24 04:50:28.688117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-fbb86f04-9252-4512-82db-7469cf803e10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35cb5db1043344b6a2847a9fb0bfa707'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:28.691069 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-fbb86f04-9252-4512-82db-7469cf803e10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35cb5db1043344b6a2847a9fb0bfa707'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:28.703914 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1817bf2-a72f-4bfe-b1fa-5c6502122235 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:28.707070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-b1817bf2-a72f-4bfe-b1fa-5c6502122235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:28.728291 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1817bf2-a72f-4bfe-b1fa-5c6502122235 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:28.740879 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-fbb86f04-9252-4512-82db-7469cf803e10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35cb5db1043344b6a2847a9fb0bfa707'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:28.752894 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e305b0-07d1-491f-b623-9408797a0f4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:28.753580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e305b0-07d1-491f-b623-9408797a0f4e service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:28.753869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e305b0-07d1-491f-b623-9408797a0f4e service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:28.754146 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e305b0-07d1-491f-b623-9408797a0f4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:28.758859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 868/1733] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:28 2022] DELETE /identity/v3/users/35cb5db1043344b6a2847a9fb0bfa707 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:28.759441 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-a4e305b0-07d1-491f-b623-9408797a0f4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:28.790510 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e305b0-07d1-491f-b623-9408797a0f4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:28.792020 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e305b0-07d1-491f-b623-9408797a0f4e service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:28.821360 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 866/1734] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:50:29.198262 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb86f04-9252-4512-82db-7469cf803e10 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:29.200558 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-fbb86f04-9252-4512-82db-7469cf803e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:29.426042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e305b0-07d1-491f-b623-9408797a0f4e service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:29.429121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-a4e305b0-07d1-491f-b623-9408797a0f4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:29.453092 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e305b0-07d1-491f-b623-9408797a0f4e service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:29.482795 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb86f04-9252-4512-82db-7469cf803e10 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:29.489262 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d6b91-21eb-4294-aa75-2eef74dd270a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:29.490114 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d6b91-21eb-4294-aa75-2eef74dd270a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:29.490513 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d6b91-21eb-4294-aa75-2eef74dd270a admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:29.490780 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d6b91-21eb-4294-aa75-2eef74dd270a admin admin] PATH_INFO: `/v3/projects/b600b5d919ba4388a9e264474e569139` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:29.492358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d6b91-21eb-4294-aa75-2eef74dd270a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b600b5d919ba4388a9e264474e569139)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:29.495160 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d6b91-21eb-4294-aa75-2eef74dd270a admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:29.558821 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:29.623889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb1e61-56fa-4496-a5fb-873e1f80ab40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:29.626312 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb1e61-56fa-4496-a5fb-873e1f80ab40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:29.626652 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb1e61-56fa-4496-a5fb-873e1f80ab40 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:29.626930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb1e61-56fa-4496-a5fb-873e1f80ab40 admin admin] PATH_INFO: `/v3/projects/4c1d812ad1e14e38bed0ce6002793dde` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:29.629961 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb1e61-56fa-4496-a5fb-873e1f80ab40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c1d812ad1e14e38bed0ce6002793dde)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:29.631983 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb1e61-56fa-4496-a5fb-873e1f80ab40 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:29.638547 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-338d6b91-21eb-4294-aa75-2eef74dd270a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b600b5d919ba4388a9e264474e569139', 'request_id': 'req-338d6b91-21eb-4294-aa75-2eef74dd270a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:29.640455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:29.658396 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-338d6b91-21eb-4294-aa75-2eef74dd270a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b600b5d919ba4388a9e264474e569139', 'request_id': 'req-338d6b91-21eb-4294-aa75-2eef74dd270a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:29.675975 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-338d6b91-21eb-4294-aa75-2eef74dd270a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b600b5d919ba4388a9e264474e569139', 'request_id': 'req-338d6b91-21eb-4294-aa75-2eef74dd270a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:29.712457 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-338d6b91-21eb-4294-aa75-2eef74dd270a admin admin] The token cache is being invalidate because project b600b5d919ba4388a9e264474e569139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:29.712732 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-338d6b91-21eb-4294-aa75-2eef74dd270a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:29.714064 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-338d6b91-21eb-4294-aa75-2eef74dd270a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:29.722178 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 869/1735] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:29 2022] DELETE /identity/v3/projects/b600b5d919ba4388a9e264474e569139 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:29.723967 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d6b91-21eb-4294-aa75-2eef74dd270a admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:29.729597 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-338d6b91-21eb-4294-aa75-2eef74dd270a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:29.784033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-3afb1e61-56fa-4496-a5fb-873e1f80ab40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c1d812ad1e14e38bed0ce6002793dde', 'request_id': 'req-3afb1e61-56fa-4496-a5fb-873e1f80ab40'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:29.799851 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-3afb1e61-56fa-4496-a5fb-873e1f80ab40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c1d812ad1e14e38bed0ce6002793dde', 'request_id': 'req-3afb1e61-56fa-4496-a5fb-873e1f80ab40'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:29.813578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-3afb1e61-56fa-4496-a5fb-873e1f80ab40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c1d812ad1e14e38bed0ce6002793dde', 'request_id': 'req-3afb1e61-56fa-4496-a5fb-873e1f80ab40'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:29.837113 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-3afb1e61-56fa-4496-a5fb-873e1f80ab40 admin admin] The token cache is being invalidate because project 4c1d812ad1e14e38bed0ce6002793dde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:29.837783 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-3afb1e61-56fa-4496-a5fb-873e1f80ab40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:29.844157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-3afb1e61-56fa-4496-a5fb-873e1f80ab40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:29.852665 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 867/1736] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:29 2022] DELETE /identity/v3/projects/4c1d812ad1e14e38bed0ce6002793dde => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:29.856374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb1e61-56fa-4496-a5fb-873e1f80ab40 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:29.858270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-3afb1e61-56fa-4496-a5fb-873e1f80ab40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:29.903623 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d6b91-21eb-4294-aa75-2eef74dd270a admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:30.015148 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb1e61-56fa-4496-a5fb-873e1f80ab40 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:30.043206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fe845-3947-4a40-bbf0-01fc21d56930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:30.044996 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fe845-3947-4a40-bbf0-01fc21d56930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:30.045885 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fe845-3947-4a40-bbf0-01fc21d56930 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:30.046756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fe845-3947-4a40-bbf0-01fc21d56930 admin admin] PATH_INFO: `/v3/users/2f4358c60fd04fb89778570c3209f5b8` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:30.051022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6fe845-3947-4a40-bbf0-01fc21d56930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f4358c60fd04fb89778570c3209f5b8)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:30.055391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6fe845-3947-4a40-bbf0-01fc21d56930 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:30.066674 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedf92a-382d-4646-b88c-0b31e19c5eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:30.067344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedf92a-382d-4646-b88c-0b31e19c5eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:30.067863 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedf92a-382d-4646-b88c-0b31e19c5eda admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:30.068151 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedf92a-382d-4646-b88c-0b31e19c5eda admin admin] PATH_INFO: `/v3/users/c8790d57b67a4d77bf30e565aab331f5` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:30.070565 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedf92a-382d-4646-b88c-0b31e19c5eda admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8790d57b67a4d77bf30e565aab331f5)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:30.072746 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedf92a-382d-4646-b88c-0b31e19c5eda admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:30.173560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-5cedf92a-382d-4646-b88c-0b31e19c5eda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8790d57b67a4d77bf30e565aab331f5'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:30.199227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-5cedf92a-382d-4646-b88c-0b31e19c5eda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8790d57b67a4d77bf30e565aab331f5'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:30.221465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-5cedf92a-382d-4646-b88c-0b31e19c5eda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8790d57b67a4d77bf30e565aab331f5'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:30.223991 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-5cedf92a-382d-4646-b88c-0b31e19c5eda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8790d57b67a4d77bf30e565aab331f5'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:30.238648 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-df6fe845-3947-4a40-bbf0-01fc21d56930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f4358c60fd04fb89778570c3209f5b8'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:30.240613 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-df6fe845-3947-4a40-bbf0-01fc21d56930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f4358c60fd04fb89778570c3209f5b8'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:30.264297 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-df6fe845-3947-4a40-bbf0-01fc21d56930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f4358c60fd04fb89778570c3209f5b8'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:30.281443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:30.284406 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-df6fe845-3947-4a40-bbf0-01fc21d56930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f4358c60fd04fb89778570c3209f5b8'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:30.293986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-5cedf92a-382d-4646-b88c-0b31e19c5eda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8790d57b67a4d77bf30e565aab331f5'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:30.319132 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 870/1737] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:29 2022] DELETE /identity/v3/users/c8790d57b67a4d77bf30e565aab331f5 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:30.322036 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedf92a-382d-4646-b88c-0b31e19c5eda admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:30.322804 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-df6fe845-3947-4a40-bbf0-01fc21d56930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f4358c60fd04fb89778570c3209f5b8'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:30.328550 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-5cedf92a-382d-4646-b88c-0b31e19c5eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:30.331914 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 868/1738] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:29 2022] DELETE /identity/v3/users/2f4358c60fd04fb89778570c3209f5b8 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:30.349557 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:30.621512 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedf92a-382d-4646-b88c-0b31e19c5eda admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:30.642652 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fe845-3947-4a40-bbf0-01fc21d56930 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:30.646000 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-df6fe845-3947-4a40-bbf0-01fc21d56930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:30.913975 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305a25f-68d3-4767-a926-4564b52f8f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:30.915987 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305a25f-68d3-4767-a926-4564b52f8f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:30.916490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305a25f-68d3-4767-a926-4564b52f8f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:30.916989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305a25f-68d3-4767-a926-4564b52f8f9a admin admin] PATH_INFO: `/v3/projects/c927f4f0798242448da4f1d06f70330d` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:30.926617 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305a25f-68d3-4767-a926-4564b52f8f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c927f4f0798242448da4f1d06f70330d)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:30.936485 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305a25f-68d3-4767-a926-4564b52f8f9a admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:30.947320 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fe845-3947-4a40-bbf0-01fc21d56930 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:30.981233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2cba3-213b-4290-91c4-c7189ca117d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3274d404cb403bbf272ce023aa5e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:30.982635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2cba3-213b-4290-91c4-c7189ca117d3 service placement] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:30.983294 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2cba3-213b-4290-91c4-c7189ca117d3 service placement] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:30.984355 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2cba3-213b-4290-91c4-c7189ca117d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:30.994905 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-42a2cba3-213b-4290-91c4-c7189ca117d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:31.054499 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2cba3-213b-4290-91c4-c7189ca117d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:31.057556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2cba3-213b-4290-91c4-c7189ca117d3 service placement] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:31.123751 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 869/1739] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:31.238945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b305a25f-68d3-4767-a926-4564b52f8f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c927f4f0798242448da4f1d06f70330d', 'request_id': 'req-b305a25f-68d3-4767-a926-4564b52f8f9a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:31.270743 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b305a25f-68d3-4767-a926-4564b52f8f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c927f4f0798242448da4f1d06f70330d', 'request_id': 'req-b305a25f-68d3-4767-a926-4564b52f8f9a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:31.289655 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9545d-07f2-4fc8-ba59-e38475a02f3b None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:31.289988 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9545d-07f2-4fc8-ba59-e38475a02f3b None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:31.290226 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9545d-07f2-4fc8-ba59-e38475a02f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:31.316157 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b305a25f-68d3-4767-a926-4564b52f8f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c927f4f0798242448da4f1d06f70330d', 'request_id': 'req-b305a25f-68d3-4767-a926-4564b52f8f9a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:31.378339 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b305a25f-68d3-4767-a926-4564b52f8f9a admin admin] The token cache is being invalidate because project c927f4f0798242448da4f1d06f70330d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:31.378849 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b305a25f-68d3-4767-a926-4564b52f8f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:31.381488 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b305a25f-68d3-4767-a926-4564b52f8f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:31.383825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 871/1740] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:30 2022] DELETE /identity/v3/projects/c927f4f0798242448da4f1d06f70330d => generated 0 bytes in 1064 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:31.389205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e275a-e207-4b61-9d46-50708873ce20 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:31.389888 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e275a-e207-4b61-9d46-50708873ce20 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:31.390256 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e275a-e207-4b61-9d46-50708873ce20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:31.397288 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-78a9545d-07f2-4fc8-ba59-e38475a02f3b None None] MFA Rules not processed for user `cab4c264979e46a39cc0ddd2df8ee8df`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:31.401467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-78a9545d-07f2-4fc8-ba59-e38475a02f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:31.451340 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-5b6e275a-e207-4b61-9d46-50708873ce20 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:31.462058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-5b6e275a-e207-4b61-9d46-50708873ce20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:31.596927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:31.681564 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 870/1741] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:31.681564 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9545d-07f2-4fc8-ba59-e38475a02f3b None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:31.686277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-78a9545d-07f2-4fc8-ba59-e38475a02f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:31.723523 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 872/1742] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:31.724919 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e275a-e207-4b61-9d46-50708873ce20 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:31.728854 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-5b6e275a-e207-4b61-9d46-50708873ce20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:31.887332 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9545d-07f2-4fc8-ba59-e38475a02f3b None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:31.900767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49413caa-0bab-4fb7-91d4-86b52d933c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:31.901958 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49413caa-0bab-4fb7-91d4-86b52d933c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:31.903759 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49413caa-0bab-4fb7-91d4-86b52d933c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:31.904611 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49413caa-0bab-4fb7-91d4-86b52d933c93 admin admin] PATH_INFO: `/v3/projects/37f4a5581312475c9208aa7561d2e20d` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:31.909676 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49413caa-0bab-4fb7-91d4-86b52d933c93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37f4a5581312475c9208aa7561d2e20d)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:31.913033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49413caa-0bab-4fb7-91d4-86b52d933c93 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:31.924857 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:31.969027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e275a-e207-4b61-9d46-50708873ce20 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:31.984224 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a21458-6228-4cbb-ba95-ee698b2b561f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:31.986752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a21458-6228-4cbb-ba95-ee698b2b561f service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:32.001209 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a21458-6228-4cbb-ba95-ee698b2b561f service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:32.002559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a21458-6228-4cbb-ba95-ee698b2b561f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:32.030305 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a21458-6228-4cbb-ba95-ee698b2b561f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:32.035411 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a21458-6228-4cbb-ba95-ee698b2b561f service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:32.052601 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-49413caa-0bab-4fb7-91d4-86b52d933c93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37f4a5581312475c9208aa7561d2e20d', 'request_id': 'req-49413caa-0bab-4fb7-91d4-86b52d933c93'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:32.075698 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-49413caa-0bab-4fb7-91d4-86b52d933c93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37f4a5581312475c9208aa7561d2e20d', 'request_id': 'req-49413caa-0bab-4fb7-91d4-86b52d933c93'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:32.076731 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 873/1743] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:32.106956 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5d67e-ab51-4363-8e3f-33f98cdca746 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:32.111266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5d67e-ab51-4363-8e3f-33f98cdca746 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:32.124079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5d67e-ab51-4363-8e3f-33f98cdca746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:32.144172 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-49413caa-0bab-4fb7-91d4-86b52d933c93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37f4a5581312475c9208aa7561d2e20d', 'request_id': 'req-49413caa-0bab-4fb7-91d4-86b52d933c93'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:32.231558 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-49413caa-0bab-4fb7-91d4-86b52d933c93 admin admin] The token cache is being invalidate because project 37f4a5581312475c9208aa7561d2e20d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:32.238596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-49413caa-0bab-4fb7-91d4-86b52d933c93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:32.248838 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-49413caa-0bab-4fb7-91d4-86b52d933c93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:32.259667 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 871/1744] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:31 2022] DELETE /identity/v3/projects/37f4a5581312475c9208aa7561d2e20d => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:32.261323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1060d-a589-4ed3-99a9-dd70fbfb2b91 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:32.269773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1060d-a589-4ed3-99a9-dd70fbfb2b91 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:32.270159 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1060d-a589-4ed3-99a9-dd70fbfb2b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:32.278810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-e0c5d67e-ab51-4363-8e3f-33f98cdca746 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:32.282526 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-e0c5d67e-ab51-4363-8e3f-33f98cdca746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:32.383681 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-b3c1060d-a589-4ed3-99a9-dd70fbfb2b91 None None] MFA Rules not processed for user `a4493625af43482a88023a2aecd73b27`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:32.386392 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-b3c1060d-a589-4ed3-99a9-dd70fbfb2b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:32.564977 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 874/1745] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:32.573660 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069be77-4ef6-4393-84b1-5493804de201 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:32.575868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069be77-4ef6-4393-84b1-5493804de201 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:32.578077 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069be77-4ef6-4393-84b1-5493804de201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:32.668751 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 872/1746] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:32.670912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1060d-a589-4ed3-99a9-dd70fbfb2b91 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:32.701156 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1060d-a589-4ed3-99a9-dd70fbfb2b91 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:32.711582 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b83c8-b7ac-44c6-b712-231fc0001315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:32.712225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b83c8-b7ac-44c6-b712-231fc0001315 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:32.713809 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b83c8-b7ac-44c6-b712-231fc0001315 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:32.713809 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b83c8-b7ac-44c6-b712-231fc0001315 admin admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:32.715022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b83c8-b7ac-44c6-b712-231fc0001315 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:32.717643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b83c8-b7ac-44c6-b712-231fc0001315 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:32.721813 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b83c8-b7ac-44c6-b712-231fc0001315 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:32.734376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-e069be77-4ef6-4393-84b1-5493804de201 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:32.747276 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-e069be77-4ef6-4393-84b1-5493804de201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:32.780143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 873/1747] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:32.788454 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965765d6-9911-454d-b437-70294d30c8b7 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:32.789343 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965765d6-9911-454d-b437-70294d30c8b7 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:32.789905 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965765d6-9911-454d-b437-70294d30c8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:32.835101 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 875/1748] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:32.836092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069be77-4ef6-4393-84b1-5493804de201 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:32.884545 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-965765d6-9911-454d-b437-70294d30c8b7 None None] MFA Rules not processed for user `a4493625af43482a88023a2aecd73b27`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:32.889343 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069be77-4ef6-4393-84b1-5493804de201 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:32.889694 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-965765d6-9911-454d-b437-70294d30c8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:32.915987 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cac584-4408-43fb-99b4-7e1bcda10124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:32.917021 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cac584-4408-43fb-99b4-7e1bcda10124 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:32.917749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cac584-4408-43fb-99b4-7e1bcda10124 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:32.918241 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cac584-4408-43fb-99b4-7e1bcda10124 admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:32.919479 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cac584-4408-43fb-99b4-7e1bcda10124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:32.924843 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cac584-4408-43fb-99b4-7e1bcda10124 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:32.937708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 874/1749] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:32.939181 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2290d85-9736-4b5a-b6b4-7e1cd02367b6 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:32.940927 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2290d85-9736-4b5a-b6b4-7e1cd02367b6 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:32.940927 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2290d85-9736-4b5a-b6b4-7e1cd02367b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:33.039868 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-d2290d85-9736-4b5a-b6b4-7e1cd02367b6 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:33.041216 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-d2290d85-9736-4b5a-b6b4-7e1cd02367b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:33.080833 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 876/1750] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:32 2022] POST /identity/v3/projects => generated 373 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:33.084184 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cac584-4408-43fb-99b4-7e1bcda10124 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:33.087043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 875/1751] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:33.088008 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2290d85-9736-4b5a-b6b4-7e1cd02367b6 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:33.090772 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-d2290d85-9736-4b5a-b6b4-7e1cd02367b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:33.097952 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-f5cac584-4408-43fb-99b4-7e1bcda10124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:33.133825 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2290d85-9736-4b5a-b6b4-7e1cd02367b6 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:33.364667 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b222a66-f343-4b95-a187-6db77981f48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:33.365387 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b222a66-f343-4b95-a187-6db77981f48a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:33.365819 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b222a66-f343-4b95-a187-6db77981f48a admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:33.365994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b222a66-f343-4b95-a187-6db77981f48a admin admin] PATH_INFO: `/v3/projects/0af17ff0a6f746c89044ad990809db96` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:33.374389 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b222a66-f343-4b95-a187-6db77981f48a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0af17ff0a6f746c89044ad990809db96)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:33.377382 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b222a66-f343-4b95-a187-6db77981f48a admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:33.389583 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:33.424964 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:33.575500 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cac584-4408-43fb-99b4-7e1bcda10124 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:33.598226 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-7b222a66-f343-4b95-a187-6db77981f48a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0af17ff0a6f746c89044ad990809db96', 'request_id': 'req-7b222a66-f343-4b95-a187-6db77981f48a'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:33.620045 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-7b222a66-f343-4b95-a187-6db77981f48a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0af17ff0a6f746c89044ad990809db96', 'request_id': 'req-7b222a66-f343-4b95-a187-6db77981f48a'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:33.645753 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-7b222a66-f343-4b95-a187-6db77981f48a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0af17ff0a6f746c89044ad990809db96', 'request_id': 'req-7b222a66-f343-4b95-a187-6db77981f48a'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:33.686305 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-7b222a66-f343-4b95-a187-6db77981f48a admin admin] The token cache is being invalidate because project 0af17ff0a6f746c89044ad990809db96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:33.686857 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-7b222a66-f343-4b95-a187-6db77981f48a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:33.688722 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-7b222a66-f343-4b95-a187-6db77981f48a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:33.693478 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 876/1752] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:33 2022] DELETE /identity/v3/projects/0af17ff0a6f746c89044ad990809db96 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:33.694580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b222a66-f343-4b95-a187-6db77981f48a admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:33.710546 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-7b222a66-f343-4b95-a187-6db77981f48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:33.876664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b222a66-f343-4b95-a187-6db77981f48a admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:33.898411 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09a5f6-6b31-4a80-915e-9c177fbafc70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:33.899188 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09a5f6-6b31-4a80-915e-9c177fbafc70 service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:33.899499 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09a5f6-6b31-4a80-915e-9c177fbafc70 service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:33.899781 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09a5f6-6b31-4a80-915e-9c177fbafc70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:33.903504 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6d08b-127b-4b30-80f3-5a781d6b4246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:33.904547 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6d08b-127b-4b30-80f3-5a781d6b4246 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:33.904984 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6d08b-127b-4b30-80f3-5a781d6b4246 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:33.905498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6d08b-127b-4b30-80f3-5a781d6b4246 admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:33.906461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6d08b-127b-4b30-80f3-5a781d6b4246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:33.910751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-8b09a5f6-6b31-4a80-915e-9c177fbafc70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:33.911492 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6d08b-127b-4b30-80f3-5a781d6b4246 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:33.963654 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 877/1753] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:33 2022] POST /identity/v3/users => generated 287 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:33.966340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6d08b-127b-4b30-80f3-5a781d6b4246 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:33.979114 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-f2c6d08b-127b-4b30-80f3-5a781d6b4246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:34.005881 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6d08b-127b-4b30-80f3-5a781d6b4246 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:34.020762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a181e5-2ec0-45a7-a0a6-4bd2ed5a416f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:34.021983 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a181e5-2ec0-45a7-a0a6-4bd2ed5a416f admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:34.022439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a181e5-2ec0-45a7-a0a6-4bd2ed5a416f admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:34.022885 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a181e5-2ec0-45a7-a0a6-4bd2ed5a416f admin admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:34.023770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a181e5-2ec0-45a7-a0a6-4bd2ed5a416f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:34.024260 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a181e5-2ec0-45a7-a0a6-4bd2ed5a416f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:34.026237 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a181e5-2ec0-45a7-a0a6-4bd2ed5a416f admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:34.079527 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 878/1754] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:34.087463 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ab8e2-687b-4e89-90b7-7b7341824c85 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:34.088573 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ab8e2-687b-4e89-90b7-7b7341824c85 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:34.089523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ab8e2-687b-4e89-90b7-7b7341824c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:34.092234 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09a5f6-6b31-4a80-915e-9c177fbafc70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:34.093915 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09a5f6-6b31-4a80-915e-9c177fbafc70 service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:34.104625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 877/1755] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 1023 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:34.106736 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035abda-0595-4938-b939-a30b4270479c None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:34.107038 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035abda-0595-4938-b939-a30b4270479c None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:34.107319 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035abda-0595-4938-b939-a30b4270479c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:34.130068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-9035abda-0595-4938-b939-a30b4270479c None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:34.131499 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-9035abda-0595-4938-b939-a30b4270479c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:34.153372 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 878/1756] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:34.154419 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035abda-0595-4938-b939-a30b4270479c None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:34.174716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035abda-0595-4938-b939-a30b4270479c None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:34.190562 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-8f8ab8e2-687b-4e89-90b7-7b7341824c85 None None] MFA Rules not processed for user `6891fc142bc84f0aa30062bc90f06b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:34.191708 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21099313-d1e1-4d6e-a334-b34d250d0777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:34.192460 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21099313-d1e1-4d6e-a334-b34d250d0777 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:34.192754 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21099313-d1e1-4d6e-a334-b34d250d0777 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:34.192856 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-8f8ab8e2-687b-4e89-90b7-7b7341824c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:34.193164 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21099313-d1e1-4d6e-a334-b34d250d0777 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:34.193992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21099313-d1e1-4d6e-a334-b34d250d0777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:34.195863 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21099313-d1e1-4d6e-a334-b34d250d0777 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:34.242404 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 879/1757] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:34.243930 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21099313-d1e1-4d6e-a334-b34d250d0777 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:34.311588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21099313-d1e1-4d6e-a334-b34d250d0777 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:34.345155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b8d41-dcf2-4382-a7c2-6038538fb4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:34.358422 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b8d41-dcf2-4382-a7c2-6038538fb4bc admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:34.358931 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b8d41-dcf2-4382-a7c2-6038538fb4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:34.359414 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b8d41-dcf2-4382-a7c2-6038538fb4bc admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:34.361290 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b8d41-dcf2-4382-a7c2-6038538fb4bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:34.378780 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b8d41-dcf2-4382-a7c2-6038538fb4bc admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:34.464651 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:34.503976 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 879/1758] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:34.511203 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 880/1759] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:34 2022] POST /identity/v3/projects => generated 399 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:34.515535 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b8d41-dcf2-4382-a7c2-6038538fb4bc admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:34.520322 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc241b-8834-48aa-8bd9-893f3328db8d None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:34.520923 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc241b-8834-48aa-8bd9-893f3328db8d None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:34.521578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc241b-8834-48aa-8bd9-893f3328db8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:34.574609 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-87fc241b-8834-48aa-8bd9-893f3328db8d None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:34.577279 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-87fc241b-8834-48aa-8bd9-893f3328db8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:34.663445 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:34.741116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b8d41-dcf2-4382-a7c2-6038538fb4bc admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:34.758104 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3566857-8e78-456f-aec5-8207769b2fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:34.760150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3566857-8e78-456f-aec5-8207769b2fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:34.760657 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3566857-8e78-456f-aec5-8207769b2fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:34.760944 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3566857-8e78-456f-aec5-8207769b2fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:34.764867 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3566857-8e78-456f-aec5-8207769b2fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:34.769789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3566857-8e78-456f-aec5-8207769b2fe8 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:34.811246 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 881/1760] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:34.812625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3566857-8e78-456f-aec5-8207769b2fe8 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:34.852957 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 880/1761] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:34.857391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f518d1-ff9e-4485-890a-e8063f2e8e18 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:34.858702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f518d1-ff9e-4485-890a-e8063f2e8e18 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:34.859042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f518d1-ff9e-4485-890a-e8063f2e8e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:34.860505 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3566857-8e78-456f-aec5-8207769b2fe8 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:34.876543 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cea77-9ee5-4af6-b34e-1cf7e75370d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:34.877232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cea77-9ee5-4af6-b34e-1cf7e75370d5 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:34.877573 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cea77-9ee5-4af6-b34e-1cf7e75370d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:34.878082 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cea77-9ee5-4af6-b34e-1cf7e75370d5 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:34.879957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470cea77-9ee5-4af6-b34e-1cf7e75370d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:34.883008 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470cea77-9ee5-4af6-b34e-1cf7e75370d5 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:34.921267 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-42f518d1-ff9e-4485-890a-e8063f2e8e18 None None] MFA Rules not processed for user `6891fc142bc84f0aa30062bc90f06b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:34.923841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-42f518d1-ff9e-4485-890a-e8063f2e8e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:34.986744 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 882/1762] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:34 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:34.988377 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cea77-9ee5-4af6-b34e-1cf7e75370d5 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:35.109731 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cea77-9ee5-4af6-b34e-1cf7e75370d5 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:35.133180 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8b469-e431-49b6-aea7-b6d1274993ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:35.134711 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8b469-e431-49b6-aea7-b6d1274993ec admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.135434 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8b469-e431-49b6-aea7-b6d1274993ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.135928 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8b469-e431-49b6-aea7-b6d1274993ec admin admin] PATH_INFO: `/v3/projects/3f8fa411f52e41199fc9d3707ec00b46/users/4cb0b71c2bda4920844e5d0d7f6cbc01/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.210003 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8b469-e431-49b6-aea7-b6d1274993ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f8fa411f52e41199fc9d3707ec00b46, user_id=4cb0b71c2bda4920844e5d0d7f6cbc01, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:35.232542 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8b469-e431-49b6-aea7-b6d1274993ec admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:35.238093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 881/1763] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:35.246323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f518d1-ff9e-4485-890a-e8063f2e8e18 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:35.292772 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f518d1-ff9e-4485-890a-e8063f2e8e18 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:35.306792 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 883/1764] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:34 2022] PUT /identity/v3/projects/3f8fa411f52e41199fc9d3707ec00b46/users/4cb0b71c2bda4920844e5d0d7f6cbc01/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:35.310041 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c360699-555d-4801-a2e4-3e95c6daaa11 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.310566 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c360699-555d-4801-a2e4-3e95c6daaa11 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.311061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c360699-555d-4801-a2e4-3e95c6daaa11 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.330308 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 884/1765] 10.222.0.94 () {54 vars in 912 bytes} [Wed Aug 24 04:50:35 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:50:35.339936 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c360699-555d-4801-a2e4-3e95c6daaa11 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:35.554360 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e1b49-9c87-458f-bdd8-ea963faedc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:35.560955 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e1b49-9c87-458f-bdd8-ea963faedc56 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.561457 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e1b49-9c87-458f-bdd8-ea963faedc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.562913 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e1b49-9c87-458f-bdd8-ea963faedc56 admin admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.570122 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e1b49-9c87-458f-bdd8-ea963faedc56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:35.570845 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e1b49-9c87-458f-bdd8-ea963faedc56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:35.574955 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e1b49-9c87-458f-bdd8-ea963faedc56 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:35.624927 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 882/1766] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:35.629483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11eb07-7163-4ae5-9e14-bdc320676746 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.630075 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11eb07-7163-4ae5-9e14-bdc320676746 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.630762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11eb07-7163-4ae5-9e14-bdc320676746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.730269 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c360699-555d-4801-a2e4-3e95c6daaa11 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:35.741990 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3b702-2812-4712-9a82-0ae3f3c06b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:35.743647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3b702-2812-4712-9a82-0ae3f3c06b4b admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.744359 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3b702-2812-4712-9a82-0ae3f3c06b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.745077 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3b702-2812-4712-9a82-0ae3f3c06b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.745310 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-3f11eb07-7163-4ae5-9e14-bdc320676746 None None] MFA Rules not processed for user `4cb0b71c2bda4920844e5d0d7f6cbc01`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:35.746828 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3b702-2812-4712-9a82-0ae3f3c06b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:35.748546 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-3f11eb07-7163-4ae5-9e14-bdc320676746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:35.751121 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3b702-2812-4712-9a82-0ae3f3c06b4b admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:35.782543 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 885/1767] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:35.786817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099ac02-c78a-45ce-935c-9aeac36ee649 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.787587 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099ac02-c78a-45ce-935c-9aeac36ee649 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.788566 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099ac02-c78a-45ce-935c-9aeac36ee649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.853028 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:35.882373 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-a099ac02-c78a-45ce-935c-9aeac36ee649 None None] MFA Rules not processed for user `0742c7ecf68d40a38c8947a05eee2797`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:35.888299 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-a099ac02-c78a-45ce-935c-9aeac36ee649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:36.018485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 883/1768] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:36.020924 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11eb07-7163-4ae5-9e14-bdc320676746 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:36.023864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-3f11eb07-7163-4ae5-9e14-bdc320676746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:36.080542 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 886/1769] 10.222.0.94 () {58 vars in 1009 bytes} [Wed Aug 24 04:50:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:36.086151 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099ac02-c78a-45ce-935c-9aeac36ee649 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:36.129022 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099ac02-c78a-45ce-935c-9aeac36ee649 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:36.152060 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8cb5c2-8f28-4865-b974-d376cc50b932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:36.152813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cb5c2-8f28-4865-b974-d376cc50b932 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:36.153103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cb5c2-8f28-4865-b974-d376cc50b932 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:36.153440 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cb5c2-8f28-4865-b974-d376cc50b932 admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:36.154514 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8cb5c2-8f28-4865-b974-d376cc50b932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:36.156087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8cb5c2-8f28-4865-b974-d376cc50b932 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:36.223993 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 887/1770] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:36 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:36.224906 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8cb5c2-8f28-4865-b974-d376cc50b932 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:36.269733 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:36.303956 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11eb07-7163-4ae5-9e14-bdc320676746 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:36.397027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8cb5c2-8f28-4865-b974-d376cc50b932 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:36.402495 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031efeba-a6f4-4511-9134-5ee0fb7a67d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:36.403163 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031efeba-a6f4-4511-9134-5ee0fb7a67d1 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:36.403448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031efeba-a6f4-4511-9134-5ee0fb7a67d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:36.403731 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031efeba-a6f4-4511-9134-5ee0fb7a67d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:36.404401 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031efeba-a6f4-4511-9134-5ee0fb7a67d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:36.410898 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031efeba-a6f4-4511-9134-5ee0fb7a67d1 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:36.446321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 888/1771] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:36.448202 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19392866-ac20-4663-932f-89f30ece1a29 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:36.448504 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19392866-ac20-4663-932f-89f30ece1a29 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:36.448801 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19392866-ac20-4663-932f-89f30ece1a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:36.489715 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b2312-c956-4084-b98d-c5236950a453 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:36.490412 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b2312-c956-4084-b98d-c5236950a453 service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:36.490691 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b2312-c956-4084-b98d-c5236950a453 service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:36.490974 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b2312-c956-4084-b98d-c5236950a453 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:36.609130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-19392866-ac20-4663-932f-89f30ece1a29 None None] MFA Rules not processed for user `7caa973c63e64d639cc2fb55a4955542`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:36.611228 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-19392866-ac20-4663-932f-89f30ece1a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:36.692604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b2312-c956-4084-b98d-c5236950a453 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:36.697231 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b2312-c956-4084-b98d-c5236950a453 service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:36.722692 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 884/1772] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 703 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:36.723246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:36.730691 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b2312-c956-4084-b98d-c5236950a453 service nova] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:36.743564 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b2312-c956-4084-b98d-c5236950a453 service nova] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:36.751374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad79b14-860d-4e4f-ba0e-270a41694f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:36.752014 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad79b14-860d-4e4f-ba0e-270a41694f85 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:36.752491 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad79b14-860d-4e4f-ba0e-270a41694f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:36.752821 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad79b14-860d-4e4f-ba0e-270a41694f85 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:36.753454 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad79b14-860d-4e4f-ba0e-270a41694f85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:36.755550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad79b14-860d-4e4f-ba0e-270a41694f85 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:36.820481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 885/1773] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:36 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:36.824595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad79b14-860d-4e4f-ba0e-270a41694f85 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:36.832816 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-aad79b14-860d-4e4f-ba0e-270a41694f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:36.836713 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 889/1774] 10.222.0.94 () {58 vars in 1009 bytes} [Wed Aug 24 04:50:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:36.837604 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19392866-ac20-4663-932f-89f30ece1a29 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:36.865746 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19392866-ac20-4663-932f-89f30ece1a29 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:37.033685 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad79b14-860d-4e4f-ba0e-270a41694f85 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:37.071690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea969a8-8358-4d92-984e-55363e55f31a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:37.073115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea969a8-8358-4d92-984e-55363e55f31a service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:37.073666 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea969a8-8358-4d92-984e-55363e55f31a service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:37.074208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea969a8-8358-4d92-984e-55363e55f31a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:37.089178 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65418c8-4daf-4e31-ac34-98c8ca9f1ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:37.089922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65418c8-4daf-4e31-ac34-98c8ca9f1ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:37.090210 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65418c8-4daf-4e31-ac34-98c8ca9f1ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:37.090880 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65418c8-4daf-4e31-ac34-98c8ca9f1ac3 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:37.091316 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65418c8-4daf-4e31-ac34-98c8ca9f1ac3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:37.095030 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea969a8-8358-4d92-984e-55363e55f31a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:37.101675 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea969a8-8358-4d92-984e-55363e55f31a service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:37.114438 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65418c8-4daf-4e31-ac34-98c8ca9f1ac3 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:37.122084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 886/1775] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:37.123159 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea969a8-8358-4d92-984e-55363e55f31a service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:37.150768 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea969a8-8358-4d92-984e-55363e55f31a service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:37.174092 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46c5f6-b89c-4eaa-990e-55293a419017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:37.175863 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46c5f6-b89c-4eaa-990e-55293a419017 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:37.175863 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46c5f6-b89c-4eaa-990e-55293a419017 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:37.176278 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46c5f6-b89c-4eaa-990e-55293a419017 admin admin] PATH_INFO: `/v3/projects/e798adfb80944c69bdc18cddda973b14/users/eed86a3b2e1246b594d8b43fd0dfc075/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:37.198756 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 890/1776] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:36 2022] POST /identity/v3/users => generated 294 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:37.198756 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65418c8-4daf-4e31-ac34-98c8ca9f1ac3 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:37.200081 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-f65418c8-4daf-4e31-ac34-98c8ca9f1ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:37.237998 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65418c8-4daf-4e31-ac34-98c8ca9f1ac3 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:37.240200 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be46c5f6-b89c-4eaa-990e-55293a419017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e798adfb80944c69bdc18cddda973b14, user_id=eed86a3b2e1246b594d8b43fd0dfc075, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:37.242970 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be46c5f6-b89c-4eaa-990e-55293a419017 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:37.249510 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8f1db-03f5-48de-934f-1cf802909dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:37.251775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8f1db-03f5-48de-934f-1cf802909dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:37.252356 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8f1db-03f5-48de-934f-1cf802909dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:37.252849 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8f1db-03f5-48de-934f-1cf802909dc8 admin admin] PATH_INFO: `/v3/users/d5afc1f833744008ad246b7d32230ed0` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:37.255007 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8f1db-03f5-48de-934f-1cf802909dc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5afc1f833744008ad246b7d32230ed0)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:37.257765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8f1db-03f5-48de-934f-1cf802909dc8 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:37.268900 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:37.269653 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 887/1777] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:37 2022] PUT /identity/v3/projects/e798adfb80944c69bdc18cddda973b14/users/eed86a3b2e1246b594d8b43fd0dfc075/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:37.280330 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46c5f6-b89c-4eaa-990e-55293a419017 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:37.379581 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-5ab8f1db-03f5-48de-934f-1cf802909dc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5afc1f833744008ad246b7d32230ed0'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:37.404330 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-5ab8f1db-03f5-48de-934f-1cf802909dc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5afc1f833744008ad246b7d32230ed0'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:37.423531 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46c5f6-b89c-4eaa-990e-55293a419017 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:37.431200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-5ab8f1db-03f5-48de-934f-1cf802909dc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5afc1f833744008ad246b7d32230ed0'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:37.432365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-5ab8f1db-03f5-48de-934f-1cf802909dc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5afc1f833744008ad246b7d32230ed0'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:37.433006 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af7b0f-3476-4525-a881-83072c5f44d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:37.433906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af7b0f-3476-4525-a881-83072c5f44d6 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:37.434827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af7b0f-3476-4525-a881-83072c5f44d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:37.434953 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af7b0f-3476-4525-a881-83072c5f44d6 admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:37.435750 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af7b0f-3476-4525-a881-83072c5f44d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:37.439304 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af7b0f-3476-4525-a881-83072c5f44d6 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:37.480718 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-5ab8f1db-03f5-48de-934f-1cf802909dc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5afc1f833744008ad246b7d32230ed0'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:37.490952 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 888/1778] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:37 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:37.492067 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af7b0f-3476-4525-a881-83072c5f44d6 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:37.497010 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 891/1779] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:37 2022] DELETE /identity/v3/users/d5afc1f833744008ad246b7d32230ed0 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:37.498938 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-18af7b0f-3476-4525-a881-83072c5f44d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:37.505699 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949247c-4111-46ea-89fd-dfe4f12a8fe2 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:37.505994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949247c-4111-46ea-89fd-dfe4f12a8fe2 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:37.506305 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949247c-4111-46ea-89fd-dfe4f12a8fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:37.647843 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-c949247c-4111-46ea-89fd-dfe4f12a8fe2 None None] MFA Rules not processed for user `cab4c264979e46a39cc0ddd2df8ee8df`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:37.650178 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-c949247c-4111-46ea-89fd-dfe4f12a8fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:37.725173 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:37.810221 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 892/1780] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:37.811821 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949247c-4111-46ea-89fd-dfe4f12a8fe2 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:37.815228 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-c949247c-4111-46ea-89fd-dfe4f12a8fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:37.833988 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af7b0f-3476-4525-a881-83072c5f44d6 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:38.045671 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbd90e-a44d-48c6-b195-7a2ab332d5a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40d2202203204b06a41e57b9d1a300fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:38.046320 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbd90e-a44d-48c6-b195-7a2ab332d5a0 service swift] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:38.046597 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbd90e-a44d-48c6-b195-7a2ab332d5a0 service swift] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:38.046869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbd90e-a44d-48c6-b195-7a2ab332d5a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:38.049615 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949247c-4111-46ea-89fd-dfe4f12a8fe2 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:38.052004 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e7cbd90e-a44d-48c6-b195-7a2ab332d5a0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:38.066341 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7511d-8755-4d4d-a3b6-a79090f34b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:38.067437 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7511d-8755-4d4d-a3b6-a79090f34b9a admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:38.067905 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7511d-8755-4d4d-a3b6-a79090f34b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:38.070987 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7511d-8755-4d4d-a3b6-a79090f34b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:38.072507 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7511d-8755-4d4d-a3b6-a79090f34b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:38.082886 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7511d-8755-4d4d-a3b6-a79090f34b9a admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:38.123558 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 893/1781] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:38.129510 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599718c5-ba74-47da-b662-ee534229e49f None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:38.130378 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599718c5-ba74-47da-b662-ee534229e49f None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:38.131128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599718c5-ba74-47da-b662-ee534229e49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:38.256263 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-599718c5-ba74-47da-b662-ee534229e49f None None] MFA Rules not processed for user `eed86a3b2e1246b594d8b43fd0dfc075`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:38.258984 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-599718c5-ba74-47da-b662-ee534229e49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:38.263190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbd90e-a44d-48c6-b195-7a2ab332d5a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:38.267296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbd90e-a44d-48c6-b195-7a2ab332d5a0 service swift] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:38.302499 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:38.336186 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 889/1782] 10.222.0.94 () {60 vars in 1384 bytes} [Wed Aug 24 04:50:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 844 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:50:38.342590 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbd90e-a44d-48c6-b195-7a2ab332d5a0 service swift] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:38.353273 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e7cbd90e-a44d-48c6-b195-7a2ab332d5a0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:38.511209 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbd90e-a44d-48c6-b195-7a2ab332d5a0 service swift] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:38.515073 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 894/1783] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:38 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:38.521056 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763ee4e-eeef-443f-8a74-e7a94b71d781 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:38.525681 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763ee4e-eeef-443f-8a74-e7a94b71d781 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:38.526288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763ee4e-eeef-443f-8a74-e7a94b71d781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:38.562306 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b505a2-0cd1-4918-95c7-6a79120b9621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:38.563527 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b505a2-0cd1-4918-95c7-6a79120b9621 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:38.563969 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b505a2-0cd1-4918-95c7-6a79120b9621 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:38.564415 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b505a2-0cd1-4918-95c7-6a79120b9621 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:38.565568 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b505a2-0cd1-4918-95c7-6a79120b9621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:38.592889 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-0763ee4e-eeef-443f-8a74-e7a94b71d781 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:38.597568 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b505a2-0cd1-4918-95c7-6a79120b9621 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:38.602615 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-0763ee4e-eeef-443f-8a74-e7a94b71d781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:38.634534 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 895/1784] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:38.637241 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763ee4e-eeef-443f-8a74-e7a94b71d781 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:38.676080 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 890/1785] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:38.678248 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b505a2-0cd1-4918-95c7-6a79120b9621 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:38.690911 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-32b505a2-0cd1-4918-95c7-6a79120b9621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:38.704479 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763ee4e-eeef-443f-8a74-e7a94b71d781 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:38.709957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b3924-8242-4c76-b33c-ad3c71b3d98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:38.712391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b3924-8242-4c76-b33c-ad3c71b3d98f admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:38.713004 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b3924-8242-4c76-b33c-ad3c71b3d98f admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:38.714319 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b3924-8242-4c76-b33c-ad3c71b3d98f admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:38.716054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b3924-8242-4c76-b33c-ad3c71b3d98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:38.726050 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b3924-8242-4c76-b33c-ad3c71b3d98f admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:38.764894 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 896/1786] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:38.775896 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b3924-8242-4c76-b33c-ad3c71b3d98f admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:38.791677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b505a2-0cd1-4918-95c7-6a79120b9621 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:38.802980 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-6e0b3924-8242-4c76-b33c-ad3c71b3d98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:38.828179 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd801e-1a2b-4a88-9dde-5af8cd134d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:38.829434 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd801e-1a2b-4a88-9dde-5af8cd134d62 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:38.829717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd801e-1a2b-4a88-9dde-5af8cd134d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:38.830013 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd801e-1a2b-4a88-9dde-5af8cd134d62 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:38.830665 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd801e-1a2b-4a88-9dde-5af8cd134d62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:38.852595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd801e-1a2b-4a88-9dde-5af8cd134d62 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:39.001912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 891/1787] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:38 2022] POST /identity/v3/projects => generated 401 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:39.005303 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd801e-1a2b-4a88-9dde-5af8cd134d62 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:39.058348 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b3924-8242-4c76-b33c-ad3c71b3d98f admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:39.232561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:39.315683 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd801e-1a2b-4a88-9dde-5af8cd134d62 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:39.338898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66cfb1-d75f-4e61-b685-2743965770fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:39.342991 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66cfb1-d75f-4e61-b685-2743965770fd admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:39.343601 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66cfb1-d75f-4e61-b685-2743965770fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:39.345345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66cfb1-d75f-4e61-b685-2743965770fd admin admin] PATH_INFO: `/v3/projects/5a430f3bb9c548cdac785a2af46ab0b2/users/0ee1a1a949824adf9d5d02039a85fa0b/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:39.408370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2611d74-8c5b-4efd-b656-faf1a83145e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:39.409422 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2611d74-8c5b-4efd-b656-faf1a83145e6 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:39.414357 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2611d74-8c5b-4efd-b656-faf1a83145e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:39.414820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2611d74-8c5b-4efd-b656-faf1a83145e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:39.442492 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66cfb1-d75f-4e61-b685-2743965770fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a430f3bb9c548cdac785a2af46ab0b2, user_id=0ee1a1a949824adf9d5d02039a85fa0b, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:39.445775 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66cfb1-d75f-4e61-b685-2743965770fd admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:39.487354 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 892/1788] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:39 2022] PUT /identity/v3/projects/5a430f3bb9c548cdac785a2af46ab0b2/users/0ee1a1a949824adf9d5d02039a85fa0b/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:39.488713 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66cfb1-d75f-4e61-b685-2743965770fd admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:39.490423 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2611d74-8c5b-4efd-b656-faf1a83145e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:39.499494 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2611d74-8c5b-4efd-b656-faf1a83145e6 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:39.600157 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 897/1789] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 827 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:39.604335 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2611d74-8c5b-4efd-b656-faf1a83145e6 service neutron] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:39.704565 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2611d74-8c5b-4efd-b656-faf1a83145e6 service neutron] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:39.757274 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66cfb1-d75f-4e61-b685-2743965770fd admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:39.773691 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af3946-e621-4939-8696-1175254155ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:39.775175 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af3946-e621-4939-8696-1175254155ae admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:39.775702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af3946-e621-4939-8696-1175254155ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:39.776173 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af3946-e621-4939-8696-1175254155ae admin admin] PATH_INFO: `/v3/projects/1c4efe925771485d9ee2d416c6bc9f57/users/3dbb124984324b688c069d755ee43104/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:39.778152 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a67884-28f9-4215-8937-dc6639a51df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:39.779192 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a67884-28f9-4215-8937-dc6639a51df6 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:39.790342 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a67884-28f9-4215-8937-dc6639a51df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:39.801695 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a67884-28f9-4215-8937-dc6639a51df6 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:39.803029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a67884-28f9-4215-8937-dc6639a51df6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:39.823964 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a67884-28f9-4215-8937-dc6639a51df6 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:39.847928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af3946-e621-4939-8696-1175254155ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c4efe925771485d9ee2d416c6bc9f57, user_id=3dbb124984324b688c069d755ee43104, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:39.864343 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af3946-e621-4939-8696-1175254155ae admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:39.974929 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 893/1790] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:39 2022] PUT /identity/v3/projects/1c4efe925771485d9ee2d416c6bc9f57/users/3dbb124984324b688c069d755ee43104/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:39.997576 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 898/1791] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:39 2022] POST /identity/v3/users => generated 307 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:39.999684 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd4f04-078b-4f87-ba32-5d35fecbfb2f None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:39.999976 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd4f04-078b-4f87-ba32-5d35fecbfb2f None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:40.000905 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd4f04-078b-4f87-ba32-5d35fecbfb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:40.001580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af3946-e621-4939-8696-1175254155ae admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:40.082484 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-d7fd4f04-078b-4f87-ba32-5d35fecbfb2f None None] MFA Rules not processed for user `0742c7ecf68d40a38c8947a05eee2797`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:40.086661 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-d7fd4f04-078b-4f87-ba32-5d35fecbfb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:40.237502 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:40.317917 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 899/1792] 10.222.0.84 () {58 vars in 1015 bytes} [Wed Aug 24 04:50:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:40.323808 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be853204-cc8b-4e1e-b26a-d7676047fad0 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:40.323956 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be853204-cc8b-4e1e-b26a-d7676047fad0 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:40.328870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be853204-cc8b-4e1e-b26a-d7676047fad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:40.473821 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-be853204-cc8b-4e1e-b26a-d7676047fad0 None None] MFA Rules not processed for user `3dbb124984324b688c069d755ee43104`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:40.475182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-be853204-cc8b-4e1e-b26a-d7676047fad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:40.490510 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af3946-e621-4939-8696-1175254155ae admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:40.564750 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648778e-2d22-42c0-9468-cff6c52c73ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:40.569540 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648778e-2d22-42c0-9468-cff6c52c73ac admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:40.570040 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648778e-2d22-42c0-9468-cff6c52c73ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:40.570748 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648778e-2d22-42c0-9468-cff6c52c73ac admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:40.574898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648778e-2d22-42c0-9468-cff6c52c73ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:40.588355 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648778e-2d22-42c0-9468-cff6c52c73ac admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:40.647733 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 894/1793] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 671 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:40.648767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648778e-2d22-42c0-9468-cff6c52c73ac admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:40.691961 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648778e-2d22-42c0-9468-cff6c52c73ac admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:40.714772 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1e523-ab35-43be-b059-e5b8ad9f3a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:40.715414 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1e523-ab35-43be-b059-e5b8ad9f3a6e admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:40.715693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1e523-ab35-43be-b059-e5b8ad9f3a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:40.717771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1e523-ab35-43be-b059-e5b8ad9f3a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:40.718819 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1e523-ab35-43be-b059-e5b8ad9f3a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:40.733106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1e523-ab35-43be-b059-e5b8ad9f3a6e admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:40.779155 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 895/1794] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:40.783152 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1e523-ab35-43be-b059-e5b8ad9f3a6e admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:40.790648 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-a4f1e523-ab35-43be-b059-e5b8ad9f3a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:40.827587 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1e523-ab35-43be-b059-e5b8ad9f3a6e admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:40.838055 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db7291-6b64-442b-b61f-0d6e421394ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:40.842704 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db7291-6b64-442b-b61f-0d6e421394ab service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:40.843448 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db7291-6b64-442b-b61f-0d6e421394ab service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:40.843797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db7291-6b64-442b-b61f-0d6e421394ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:40.866097 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db7291-6b64-442b-b61f-0d6e421394ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:40.870519 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db7291-6b64-442b-b61f-0d6e421394ab service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:40.897244 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 900/1795] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 579 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:40.898366 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be853204-cc8b-4e1e-b26a-d7676047fad0 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:40.909975 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 896/1796] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:40.914122 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db7291-6b64-442b-b61f-0d6e421394ab service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:40.948881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be853204-cc8b-4e1e-b26a-d7676047fad0 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:40.967410 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db7291-6b64-442b-b61f-0d6e421394ab service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:40.981646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e6427-3003-4464-bd23-f0c5dafe3b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:40.982484 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e6427-3003-4464-bd23-f0c5dafe3b3d admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:40.983082 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e6427-3003-4464-bd23-f0c5dafe3b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:40.983257 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e6427-3003-4464-bd23-f0c5dafe3b3d admin admin] PATH_INFO: `/v3/projects/5a430f3bb9c548cdac785a2af46ab0b2/users/0ee1a1a949824adf9d5d02039a85fa0b/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:40.988644 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e6427-3003-4464-bd23-f0c5dafe3b3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a430f3bb9c548cdac785a2af46ab0b2, user_id=0ee1a1a949824adf9d5d02039a85fa0b, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:40.992047 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f332c-95c0-458d-ab42-31ae81551401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:40.993175 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f332c-95c0-458d-ab42-31ae81551401 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:40.993692 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f332c-95c0-458d-ab42-31ae81551401 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:40.994169 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f332c-95c0-458d-ab42-31ae81551401 admin admin] PATH_INFO: `/v3/projects/4d0a1040a9dc4a3584f55a8334f98153/users/d60ee45cfac9401aa5c5af905dfeb54c/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:40.994940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e6427-3003-4464-bd23-f0c5dafe3b3d admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:41.043610 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:41.053454 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f332c-95c0-458d-ab42-31ae81551401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d0a1040a9dc4a3584f55a8334f98153, user_id=d60ee45cfac9401aa5c5af905dfeb54c, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:41.065518 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 901/1797] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:40 2022] PUT /identity/v3/projects/5a430f3bb9c548cdac785a2af46ab0b2/users/0ee1a1a949824adf9d5d02039a85fa0b/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:41.065518 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e6427-3003-4464-bd23-f0c5dafe3b3d admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:41.066987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f332c-95c0-458d-ab42-31ae81551401 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:41.128018 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 897/1798] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:40 2022] PUT /identity/v3/projects/4d0a1040a9dc4a3584f55a8334f98153/users/d60ee45cfac9401aa5c5af905dfeb54c/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:41.128018 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab0aa7-a517-4b71-bba3-e06a50c78746 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:41.128018 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab0aa7-a517-4b71-bba3-e06a50c78746 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:41.128018 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab0aa7-a517-4b71-bba3-e06a50c78746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:41.296386 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-a9ab0aa7-a517-4b71-bba3-e06a50c78746 None None] MFA Rules not processed for user `0ee1a1a949824adf9d5d02039a85fa0b`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:41.299200 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-a9ab0aa7-a517-4b71-bba3-e06a50c78746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:41.317912 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e6427-3003-4464-bd23-f0c5dafe3b3d admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:41.496771 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe45c35-36ec-48b3-954b-f14012880c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:41.502655 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe45c35-36ec-48b3-954b-f14012880c39 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:41.503038 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe45c35-36ec-48b3-954b-f14012880c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:41.503423 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe45c35-36ec-48b3-954b-f14012880c39 admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:41.513217 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe45c35-36ec-48b3-954b-f14012880c39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:41.527862 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe45c35-36ec-48b3-954b-f14012880c39 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:41.616706 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:41.675128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 902/1799] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:41 2022] POST /identity/v3/projects => generated 385 bytes in 620 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:41.676115 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe45c35-36ec-48b3-954b-f14012880c39 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:41.763654 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 898/1800] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 643 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:41.764672 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab0aa7-a517-4b71-bba3-e06a50c78746 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:41.769437 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-a9ab0aa7-a517-4b71-bba3-e06a50c78746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:41.788448 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab0aa7-a517-4b71-bba3-e06a50c78746 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:41.945997 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fe3ce-f93a-4101-801a-f6deb57ef3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:41.946885 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fe3ce-f93a-4101-801a-f6deb57ef3f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:41.947174 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fe3ce-f93a-4101-801a-f6deb57ef3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:41.948538 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fe3ce-f93a-4101-801a-f6deb57ef3f9 admin admin] PATH_INFO: `/v3/projects/6d694555cfea413ea7426ce8a5b3b875` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:41.953974 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180fe3ce-f93a-4101-801a-f6deb57ef3f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d694555cfea413ea7426ce8a5b3b875)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:41.956409 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180fe3ce-f93a-4101-801a-f6deb57ef3f9 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:42.025472 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe45c35-36ec-48b3-954b-f14012880c39 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:42.045983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1198f42-69dd-4324-a9b5-8e68a7fd66b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:42.049150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1198f42-69dd-4324-a9b5-8e68a7fd66b0 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:42.050585 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1198f42-69dd-4324-a9b5-8e68a7fd66b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:42.051030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1198f42-69dd-4324-a9b5-8e68a7fd66b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:42.066781 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1198f42-69dd-4324-a9b5-8e68a7fd66b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:42.073616 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1198f42-69dd-4324-a9b5-8e68a7fd66b0 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:42.107274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 903/1801] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:42.108691 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1198f42-69dd-4324-a9b5-8e68a7fd66b0 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:42.138417 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1198f42-69dd-4324-a9b5-8e68a7fd66b0 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:42.164608 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-180fe3ce-f93a-4101-801a-f6deb57ef3f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d694555cfea413ea7426ce8a5b3b875', 'request_id': 'req-180fe3ce-f93a-4101-801a-f6deb57ef3f9'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:42.223725 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-180fe3ce-f93a-4101-801a-f6deb57ef3f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d694555cfea413ea7426ce8a5b3b875', 'request_id': 'req-180fe3ce-f93a-4101-801a-f6deb57ef3f9'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:42.251981 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-180fe3ce-f93a-4101-801a-f6deb57ef3f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d694555cfea413ea7426ce8a5b3b875', 'request_id': 'req-180fe3ce-f93a-4101-801a-f6deb57ef3f9'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:42.289442 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-180fe3ce-f93a-4101-801a-f6deb57ef3f9 admin admin] The token cache is being invalidate because project 6d694555cfea413ea7426ce8a5b3b875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:42.289753 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-180fe3ce-f93a-4101-801a-f6deb57ef3f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:42.290455 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-180fe3ce-f93a-4101-801a-f6deb57ef3f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:42.296294 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 899/1802] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:41 2022] DELETE /identity/v3/projects/6d694555cfea413ea7426ce8a5b3b875 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:42.296294 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fe3ce-f93a-4101-801a-f6deb57ef3f9 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:42.304948 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-180fe3ce-f93a-4101-801a-f6deb57ef3f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:42.331718 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:42.385736 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb654a-a06f-45e8-93ed-342c526eaacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:42.385736 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb654a-a06f-45e8-93ed-342c526eaacb admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:42.385736 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb654a-a06f-45e8-93ed-342c526eaacb admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:42.385736 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb654a-a06f-45e8-93ed-342c526eaacb admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:42.386295 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb654a-a06f-45e8-93ed-342c526eaacb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:42.387881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb654a-a06f-45e8-93ed-342c526eaacb admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:42.431795 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 904/1803] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:42 2022] POST /identity/v3/users => generated 293 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:42.433504 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6e9ef-eb42-4466-b61f-e3916a608307 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:42.433800 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6e9ef-eb42-4466-b61f-e3916a608307 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:42.434079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6e9ef-eb42-4466-b61f-e3916a608307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:42.437419 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fe3ce-f93a-4101-801a-f6deb57ef3f9 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:42.446293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad0e08-d4c9-4a45-9e46-d6fb16e34d46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:42.447122 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad0e08-d4c9-4a45-9e46-d6fb16e34d46 service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:42.447393 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad0e08-d4c9-4a45-9e46-d6fb16e34d46 service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:42.448635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad0e08-d4c9-4a45-9e46-d6fb16e34d46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:42.452826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-79ad0e08-d4c9-4a45-9e46-d6fb16e34d46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:42.490146 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-57c6e9ef-eb42-4466-b61f-e3916a608307 None None] MFA Rules not processed for user `a4493625af43482a88023a2aecd73b27`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:42.492022 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-57c6e9ef-eb42-4466-b61f-e3916a608307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:42.710894 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 905/1804] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:42.713554 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6e9ef-eb42-4466-b61f-e3916a608307 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:42.723243 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-57c6e9ef-eb42-4466-b61f-e3916a608307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:42.747182 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad0e08-d4c9-4a45-9e46-d6fb16e34d46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:42.759060 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6e9ef-eb42-4466-b61f-e3916a608307 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:42.770287 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad0e08-d4c9-4a45-9e46-d6fb16e34d46 service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:42.773773 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e86651-d533-47f1-942f-e51387e8c173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:42.774469 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e86651-d533-47f1-942f-e51387e8c173 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:42.774754 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e86651-d533-47f1-942f-e51387e8c173 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:42.775029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e86651-d533-47f1-942f-e51387e8c173 admin admin] PATH_INFO: `/v3/projects/4d0a1040a9dc4a3584f55a8334f98153/users/d60ee45cfac9401aa5c5af905dfeb54c/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:42.777205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e86651-d533-47f1-942f-e51387e8c173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d0a1040a9dc4a3584f55a8334f98153, user_id=d60ee45cfac9401aa5c5af905dfeb54c, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:42.781097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e86651-d533-47f1-942f-e51387e8c173 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:42.827751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 906/1805] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:42 2022] PUT /identity/v3/projects/4d0a1040a9dc4a3584f55a8334f98153/users/d60ee45cfac9401aa5c5af905dfeb54c/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:42.829159 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e86651-d533-47f1-942f-e51387e8c173 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:42.838842 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-c0e86651-d533-47f1-942f-e51387e8c173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:42.916208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 900/1806] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:42.927285 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad0e08-d4c9-4a45-9e46-d6fb16e34d46 service cinder] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:42.960668 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-79ad0e08-d4c9-4a45-9e46-d6fb16e34d46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:42.972260 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:43.085206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad0e08-d4c9-4a45-9e46-d6fb16e34d46 service cinder] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:43.155178 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e86651-d533-47f1-942f-e51387e8c173 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:43.174578 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee7021-d02a-4013-80ab-58c7d8966b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:43.185523 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee7021-d02a-4013-80ab-58c7d8966b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:43.186187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee7021-d02a-4013-80ab-58c7d8966b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:43.186360 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee7021-d02a-4013-80ab-58c7d8966b9a admin admin] PATH_INFO: `/v3/users/65a40a0dc16a4828871450529f878cf0` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:43.189347 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee7021-d02a-4013-80ab-58c7d8966b9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=65a40a0dc16a4828871450529f878cf0)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:43.191531 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee7021-d02a-4013-80ab-58c7d8966b9a admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:43.379523 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-c7ee7021-d02a-4013-80ab-58c7d8966b9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65a40a0dc16a4828871450529f878cf0'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:43.407524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-c7ee7021-d02a-4013-80ab-58c7d8966b9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65a40a0dc16a4828871450529f878cf0'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:43.440991 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-c7ee7021-d02a-4013-80ab-58c7d8966b9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65a40a0dc16a4828871450529f878cf0'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:43.441846 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-c7ee7021-d02a-4013-80ab-58c7d8966b9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65a40a0dc16a4828871450529f878cf0'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:43.480819 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f25b9-2d8f-4fcc-a7ad-d8c61cd5fadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:43.482876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f25b9-2d8f-4fcc-a7ad-d8c61cd5fadb admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:43.483351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f25b9-2d8f-4fcc-a7ad-d8c61cd5fadb admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:43.483742 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f25b9-2d8f-4fcc-a7ad-d8c61cd5fadb admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:43.486302 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f25b9-2d8f-4fcc-a7ad-d8c61cd5fadb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:43.489922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f25b9-2d8f-4fcc-a7ad-d8c61cd5fadb admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:43.490544 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-c7ee7021-d02a-4013-80ab-58c7d8966b9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65a40a0dc16a4828871450529f878cf0'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:43.527031 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 907/1807] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:42 2022] DELETE /identity/v3/users/65a40a0dc16a4828871450529f878cf0 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:43.527031 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa072717-f742-4359-8dfc-480ef5246cc5 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:43.527031 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa072717-f742-4359-8dfc-480ef5246cc5 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:43.527031 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa072717-f742-4359-8dfc-480ef5246cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:43.555122 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 901/1808] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 633 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:43.556309 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f25b9-2d8f-4fcc-a7ad-d8c61cd5fadb admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:43.561571 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-eb5f25b9-2d8f-4fcc-a7ad-d8c61cd5fadb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:43.652698 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-fa072717-f742-4359-8dfc-480ef5246cc5 None None] MFA Rules not processed for user `d60ee45cfac9401aa5c5af905dfeb54c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:43.663684 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-fa072717-f742-4359-8dfc-480ef5246cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:43.900709 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f25b9-2d8f-4fcc-a7ad-d8c61cd5fadb admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:43.929511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:44.111487 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 908/1809] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:43 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 587 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:44.118106 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa072717-f742-4359-8dfc-480ef5246cc5 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:44.127469 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-fa072717-f742-4359-8dfc-480ef5246cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:44.145573 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3eeec-170a-4fe4-9458-6f0a2e2e05c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:44.149222 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3eeec-170a-4fe4-9458-6f0a2e2e05c7 service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:44.149837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3eeec-170a-4fe4-9458-6f0a2e2e05c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:44.150253 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3eeec-170a-4fe4-9458-6f0a2e2e05c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:44.153343 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-04e3eeec-170a-4fe4-9458-6f0a2e2e05c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:44.216078 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:44.403897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3eeec-170a-4fe4-9458-6f0a2e2e05c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:44.408640 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3eeec-170a-4fe4-9458-6f0a2e2e05c7 service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:44.435087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 902/1810] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 879 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:44.464348 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3eeec-170a-4fe4-9458-6f0a2e2e05c7 service cinder] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:44.470317 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-04e3eeec-170a-4fe4-9458-6f0a2e2e05c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:44.479942 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa072717-f742-4359-8dfc-480ef5246cc5 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:44.501654 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3bbc1-186b-400f-8520-2e852b30353d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:44.502378 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3bbc1-186b-400f-8520-2e852b30353d admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:44.504339 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3bbc1-186b-400f-8520-2e852b30353d admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:44.504692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3bbc1-186b-400f-8520-2e852b30353d admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:44.507804 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3bbc1-186b-400f-8520-2e852b30353d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:44.514341 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3bbc1-186b-400f-8520-2e852b30353d admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:44.545354 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3eeec-170a-4fe4-9458-6f0a2e2e05c7 service cinder] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:44.573096 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 909/1811] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 461 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:44.575395 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3bbc1-186b-400f-8520-2e852b30353d admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:44.577425 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853710c5-b304-4d6b-abd2-903e714cd7cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:44.586002 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853710c5-b304-4d6b-abd2-903e714cd7cc service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:44.589445 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853710c5-b304-4d6b-abd2-903e714cd7cc service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:44.590134 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853710c5-b304-4d6b-abd2-903e714cd7cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:44.623434 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3bbc1-186b-400f-8520-2e852b30353d admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:44.639548 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853710c5-b304-4d6b-abd2-903e714cd7cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:44.644264 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd030d1-0626-4eea-8bb4-ed5c659a1ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:44.646058 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853710c5-b304-4d6b-abd2-903e714cd7cc service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:44.646736 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd030d1-0626-4eea-8bb4-ed5c659a1ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:44.647131 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd030d1-0626-4eea-8bb4-ed5c659a1ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:44.648608 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd030d1-0626-4eea-8bb4-ed5c659a1ae1 admin admin] PATH_INFO: `/v3/projects/8eac3992a3924a5f9f5b980d7acceb54/users/fd39fb1c35364d4ebca0d26b000ab65c/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:44.705202 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd030d1-0626-4eea-8bb4-ed5c659a1ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eac3992a3924a5f9f5b980d7acceb54, user_id=fd39fb1c35364d4ebca0d26b000ab65c, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:44.714027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 903/1812] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:44 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:44.724642 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd030d1-0626-4eea-8bb4-ed5c659a1ae1 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:44.769276 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 910/1813] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:44 2022] PUT /identity/v3/projects/8eac3992a3924a5f9f5b980d7acceb54/users/fd39fb1c35364d4ebca0d26b000ab65c/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:44.780544 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9ca6e-9b98-44bd-b51b-10243ae4b81d None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:44.780823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9ca6e-9b98-44bd-b51b-10243ae4b81d None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:44.781866 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9ca6e-9b98-44bd-b51b-10243ae4b81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:44.876955 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-1cc9ca6e-9b98-44bd-b51b-10243ae4b81d None None] MFA Rules not processed for user `fd39fb1c35364d4ebca0d26b000ab65c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:44.878405 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-1cc9ca6e-9b98-44bd-b51b-10243ae4b81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:45.013083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd030d1-0626-4eea-8bb4-ed5c659a1ae1 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:45.135549 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 904/1814] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:45.142567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9ca6e-9b98-44bd-b51b-10243ae4b81d None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:45.274741 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd030d1-0626-4eea-8bb4-ed5c659a1ae1 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:45.288709 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b52ffb-57fa-45b7-9d69-ad7ac1d138ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:45.291199 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b52ffb-57fa-45b7-9d69-ad7ac1d138ba service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:45.291859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b52ffb-57fa-45b7-9d69-ad7ac1d138ba service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:45.292538 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b52ffb-57fa-45b7-9d69-ad7ac1d138ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:45.299873 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-94b52ffb-57fa-45b7-9d69-ad7ac1d138ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:45.340878 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:45.455845 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9ca6e-9b98-44bd-b51b-10243ae4b81d None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:45.486763 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb91da-7e4b-41e2-a92e-474aa2ff91bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:45.488954 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb91da-7e4b-41e2-a92e-474aa2ff91bf admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:45.491005 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb91da-7e4b-41e2-a92e-474aa2ff91bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:45.491857 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb91da-7e4b-41e2-a92e-474aa2ff91bf admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:45.493533 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb91da-7e4b-41e2-a92e-474aa2ff91bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:45.510894 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb91da-7e4b-41e2-a92e-474aa2ff91bf admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:45.593475 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b52ffb-57fa-45b7-9d69-ad7ac1d138ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:45.599942 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b52ffb-57fa-45b7-9d69-ad7ac1d138ba service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:45.631265 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 911/1815] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:45 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:50:45.722030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b52ffb-57fa-45b7-9d69-ad7ac1d138ba service cinder] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:45.732561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 905/1816] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:45 2022] POST /identity/v3/projects => generated 385 bytes in 588 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:45.737866 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b52ffb-57fa-45b7-9d69-ad7ac1d138ba service cinder] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:45.921391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:45.972029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04970aac-f0b1-4f46-a065-60d55edfa08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:45.973851 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04970aac-f0b1-4f46-a065-60d55edfa08b admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:45.974378 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04970aac-f0b1-4f46-a065-60d55edfa08b admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:45.976556 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04970aac-f0b1-4f46-a065-60d55edfa08b admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:45.977916 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04970aac-f0b1-4f46-a065-60d55edfa08b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:46.001609 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04970aac-f0b1-4f46-a065-60d55edfa08b admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:46.057165 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 912/1817] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:45 2022] POST /identity/v3/users => generated 299 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:50:46.063144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb91da-7e4b-41e2-a92e-474aa2ff91bf admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:46.101236 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb91da-7e4b-41e2-a92e-474aa2ff91bf admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:46.133393 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d816e65-9dad-4143-b873-70aacdb8471e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:46.135993 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d816e65-9dad-4143-b873-70aacdb8471e admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:46.136731 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d816e65-9dad-4143-b873-70aacdb8471e admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:46.136731 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d816e65-9dad-4143-b873-70aacdb8471e admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:46.139582 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d816e65-9dad-4143-b873-70aacdb8471e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:46.164502 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d816e65-9dad-4143-b873-70aacdb8471e admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:46.227397 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 906/1818] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:46.232636 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04970aac-f0b1-4f46-a065-60d55edfa08b admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:46.255632 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04970aac-f0b1-4f46-a065-60d55edfa08b admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:46.283048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ebe19-8131-4be3-a25d-87df1e5e33c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:46.284375 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ebe19-8131-4be3-a25d-87df1e5e33c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:46.284969 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ebe19-8131-4be3-a25d-87df1e5e33c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:46.285626 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ebe19-8131-4be3-a25d-87df1e5e33c4 admin admin] PATH_INFO: `/v3/projects/0e72a47d2eed47d69a6b69e5896563fe/users/9fdff0d4f25340f6a5c8b049ac947228/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:46.368119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ebe19-8131-4be3-a25d-87df1e5e33c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e72a47d2eed47d69a6b69e5896563fe, user_id=9fdff0d4f25340f6a5c8b049ac947228, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:46.378210 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ebe19-8131-4be3-a25d-87df1e5e33c4 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:46.414238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 913/1819] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:46 2022] PUT /identity/v3/projects/0e72a47d2eed47d69a6b69e5896563fe/users/9fdff0d4f25340f6a5c8b049ac947228/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:46.414569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d816e65-9dad-4143-b873-70aacdb8471e admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:46.451158 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d816e65-9dad-4143-b873-70aacdb8471e admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:46.725925 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f158c3-2719-49e7-975c-db86327d1f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:46.726562 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f158c3-2719-49e7-975c-db86327d1f34 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:46.726840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f158c3-2719-49e7-975c-db86327d1f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:46.727159 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f158c3-2719-49e7-975c-db86327d1f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:46.727831 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f158c3-2719-49e7-975c-db86327d1f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:46.749002 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f158c3-2719-49e7-975c-db86327d1f34 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:46.783144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 907/1820] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:46.786979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ebe19-8131-4be3-a25d-87df1e5e33c4 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:46.803925 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ebe19-8131-4be3-a25d-87df1e5e33c4 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:46.831819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3d901-c155-4354-805f-2dccf0af2c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:46.832636 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3d901-c155-4354-805f-2dccf0af2c5e admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:46.832927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3d901-c155-4354-805f-2dccf0af2c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:46.833215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3d901-c155-4354-805f-2dccf0af2c5e admin admin] PATH_INFO: `/v3/projects/0e72a47d2eed47d69a6b69e5896563fe/users/9fdff0d4f25340f6a5c8b049ac947228/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:46.841383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3d901-c155-4354-805f-2dccf0af2c5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e72a47d2eed47d69a6b69e5896563fe, user_id=9fdff0d4f25340f6a5c8b049ac947228, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:46.853290 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3d901-c155-4354-805f-2dccf0af2c5e admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:46.934760 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 914/1821] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:46 2022] PUT /identity/v3/projects/0e72a47d2eed47d69a6b69e5896563fe/users/9fdff0d4f25340f6a5c8b049ac947228/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:46.938899 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fb169-c797-4d56-8ed9-f73e181ccec9 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:46.939159 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fb169-c797-4d56-8ed9-f73e181ccec9 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:46.939438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fb169-c797-4d56-8ed9-f73e181ccec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:47.014010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-685fb169-c797-4d56-8ed9-f73e181ccec9 None None] MFA Rules not processed for user `9fdff0d4f25340f6a5c8b049ac947228`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:47.015988 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-685fb169-c797-4d56-8ed9-f73e181ccec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:47.195496 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 908/1822] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:47.206751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3d901-c155-4354-805f-2dccf0af2c5e admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:47.476946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3d901-c155-4354-805f-2dccf0af2c5e admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:47.497238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b43dd-328d-4d47-868a-7fc1cf8629c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:47.499354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b43dd-328d-4d47-868a-7fc1cf8629c4 service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:47.501028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b43dd-328d-4d47-868a-7fc1cf8629c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:47.502439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b43dd-328d-4d47-868a-7fc1cf8629c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:47.543717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b43dd-328d-4d47-868a-7fc1cf8629c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:47.552297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b43dd-328d-4d47-868a-7fc1cf8629c4 service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:47.588228 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 915/1823] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:47.948956 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fb169-c797-4d56-8ed9-f73e181ccec9 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:47.955142 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-685fb169-c797-4d56-8ed9-f73e181ccec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:48.110014 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:48.196186 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fb169-c797-4d56-8ed9-f73e181ccec9 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:48.221611 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b02f8-7c00-4d79-9782-57700f8ca155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:48.222278 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b02f8-7c00-4d79-9782-57700f8ca155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:48.222772 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b02f8-7c00-4d79-9782-57700f8ca155 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:48.223240 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b02f8-7c00-4d79-9782-57700f8ca155 admin admin] PATH_INFO: `/v3/projects/f3e6d0587b2648fcb9d59ea0e28da9f5` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:48.226289 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b02f8-7c00-4d79-9782-57700f8ca155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e6d0587b2648fcb9d59ea0e28da9f5)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:48.228716 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b02f8-7c00-4d79-9782-57700f8ca155 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:48.380509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-ec8b02f8-7c00-4d79-9782-57700f8ca155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e6d0587b2648fcb9d59ea0e28da9f5', 'request_id': 'req-ec8b02f8-7c00-4d79-9782-57700f8ca155'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:48.415840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-ec8b02f8-7c00-4d79-9782-57700f8ca155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e6d0587b2648fcb9d59ea0e28da9f5', 'request_id': 'req-ec8b02f8-7c00-4d79-9782-57700f8ca155'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:48.456428 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-ec8b02f8-7c00-4d79-9782-57700f8ca155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e6d0587b2648fcb9d59ea0e28da9f5', 'request_id': 'req-ec8b02f8-7c00-4d79-9782-57700f8ca155'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:48.509128 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-ec8b02f8-7c00-4d79-9782-57700f8ca155 admin admin] The token cache is being invalidate because project f3e6d0587b2648fcb9d59ea0e28da9f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:48.509876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-ec8b02f8-7c00-4d79-9782-57700f8ca155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:48.516352 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-ec8b02f8-7c00-4d79-9782-57700f8ca155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:48.524962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 909/1824] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:47 2022] DELETE /identity/v3/projects/f3e6d0587b2648fcb9d59ea0e28da9f5 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:48.525992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a7435-5ff7-4dfc-9db3-4df499fef9c2 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:48.527558 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a7435-5ff7-4dfc-9db3-4df499fef9c2 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:48.528333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a7435-5ff7-4dfc-9db3-4df499fef9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:48.600104 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-803a7435-5ff7-4dfc-9db3-4df499fef9c2 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:48.604548 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-803a7435-5ff7-4dfc-9db3-4df499fef9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:48.792245 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 916/1825] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:48.803033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf7405-9dc3-4bef-99ee-aa5a1e979fd8 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:48.803325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf7405-9dc3-4bef-99ee-aa5a1e979fd8 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:48.803604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf7405-9dc3-4bef-99ee-aa5a1e979fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:48.927139 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-1edf7405-9dc3-4bef-99ee-aa5a1e979fd8 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:48.932859 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-1edf7405-9dc3-4bef-99ee-aa5a1e979fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:48.968687 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a7435-5ff7-4dfc-9db3-4df499fef9c2 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:48.985299 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a7435-5ff7-4dfc-9db3-4df499fef9c2 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:48.985862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 910/1826] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:49.019165 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a325eca-a8e8-46e7-a8b1-4d6d08b39beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:49.021578 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a325eca-a8e8-46e7-a8b1-4d6d08b39beb admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:49.022953 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a325eca-a8e8-46e7-a8b1-4d6d08b39beb admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:49.024842 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a325eca-a8e8-46e7-a8b1-4d6d08b39beb admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:49.026747 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a325eca-a8e8-46e7-a8b1-4d6d08b39beb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:49.029202 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a325eca-a8e8-46e7-a8b1-4d6d08b39beb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:49.036054 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e9039-aa21-41aa-b1bf-795b491c3963 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:49.036238 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e9039-aa21-41aa-b1bf-795b491c3963 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:49.036512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e9039-aa21-41aa-b1bf-795b491c3963 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:49.038266 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 911/1827] 10.222.0.94 () {54 vars in 921 bytes} [Wed Aug 24 04:50:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:50:49.040023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a325eca-a8e8-46e7-a8b1-4d6d08b39beb admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:49.072502 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c7a5c-8191-4e58-8a30-ca528a9c51f2 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:49.073143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c7a5c-8191-4e58-8a30-ca528a9c51f2 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:49.081007 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c7a5c-8191-4e58-8a30-ca528a9c51f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:49.112497 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 917/1828] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:49.114252 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a325eca-a8e8-46e7-a8b1-4d6d08b39beb admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:49.145467 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a325eca-a8e8-46e7-a8b1-4d6d08b39beb admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:49.178301 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf7ddb-66dc-4c09-91df-e4bfafd39b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:49.179370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf7ddb-66dc-4c09-91df-e4bfafd39b58 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:49.179895 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf7ddb-66dc-4c09-91df-e4bfafd39b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:49.180182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf7ddb-66dc-4c09-91df-e4bfafd39b58 admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:49.180894 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf7ddb-66dc-4c09-91df-e4bfafd39b58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:49.181697 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-e67c7a5c-8191-4e58-8a30-ca528a9c51f2 None None] MFA Rules not processed for user `5bdbda2b9c8f48338c5117585a229cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:49.184459 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e67c7a5c-8191-4e58-8a30-ca528a9c51f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:49.204007 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf7ddb-66dc-4c09-91df-e4bfafd39b58 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:49.293784 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 918/1829] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:49 2022] POST /identity/v3/projects => generated 385 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:49.298896 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf7ddb-66dc-4c09-91df-e4bfafd39b58 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:49.320284 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:49.492255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 912/1830] 10.222.0.94 () {58 vars in 1018 bytes} [Wed Aug 24 04:50:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:49.549664 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf7ddb-66dc-4c09-91df-e4bfafd39b58 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:49.567669 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c34f0-535b-4bbb-8105-c0358e98b383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:49.568508 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c34f0-535b-4bbb-8105-c0358e98b383 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:49.568824 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c34f0-535b-4bbb-8105-c0358e98b383 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:49.571809 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c34f0-535b-4bbb-8105-c0358e98b383 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:49.572559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c34f0-535b-4bbb-8105-c0358e98b383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:49.580165 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c34f0-535b-4bbb-8105-c0358e98b383 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:49.656629 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 919/1831] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:49 2022] POST /identity/v3/users => generated 293 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:49.663556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c7a5c-8191-4e58-8a30-ca528a9c51f2 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:49.758800 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c7a5c-8191-4e58-8a30-ca528a9c51f2 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:49.769157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f782f-7904-45ce-816c-63c7ee92321b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:49.769829 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f782f-7904-45ce-816c-63c7ee92321b admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:49.770104 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f782f-7904-45ce-816c-63c7ee92321b admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:49.770381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f782f-7904-45ce-816c-63c7ee92321b admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:49.771042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f782f-7904-45ce-816c-63c7ee92321b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:49.772669 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f782f-7904-45ce-816c-63c7ee92321b admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:49.798914 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 913/1832] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:49.800208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c34f0-535b-4bbb-8105-c0358e98b383 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:49.835273 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c34f0-535b-4bbb-8105-c0358e98b383 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:49.840623 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4058c1-7a69-4a70-b215-7efa8206badf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:49.841314 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4058c1-7a69-4a70-b215-7efa8206badf admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:49.841646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4058c1-7a69-4a70-b215-7efa8206badf admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:49.841926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4058c1-7a69-4a70-b215-7efa8206badf admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:49.842850 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4058c1-7a69-4a70-b215-7efa8206badf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:49.844881 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f782f-7904-45ce-816c-63c7ee92321b admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:49.849629 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-4f3f782f-7904-45ce-816c-63c7ee92321b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:49.859344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4058c1-7a69-4a70-b215-7efa8206badf admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:49.884241 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 920/1833] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:49.894964 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4058c1-7a69-4a70-b215-7efa8206badf admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:49.933774 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4058c1-7a69-4a70-b215-7efa8206badf admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:49.950224 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c8daf-35fe-418b-b1f6-a84f3c2d34bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:49.954872 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c8daf-35fe-418b-b1f6-a84f3c2d34bc admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:49.955203 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c8daf-35fe-418b-b1f6-a84f3c2d34bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:49.955505 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c8daf-35fe-418b-b1f6-a84f3c2d34bc admin admin] PATH_INFO: `/v3/projects/dd5f49dab78c4549bafe15b452756737/users/63ed27f3419641f6b4b7a0235a5d25c2/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:50.027271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:50.034118 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c8daf-35fe-418b-b1f6-a84f3c2d34bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5f49dab78c4549bafe15b452756737, user_id=63ed27f3419641f6b4b7a0235a5d25c2, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:50.044881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c8daf-35fe-418b-b1f6-a84f3c2d34bc admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:50.065271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f782f-7904-45ce-816c-63c7ee92321b admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:50.075640 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 921/1834] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:49 2022] PUT /identity/v3/projects/dd5f49dab78c4549bafe15b452756737/users/63ed27f3419641f6b4b7a0235a5d25c2/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:50.092123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc10f30-5f87-4de2-bc4d-fb63c96e52e7 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:50.092556 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc10f30-5f87-4de2-bc4d-fb63c96e52e7 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:50.092878 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc10f30-5f87-4de2-bc4d-fb63c96e52e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:50.192202 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-acc10f30-5f87-4de2-bc4d-fb63c96e52e7 None None] MFA Rules not processed for user `63ed27f3419641f6b4b7a0235a5d25c2`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:50.194030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-acc10f30-5f87-4de2-bc4d-fb63c96e52e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:50.210821 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1188a6-6c1a-4ba6-aac5-9a0b5db2b721 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:50.212149 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1188a6-6c1a-4ba6-aac5-9a0b5db2b721 service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:50.212648 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1188a6-6c1a-4ba6-aac5-9a0b5db2b721 service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:50.213183 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1188a6-6c1a-4ba6-aac5-9a0b5db2b721 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:50.216583 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-5e1188a6-6c1a-4ba6-aac5-9a0b5db2b721 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:50.382910 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1188a6-6c1a-4ba6-aac5-9a0b5db2b721 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:50.384816 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1188a6-6c1a-4ba6-aac5-9a0b5db2b721 service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:50.425079 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 914/1835] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:50:50.549046 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1188a6-6c1a-4ba6-aac5-9a0b5db2b721 service cinder] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:50.560739 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 922/1836] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:50.686251 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1188a6-6c1a-4ba6-aac5-9a0b5db2b721 service cinder] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:50.698685 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9879d-c1eb-4a0a-b2b5-df660f3f120e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:50.699529 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9879d-c1eb-4a0a-b2b5-df660f3f120e admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:50.699872 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9879d-c1eb-4a0a-b2b5-df660f3f120e admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:50.700208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9879d-c1eb-4a0a-b2b5-df660f3f120e admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:50.701080 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9879d-c1eb-4a0a-b2b5-df660f3f120e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:50.707545 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9879d-c1eb-4a0a-b2b5-df660f3f120e admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:50.779493 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 915/1837] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:50 2022] POST /identity/v3/projects => generated 383 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:50:50.784583 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc10f30-5f87-4de2-bc4d-fb63c96e52e7 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:50.831858 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc10f30-5f87-4de2-bc4d-fb63c96e52e7 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:51.051305 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9879d-c1eb-4a0a-b2b5-df660f3f120e admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:51.056715 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-f8f9879d-c1eb-4a0a-b2b5-df660f3f120e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:51.064111 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:51.102698 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2a313-89da-4891-993f-f5d9f2f4ac3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:51.104570 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2a313-89da-4891-993f-f5d9f2f4ac3f admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:51.110687 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2a313-89da-4891-993f-f5d9f2f4ac3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:51.112199 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2a313-89da-4891-993f-f5d9f2f4ac3f admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:51.113924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2a313-89da-4891-993f-f5d9f2f4ac3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:51.116946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2a313-89da-4891-993f-f5d9f2f4ac3f admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:51.167037 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 923/1838] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:50 2022] POST /identity/v3/users => generated 298 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:50:51.168845 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2a313-89da-4891-993f-f5d9f2f4ac3f admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:51.210150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2a313-89da-4891-993f-f5d9f2f4ac3f admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:51.236358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd87172-6537-4781-bdd0-64f2ede4625c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:51.237442 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd87172-6537-4781-bdd0-64f2ede4625c admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:51.238978 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd87172-6537-4781-bdd0-64f2ede4625c admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:51.240523 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd87172-6537-4781-bdd0-64f2ede4625c admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:51.240523 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd87172-6537-4781-bdd0-64f2ede4625c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:51.248004 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd87172-6537-4781-bdd0-64f2ede4625c admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:51.273638 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:51.304142 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 924/1839] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:51.305165 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd87172-6537-4781-bdd0-64f2ede4625c admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:51.354733 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd87172-6537-4781-bdd0-64f2ede4625c admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:51.368130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228458c-df33-4ff1-95b8-ecfdd351aff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:51.371183 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228458c-df33-4ff1-95b8-ecfdd351aff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:51.373442 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228458c-df33-4ff1-95b8-ecfdd351aff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:51.376313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228458c-df33-4ff1-95b8-ecfdd351aff4 admin admin] PATH_INFO: `/v3/projects/44241f842c8243c0b76f32fb012f9d34/users/6eeb37ac45d84045b852a1fee861dcbe/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:51.430101 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228458c-df33-4ff1-95b8-ecfdd351aff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44241f842c8243c0b76f32fb012f9d34, user_id=6eeb37ac45d84045b852a1fee861dcbe, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:51.436076 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228458c-df33-4ff1-95b8-ecfdd351aff4 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:51.441059 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9879d-c1eb-4a0a-b2b5-df660f3f120e admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:51.463759 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded07dc-a918-4ef9-a5f0-a9b9ea167bce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:51.466536 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded07dc-a918-4ef9-a5f0-a9b9ea167bce service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:51.466821 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded07dc-a918-4ef9-a5f0-a9b9ea167bce service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:51.467098 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded07dc-a918-4ef9-a5f0-a9b9ea167bce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:51.495393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 925/1840] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:51 2022] PUT /identity/v3/projects/44241f842c8243c0b76f32fb012f9d34/users/6eeb37ac45d84045b852a1fee861dcbe/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:51.514143 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228458c-df33-4ff1-95b8-ecfdd351aff4 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:51.537000 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded07dc-a918-4ef9-a5f0-a9b9ea167bce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:51.549624 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded07dc-a918-4ef9-a5f0-a9b9ea167bce service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:51.635230 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 916/1841] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:51.990906 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228458c-df33-4ff1-95b8-ecfdd351aff4 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:52.021922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c5f5d-9f3d-4cf3-aeff-65f1a6292ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:52.023169 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c5f5d-9f3d-4cf3-aeff-65f1a6292ccc admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:52.030042 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c5f5d-9f3d-4cf3-aeff-65f1a6292ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:52.030846 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c5f5d-9f3d-4cf3-aeff-65f1a6292ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:52.034889 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c5f5d-9f3d-4cf3-aeff-65f1a6292ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:52.044085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c5f5d-9f3d-4cf3-aeff-65f1a6292ccc admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:52.107751 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded07dc-a918-4ef9-a5f0-a9b9ea167bce service nova] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:52.108031 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 926/1842] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 608 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:52.153202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded07dc-a918-4ef9-a5f0-a9b9ea167bce service nova] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:52.194864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0909b-6a67-4397-95b2-775b76cc5d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:52.198742 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0909b-6a67-4397-95b2-775b76cc5d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:52.199034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0909b-6a67-4397-95b2-775b76cc5d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:52.203629 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0909b-6a67-4397-95b2-775b76cc5d86 admin admin] PATH_INFO: `/v3/projects/44241f842c8243c0b76f32fb012f9d34/users/6eeb37ac45d84045b852a1fee861dcbe/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:52.213219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0909b-6a67-4397-95b2-775b76cc5d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44241f842c8243c0b76f32fb012f9d34, user_id=6eeb37ac45d84045b852a1fee861dcbe, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:52.219162 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0909b-6a67-4397-95b2-775b76cc5d86 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:52.307187 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 917/1843] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:52 2022] PUT /identity/v3/projects/44241f842c8243c0b76f32fb012f9d34/users/6eeb37ac45d84045b852a1fee861dcbe/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:52.325162 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d5247-9b8b-4f69-8030-0381bb3fd7f8 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:52.325929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d5247-9b8b-4f69-8030-0381bb3fd7f8 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:52.326752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d5247-9b8b-4f69-8030-0381bb3fd7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:52.410385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-3d7d5247-9b8b-4f69-8030-0381bb3fd7f8 None None] MFA Rules not processed for user `6eeb37ac45d84045b852a1fee861dcbe`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:52.411815 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-3d7d5247-9b8b-4f69-8030-0381bb3fd7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:52.817600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 927/1844] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:52.877070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0909b-6a67-4397-95b2-775b76cc5d86 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:52.880661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-1ca0909b-6a67-4397-95b2-775b76cc5d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:53.162286 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0909b-6a67-4397-95b2-775b76cc5d86 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:53.174125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a9f21-60d5-4d84-99e8-b6928e64858c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:53.174800 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a9f21-60d5-4d84-99e8-b6928e64858c service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:53.177009 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a9f21-60d5-4d84-99e8-b6928e64858c service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:53.177009 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a9f21-60d5-4d84-99e8-b6928e64858c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:53.209457 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a9f21-60d5-4d84-99e8-b6928e64858c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:53.216992 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a9f21-60d5-4d84-99e8-b6928e64858c service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:53.268652 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 918/1845] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:53.328757 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d5247-9b8b-4f69-8030-0381bb3fd7f8 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:53.407018 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:53.438327 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a9f21-60d5-4d84-99e8-b6928e64858c service cinder] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:53.440522 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-a44a9f21-60d5-4d84-99e8-b6928e64858c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:53.530775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d5247-9b8b-4f69-8030-0381bb3fd7f8 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:53.536459 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef191a-7036-4bb9-81e6-58a35d963da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:53.537186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef191a-7036-4bb9-81e6-58a35d963da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:53.537614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef191a-7036-4bb9-81e6-58a35d963da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:53.537959 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef191a-7036-4bb9-81e6-58a35d963da3 admin admin] PATH_INFO: `/v3/users/63ed27f3419641f6b4b7a0235a5d25c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:53.544550 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef191a-7036-4bb9-81e6-58a35d963da3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63ed27f3419641f6b4b7a0235a5d25c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:53.552067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef191a-7036-4bb9-81e6-58a35d963da3 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:53.603187 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a9f21-60d5-4d84-99e8-b6928e64858c service cinder] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:53.613604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a031c-bb47-4af3-9810-3ffbcd5b306f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:53.615175 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a031c-bb47-4af3-9810-3ffbcd5b306f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:53.616085 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a031c-bb47-4af3-9810-3ffbcd5b306f admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:53.616581 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a031c-bb47-4af3-9810-3ffbcd5b306f admin admin] PATH_INFO: `/v3/users/eed86a3b2e1246b594d8b43fd0dfc075` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:53.620120 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a031c-bb47-4af3-9810-3ffbcd5b306f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed86a3b2e1246b594d8b43fd0dfc075)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:53.624948 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a031c-bb47-4af3-9810-3ffbcd5b306f admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:53.695016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-0cef191a-7036-4bb9-81e6-58a35d963da3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63ed27f3419641f6b4b7a0235a5d25c2'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:53.737904 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-0cef191a-7036-4bb9-81e6-58a35d963da3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63ed27f3419641f6b4b7a0235a5d25c2'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:53.749740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-0cef191a-7036-4bb9-81e6-58a35d963da3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63ed27f3419641f6b4b7a0235a5d25c2'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:53.750563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-0cef191a-7036-4bb9-81e6-58a35d963da3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63ed27f3419641f6b4b7a0235a5d25c2'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:53.772725 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-0cef191a-7036-4bb9-81e6-58a35d963da3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63ed27f3419641f6b4b7a0235a5d25c2'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:53.774641 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-715a031c-bb47-4af3-9810-3ffbcd5b306f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed86a3b2e1246b594d8b43fd0dfc075'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:53.789377 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 928/1846] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:53 2022] DELETE /identity/v3/users/63ed27f3419641f6b4b7a0235a5d25c2 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:53.798126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f8884-69e9-476f-986e-a0743dd0962c None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:53.798412 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f8884-69e9-476f-986e-a0743dd0962c None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:53.798753 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f8884-69e9-476f-986e-a0743dd0962c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:53.815857 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-715a031c-bb47-4af3-9810-3ffbcd5b306f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed86a3b2e1246b594d8b43fd0dfc075'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:53.829489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:53.835966 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-715a031c-bb47-4af3-9810-3ffbcd5b306f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed86a3b2e1246b594d8b43fd0dfc075'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:53.865688 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-715a031c-bb47-4af3-9810-3ffbcd5b306f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed86a3b2e1246b594d8b43fd0dfc075'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:53.867798 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-421f8884-69e9-476f-986e-a0743dd0962c None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:53.875673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-421f8884-69e9-476f-986e-a0743dd0962c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:53.880517 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-715a031c-bb47-4af3-9810-3ffbcd5b306f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed86a3b2e1246b594d8b43fd0dfc075'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:53.898776 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 919/1847] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:53 2022] DELETE /identity/v3/users/eed86a3b2e1246b594d8b43fd0dfc075 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:53.900913 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbd33f-75ea-46f0-af7f-daebad39f1fc None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:53.901509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbd33f-75ea-46f0-af7f-daebad39f1fc None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:53.902040 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbd33f-75ea-46f0-af7f-daebad39f1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:53.957238 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-93dbd33f-75ea-46f0-af7f-daebad39f1fc None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:53.961485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-93dbd33f-75ea-46f0-af7f-daebad39f1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:54.055802 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 929/1848] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:54.117523 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f8884-69e9-476f-986e-a0743dd0962c None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:54.119560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-421f8884-69e9-476f-986e-a0743dd0962c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:54.158748 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 920/1849] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:54.238847 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:54.245144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbd33f-75ea-46f0-af7f-daebad39f1fc None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:54.251098 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-93dbd33f-75ea-46f0-af7f-daebad39f1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:54.294252 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f8884-69e9-476f-986e-a0743dd0962c None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:54.478100 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbd33f-75ea-46f0-af7f-daebad39f1fc None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:54.489048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80d901-4a68-4e43-ab50-17317099ff1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:54.489696 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80d901-4a68-4e43-ab50-17317099ff1e service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:54.489976 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80d901-4a68-4e43-ab50-17317099ff1e service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:54.490244 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80d901-4a68-4e43-ab50-17317099ff1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:54.526983 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80d901-4a68-4e43-ab50-17317099ff1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:54.531714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80d901-4a68-4e43-ab50-17317099ff1e service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:54.573884 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5e622-1f54-408e-a862-9eedc3c36ab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:54.578807 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 921/1850] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:54.586746 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5e622-1f54-408e-a862-9eedc3c36ab5 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:54.587254 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5e622-1f54-408e-a862-9eedc3c36ab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:54.587581 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5e622-1f54-408e-a862-9eedc3c36ab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:54.635259 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5e622-1f54-408e-a862-9eedc3c36ab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:54.639318 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5e622-1f54-408e-a862-9eedc3c36ab5 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:54.691603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 930/1851] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:55.574688 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fec53-3a7f-4703-ac82-67b0e0ccbbb0 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:55.575594 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fec53-3a7f-4703-ac82-67b0e0ccbbb0 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:55.575594 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fec53-3a7f-4703-ac82-67b0e0ccbbb0 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:55.577038 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 922/1852] 10.222.0.94 () {54 vars in 921 bytes} [Wed Aug 24 04:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:50:55.794740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd667ba-eda9-449a-83cf-0736bd68b385 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:55.795721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd667ba-eda9-449a-83cf-0736bd68b385 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:55.795721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd667ba-eda9-449a-83cf-0736bd68b385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:55.863115 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-0cd667ba-eda9-449a-83cf-0736bd68b385 None None] MFA Rules not processed for user `5bdbda2b9c8f48338c5117585a229cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:55.869839 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-0cd667ba-eda9-449a-83cf-0736bd68b385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:56.105256 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 931/1853] 10.222.0.94 () {58 vars in 1018 bytes} [Wed Aug 24 04:50:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:56.280760 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897fec53-3a7f-4703-ac82-67b0e0ccbbb0 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:56.284198 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-897fec53-3a7f-4703-ac82-67b0e0ccbbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:56.347811 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897fec53-3a7f-4703-ac82-67b0e0ccbbb0 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:56.369762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129f879-684f-4372-b333-96c42705b957 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:56.370410 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129f879-684f-4372-b333-96c42705b957 service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:56.370808 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129f879-684f-4372-b333-96c42705b957 service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:56.371327 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129f879-684f-4372-b333-96c42705b957 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:56.394387 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129f879-684f-4372-b333-96c42705b957 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:56.396405 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129f879-684f-4372-b333-96c42705b957 service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:56.442427 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 923/1854] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:56.676293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd667ba-eda9-449a-83cf-0736bd68b385 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:56.679050 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-0cd667ba-eda9-449a-83cf-0736bd68b385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:56.707260 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd667ba-eda9-449a-83cf-0736bd68b385 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:56.724858 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34c786-45ad-4a69-8045-ecadd68c5a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:56.726024 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34c786-45ad-4a69-8045-ecadd68c5a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:56.726513 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34c786-45ad-4a69-8045-ecadd68c5a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:56.727209 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34c786-45ad-4a69-8045-ecadd68c5a65 admin admin] PATH_INFO: `/v3/projects/e798adfb80944c69bdc18cddda973b14` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:56.728722 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34c786-45ad-4a69-8045-ecadd68c5a65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e798adfb80944c69bdc18cddda973b14)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:56.731152 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34c786-45ad-4a69-8045-ecadd68c5a65 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:56.873224 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ba34c786-45ad-4a69-8045-ecadd68c5a65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e798adfb80944c69bdc18cddda973b14', 'request_id': 'req-ba34c786-45ad-4a69-8045-ecadd68c5a65'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:56.893743 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ba34c786-45ad-4a69-8045-ecadd68c5a65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e798adfb80944c69bdc18cddda973b14', 'request_id': 'req-ba34c786-45ad-4a69-8045-ecadd68c5a65'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:56.933202 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ba34c786-45ad-4a69-8045-ecadd68c5a65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e798adfb80944c69bdc18cddda973b14', 'request_id': 'req-ba34c786-45ad-4a69-8045-ecadd68c5a65'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:56.948928 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ba34c786-45ad-4a69-8045-ecadd68c5a65 admin admin] The token cache is being invalidate because project e798adfb80944c69bdc18cddda973b14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:56.949713 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ba34c786-45ad-4a69-8045-ecadd68c5a65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:56.950807 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ba34c786-45ad-4a69-8045-ecadd68c5a65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:56.952826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 932/1855] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:56 2022] DELETE /identity/v3/projects/e798adfb80944c69bdc18cddda973b14 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:56.958409 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129f879-684f-4372-b333-96c42705b957 service nova] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:56.984246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129f879-684f-4372-b333-96c42705b957 service nova] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:57.146215 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e1b95-fc05-41d9-955b-43302a87d0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:57.147284 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e1b95-fc05-41d9-955b-43302a87d0cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:57.148578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e1b95-fc05-41d9-955b-43302a87d0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:57.149077 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e1b95-fc05-41d9-955b-43302a87d0cb admin admin] PATH_INFO: `/v3/users/d60ee45cfac9401aa5c5af905dfeb54c` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:57.150751 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e1b95-fc05-41d9-955b-43302a87d0cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d60ee45cfac9401aa5c5af905dfeb54c)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:57.153878 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e1b95-fc05-41d9-955b-43302a87d0cb admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:57.157118 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:57.211099 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34c786-45ad-4a69-8045-ecadd68c5a65 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:57.213201 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ba34c786-45ad-4a69-8045-ecadd68c5a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:57.242910 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34c786-45ad-4a69-8045-ecadd68c5a65 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:57.265395 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c4813-29f7-4373-96a1-f2f167ff341e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:57.270026 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c4813-29f7-4373-96a1-f2f167ff341e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:57.271894 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c4813-29f7-4373-96a1-f2f167ff341e admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:57.272347 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c4813-29f7-4373-96a1-f2f167ff341e admin admin] PATH_INFO: `/v3/projects/dd5f49dab78c4549bafe15b452756737` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:57.279116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c4813-29f7-4373-96a1-f2f167ff341e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd5f49dab78c4549bafe15b452756737)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:57.289453 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c4813-29f7-4373-96a1-f2f167ff341e admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:57.317430 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-087e1b95-fc05-41d9-955b-43302a87d0cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd60ee45cfac9401aa5c5af905dfeb54c'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:57.318241 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-087e1b95-fc05-41d9-955b-43302a87d0cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd60ee45cfac9401aa5c5af905dfeb54c'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:57.320978 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:57.337813 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-087e1b95-fc05-41d9-955b-43302a87d0cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd60ee45cfac9401aa5c5af905dfeb54c'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:57.382084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-087e1b95-fc05-41d9-955b-43302a87d0cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd60ee45cfac9401aa5c5af905dfeb54c'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:57.401804 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-087e1b95-fc05-41d9-955b-43302a87d0cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd60ee45cfac9401aa5c5af905dfeb54c'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:57.410127 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-267c4813-29f7-4373-96a1-f2f167ff341e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd5f49dab78c4549bafe15b452756737', 'request_id': 'req-267c4813-29f7-4373-96a1-f2f167ff341e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:57.420084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 924/1856] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:56 2022] DELETE /identity/v3/users/d60ee45cfac9401aa5c5af905dfeb54c => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:57.420481 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-267c4813-29f7-4373-96a1-f2f167ff341e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd5f49dab78c4549bafe15b452756737', 'request_id': 'req-267c4813-29f7-4373-96a1-f2f167ff341e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:57.434232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-267c4813-29f7-4373-96a1-f2f167ff341e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd5f49dab78c4549bafe15b452756737', 'request_id': 'req-267c4813-29f7-4373-96a1-f2f167ff341e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:57.454408 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-267c4813-29f7-4373-96a1-f2f167ff341e admin admin] The token cache is being invalidate because project dd5f49dab78c4549bafe15b452756737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:57.454791 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-267c4813-29f7-4373-96a1-f2f167ff341e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:57.455617 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-267c4813-29f7-4373-96a1-f2f167ff341e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:57.463177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 933/1857] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:57 2022] DELETE /identity/v3/projects/dd5f49dab78c4549bafe15b452756737 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:57.464724 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e1b95-fc05-41d9-955b-43302a87d0cb admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:57.468598 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-087e1b95-fc05-41d9-955b-43302a87d0cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:57.651425 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e1b95-fc05-41d9-955b-43302a87d0cb admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:57.659927 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b325e60-b6ec-4511-9763-a7f132df2c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:57.660532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b325e60-b6ec-4511-9763-a7f132df2c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:57.660885 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b325e60-b6ec-4511-9763-a7f132df2c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:57.661229 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b325e60-b6ec-4511-9763-a7f132df2c28 admin admin] PATH_INFO: `/v3/users/6eeb37ac45d84045b852a1fee861dcbe` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:57.662684 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b325e60-b6ec-4511-9763-a7f132df2c28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eeb37ac45d84045b852a1fee861dcbe)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:57.664756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b325e60-b6ec-4511-9763-a7f132df2c28 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:57.823712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2b325e60-b6ec-4511-9763-a7f132df2c28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eeb37ac45d84045b852a1fee861dcbe'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:57.825875 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2b325e60-b6ec-4511-9763-a7f132df2c28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eeb37ac45d84045b852a1fee861dcbe'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:57.850793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2b325e60-b6ec-4511-9763-a7f132df2c28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eeb37ac45d84045b852a1fee861dcbe'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:57.882668 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2b325e60-b6ec-4511-9763-a7f132df2c28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eeb37ac45d84045b852a1fee861dcbe'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:57.893818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2b325e60-b6ec-4511-9763-a7f132df2c28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eeb37ac45d84045b852a1fee861dcbe'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:57.895948 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:57.904269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 925/1858] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:57 2022] DELETE /identity/v3/users/6eeb37ac45d84045b852a1fee861dcbe => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:57.966009 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c4813-29f7-4373-96a1-f2f167ff341e admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:57.968110 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-267c4813-29f7-4373-96a1-f2f167ff341e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:58.041106 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c4813-29f7-4373-96a1-f2f167ff341e admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:58.107913 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af75269-3b9d-4e37-b15c-f1de39ac4c2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:58.109566 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af75269-3b9d-4e37-b15c-f1de39ac4c2d service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:58.110015 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af75269-3b9d-4e37-b15c-f1de39ac4c2d service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:58.110471 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af75269-3b9d-4e37-b15c-f1de39ac4c2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:58.112857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-8af75269-3b9d-4e37-b15c-f1de39ac4c2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:58.225154 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af75269-3b9d-4e37-b15c-f1de39ac4c2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:58.228200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af75269-3b9d-4e37-b15c-f1de39ac4c2d service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:58.266999 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 934/1859] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:50:58.771915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b325e60-b6ec-4511-9763-a7f132df2c28 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:58.774434 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-2b325e60-b6ec-4511-9763-a7f132df2c28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:58.938276 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b325e60-b6ec-4511-9763-a7f132df2c28 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:58.949393 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff046869-292f-4f8a-a16b-d6106fa68b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:58.951060 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff046869-292f-4f8a-a16b-d6106fa68b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:58.952731 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff046869-292f-4f8a-a16b-d6106fa68b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:58.953285 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff046869-292f-4f8a-a16b-d6106fa68b82 admin admin] PATH_INFO: `/v3/projects/4d0a1040a9dc4a3584f55a8334f98153` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:58.957263 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff046869-292f-4f8a-a16b-d6106fa68b82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d0a1040a9dc4a3584f55a8334f98153)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:58.966413 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff046869-292f-4f8a-a16b-d6106fa68b82 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:58.974543 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af75269-3b9d-4e37-b15c-f1de39ac4c2d service cinder] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:58.976020 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-8af75269-3b9d-4e37-b15c-f1de39ac4c2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:59.021141 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af75269-3b9d-4e37-b15c-f1de39ac4c2d service cinder] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:59.067238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cce690-2f0e-4e85-ba8d-b1b0cca1302f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:59.070536 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cce690-2f0e-4e85-ba8d-b1b0cca1302f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:59.071052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cce690-2f0e-4e85-ba8d-b1b0cca1302f admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:59.071943 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cce690-2f0e-4e85-ba8d-b1b0cca1302f admin admin] PATH_INFO: `/v3/projects/44241f842c8243c0b76f32fb012f9d34` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:59.081596 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cce690-2f0e-4e85-ba8d-b1b0cca1302f admin admin] RBAC: Authorizing `identity:delete_project(project_id=44241f842c8243c0b76f32fb012f9d34)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:59.090073 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cce690-2f0e-4e85-ba8d-b1b0cca1302f admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:59.109700 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-ff046869-292f-4f8a-a16b-d6106fa68b82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d0a1040a9dc4a3584f55a8334f98153', 'request_id': 'req-ff046869-292f-4f8a-a16b-d6106fa68b82'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:59.118951 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:59.142032 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-ff046869-292f-4f8a-a16b-d6106fa68b82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d0a1040a9dc4a3584f55a8334f98153', 'request_id': 'req-ff046869-292f-4f8a-a16b-d6106fa68b82'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:59.161579 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-ff046869-292f-4f8a-a16b-d6106fa68b82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d0a1040a9dc4a3584f55a8334f98153', 'request_id': 'req-ff046869-292f-4f8a-a16b-d6106fa68b82'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:59.210492 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-ff046869-292f-4f8a-a16b-d6106fa68b82 admin admin] The token cache is being invalidate because project 4d0a1040a9dc4a3584f55a8334f98153 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:59.211085 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-ff046869-292f-4f8a-a16b-d6106fa68b82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:59.211995 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-ff046869-292f-4f8a-a16b-d6106fa68b82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:59.219424 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 926/1860] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:58 2022] DELETE /identity/v3/projects/4d0a1040a9dc4a3584f55a8334f98153 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:59.221847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24959988-2693-4a1e-bb60-67da1a2beaaa None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:59.222924 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24959988-2693-4a1e-bb60-67da1a2beaaa None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:59.223965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24959988-2693-4a1e-bb60-67da1a2beaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:59.234863 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e6cce690-2f0e-4e85-ba8d-b1b0cca1302f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44241f842c8243c0b76f32fb012f9d34', 'request_id': 'req-e6cce690-2f0e-4e85-ba8d-b1b0cca1302f'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:59.247889 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e6cce690-2f0e-4e85-ba8d-b1b0cca1302f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44241f842c8243c0b76f32fb012f9d34', 'request_id': 'req-e6cce690-2f0e-4e85-ba8d-b1b0cca1302f'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:59.262412 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e6cce690-2f0e-4e85-ba8d-b1b0cca1302f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44241f842c8243c0b76f32fb012f9d34', 'request_id': 'req-e6cce690-2f0e-4e85-ba8d-b1b0cca1302f'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:59.279647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e6cce690-2f0e-4e85-ba8d-b1b0cca1302f admin admin] The token cache is being invalidate because project 44241f842c8243c0b76f32fb012f9d34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:59.280702 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e6cce690-2f0e-4e85-ba8d-b1b0cca1302f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:59.281795 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e6cce690-2f0e-4e85-ba8d-b1b0cca1302f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:59.285593 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-24959988-2693-4a1e-bb60-67da1a2beaaa None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:59.286792 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 935/1861] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:58 2022] DELETE /identity/v3/projects/44241f842c8243c0b76f32fb012f9d34 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:59.291333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-24959988-2693-4a1e-bb60-67da1a2beaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:59.294277 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe4306-be3c-4e83-bbdc-320660792696 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:59.295289 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe4306-be3c-4e83-bbdc-320660792696 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:59.296695 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe4306-be3c-4e83-bbdc-320660792696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:59.329981 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-31fe4306-be3c-4e83-bbdc-320660792696 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:59.331833 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-31fe4306-be3c-4e83-bbdc-320660792696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:59.439283 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 927/1862] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:59.447181 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e66ec-cb79-4c46-991a-61a6980ffb9a None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:59.447468 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e66ec-cb79-4c46-991a-61a6980ffb9a None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:59.447743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e66ec-cb79-4c46-991a-61a6980ffb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:59.469760 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 936/1863] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:59.470618 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aeb491-74c6-4c31-88ed-ab3e28f95030 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:59.470913 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aeb491-74c6-4c31-88ed-ab3e28f95030 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:59.471261 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aeb491-74c6-4c31-88ed-ab3e28f95030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:59.498775 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-de0e66ec-cb79-4c46-991a-61a6980ffb9a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:59.500628 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-de0e66ec-cb79-4c46-991a-61a6980ffb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:59.503977 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-27aeb491-74c6-4c31-88ed-ab3e28f95030 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:59.505519 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-27aeb491-74c6-4c31-88ed-ab3e28f95030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:59.517135 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 928/1864] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:59.517338 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 937/1865] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:59.518591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e66ec-cb79-4c46-991a-61a6980ffb9a None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:59.524721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aeb491-74c6-4c31-88ed-ab3e28f95030 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:59.532424 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e66ec-cb79-4c46-991a-61a6980ffb9a None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:59.536574 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aeb491-74c6-4c31-88ed-ab3e28f95030 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:59.543862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff72e95-00c8-4eff-a4b4-b190e36c09e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:59.544588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff72e95-00c8-4eff-a4b4-b190e36c09e5 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:59.544937 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff72e95-00c8-4eff-a4b4-b190e36c09e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:59.545357 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff72e95-00c8-4eff-a4b4-b190e36c09e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:59.546327 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff72e95-00c8-4eff-a4b4-b190e36c09e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:59.546895 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff72e95-00c8-4eff-a4b4-b190e36c09e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:59.548638 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff72e95-00c8-4eff-a4b4-b190e36c09e5 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:59.551274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627d7d2-16f6-4f29-886e-dbd763293fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:59.552695 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627d7d2-16f6-4f29-886e-dbd763293fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:59.554347 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627d7d2-16f6-4f29-886e-dbd763293fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:59.555169 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627d7d2-16f6-4f29-886e-dbd763293fa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:59.556640 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627d7d2-16f6-4f29-886e-dbd763293fa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:59.557443 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627d7d2-16f6-4f29-886e-dbd763293fa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:59.561359 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627d7d2-16f6-4f29-886e-dbd763293fa5 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:59.579113 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 929/1866] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:59.584577 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff72e95-00c8-4eff-a4b4-b190e36c09e5 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:59.593621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 938/1867] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:59.600576 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627d7d2-16f6-4f29-886e-dbd763293fa5 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:59.612548 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627d7d2-16f6-4f29-886e-dbd763293fa5 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:59.621952 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66aefd-0f81-4945-a98c-94a75bab5817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:59.623124 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66aefd-0f81-4945-a98c-94a75bab5817 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:59.623523 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66aefd-0f81-4945-a98c-94a75bab5817 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:59.624042 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66aefd-0f81-4945-a98c-94a75bab5817 admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:59.625552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66aefd-0f81-4945-a98c-94a75bab5817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:59.629908 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66aefd-0f81-4945-a98c-94a75bab5817 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:59.632427 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff72e95-00c8-4eff-a4b4-b190e36c09e5 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:59.642897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f80cd2-d5e6-402f-a8db-0f50e5b687bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:59.644345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f80cd2-d5e6-402f-a8db-0f50e5b687bf admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:59.644876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f80cd2-d5e6-402f-a8db-0f50e5b687bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:59.645630 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f80cd2-d5e6-402f-a8db-0f50e5b687bf admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:59.646850 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f80cd2-d5e6-402f-a8db-0f50e5b687bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:59.650123 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f80cd2-d5e6-402f-a8db-0f50e5b687bf admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:59.662506 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:59.729122 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 939/1868] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:59 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:59.735683 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 930/1869] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:59 2022] POST /identity/v3/projects => generated 409 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:50:59.738180 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66aefd-0f81-4945-a98c-94a75bab5817 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:59.741837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f80cd2-d5e6-402f-a8db-0f50e5b687bf admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:59.841514 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:59.871683 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66aefd-0f81-4945-a98c-94a75bab5817 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:59.888795 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f80cd2-d5e6-402f-a8db-0f50e5b687bf admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:59.890824 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514c008-c879-426a-825d-0abd39e6e128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:59.892119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514c008-c879-426a-825d-0abd39e6e128 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:59.892512 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514c008-c879-426a-825d-0abd39e6e128 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:59.893060 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514c008-c879-426a-825d-0abd39e6e128 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:59.894188 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8514c008-c879-426a-825d-0abd39e6e128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:59.897857 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436b455-642e-47f1-9914-4e0fabb156e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:59.898285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8514c008-c879-426a-825d-0abd39e6e128 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:59.898746 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436b455-642e-47f1-9914-4e0fabb156e9 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:59.899133 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436b455-642e-47f1-9914-4e0fabb156e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:59.899497 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436b455-642e-47f1-9914-4e0fabb156e9 admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:59.900357 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436b455-642e-47f1-9914-4e0fabb156e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:59.902835 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436b455-642e-47f1-9914-4e0fabb156e9 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:59.945441 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 931/1871] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:59 2022] POST /identity/v3/users => generated 305 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:50:59.949687 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436b455-642e-47f1-9914-4e0fabb156e9 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:59.951445 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 940/1871] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:59 2022] POST /identity/v3/users => generated 294 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:59.956742 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514c008-c879-426a-825d-0abd39e6e128 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:59.964649 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436b455-642e-47f1-9914-4e0fabb156e9 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:59.970747 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9fc69-84e5-414e-bd4a-16500558e8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:59.971421 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9fc69-84e5-414e-bd4a-16500558e8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:59.971727 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9fc69-84e5-414e-bd4a-16500558e8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:59.972099 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9fc69-84e5-414e-bd4a-16500558e8b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:59.972783 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514c008-c879-426a-825d-0abd39e6e128 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:59.972957 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9fc69-84e5-414e-bd4a-16500558e8b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:59.974728 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9fc69-84e5-414e-bd4a-16500558e8b4 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:59.980509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3a753-53fc-4d98-a4dc-37da7f3feb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:59.982790 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3a753-53fc-4d98-a4dc-37da7f3feb01 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:59.983346 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3a753-53fc-4d98-a4dc-37da7f3feb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:59.983827 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3a753-53fc-4d98-a4dc-37da7f3feb01 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:59.984670 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3a753-53fc-4d98-a4dc-37da7f3feb01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:59.987212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3a753-53fc-4d98-a4dc-37da7f3feb01 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:59.990127 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 932/1872] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:59.994165 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9fc69-84e5-414e-bd4a-16500558e8b4 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:00.004601 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 941/1873] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:00.009038 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3a753-53fc-4d98-a4dc-37da7f3feb01 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:00.010306 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9fc69-84e5-414e-bd4a-16500558e8b4 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:00.016368 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527372bc-03a5-4207-9d21-5af8c88c33ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:00.017003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527372bc-03a5-4207-9d21-5af8c88c33ed admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:00.017387 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527372bc-03a5-4207-9d21-5af8c88c33ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:00.017697 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527372bc-03a5-4207-9d21-5af8c88c33ed admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:00.018361 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527372bc-03a5-4207-9d21-5af8c88c33ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:00.020029 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527372bc-03a5-4207-9d21-5af8c88c33ed admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:00.029534 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3a753-53fc-4d98-a4dc-37da7f3feb01 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:00.038075 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 933/1874] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:51:00.040092 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527372bc-03a5-4207-9d21-5af8c88c33ed admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:00.044954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9f31b-ec25-4f03-a968-45ead888600a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:00.047521 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9f31b-ec25-4f03-a968-45ead888600a admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:00.047971 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9f31b-ec25-4f03-a968-45ead888600a admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:00.048266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9f31b-ec25-4f03-a968-45ead888600a admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:00.049141 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9f31b-ec25-4f03-a968-45ead888600a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:00.051221 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9f31b-ec25-4f03-a968-45ead888600a admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:00.055931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527372bc-03a5-4207-9d21-5af8c88c33ed admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:00.062842 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a66e54-5a51-464a-875c-9f7cf7f50b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:00.063529 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a66e54-5a51-464a-875c-9f7cf7f50b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:00.063812 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a66e54-5a51-464a-875c-9f7cf7f50b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:00.064882 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a66e54-5a51-464a-875c-9f7cf7f50b97 admin admin] PATH_INFO: `/v3/projects/721c16043f624def920592ab340f19eb/users/1f2e204d89304083921180275387922c/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:00.071348 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 942/1875] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:51:00.072916 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9f31b-ec25-4f03-a968-45ead888600a admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:00.084306 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9f31b-ec25-4f03-a968-45ead888600a admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:00.084858 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a66e54-5a51-464a-875c-9f7cf7f50b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=721c16043f624def920592ab340f19eb, user_id=1f2e204d89304083921180275387922c, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:00.087607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a66e54-5a51-464a-875c-9f7cf7f50b97 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:00.090227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5680d-8d33-42af-84e0-463b6e6adf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:00.090996 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5680d-8d33-42af-84e0-463b6e6adf02 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:00.091351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5680d-8d33-42af-84e0-463b6e6adf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:00.091693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5680d-8d33-42af-84e0-463b6e6adf02 admin admin] PATH_INFO: `/v3/projects/22f6cf536e97448f820e8fabed7ef2ad/users/ec69d412a7954658921341f370c4d627/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:00.117220 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 934/1876] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:00 2022] PUT /identity/v3/projects/721c16043f624def920592ab340f19eb/users/1f2e204d89304083921180275387922c/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:00.120048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1feef7-7896-411d-aa8f-3c29571e1c52 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:00.120374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1feef7-7896-411d-aa8f-3c29571e1c52 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:00.120660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1feef7-7896-411d-aa8f-3c29571e1c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:00.127157 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5680d-8d33-42af-84e0-463b6e6adf02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f6cf536e97448f820e8fabed7ef2ad, user_id=ec69d412a7954658921341f370c4d627, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:00.134015 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5680d-8d33-42af-84e0-463b6e6adf02 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:00.160726 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 943/1877] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:00 2022] PUT /identity/v3/projects/22f6cf536e97448f820e8fabed7ef2ad/users/ec69d412a7954658921341f370c4d627/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:00.162959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-9e1feef7-7896-411d-aa8f-3c29571e1c52 None None] MFA Rules not processed for user `1f2e204d89304083921180275387922c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:00.164350 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-9e1feef7-7896-411d-aa8f-3c29571e1c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:00.175155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf6446-177c-4fa0-8d8d-6c4ce11eede1 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:00.175622 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf6446-177c-4fa0-8d8d-6c4ce11eede1 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:00.176088 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf6446-177c-4fa0-8d8d-6c4ce11eede1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:00.211894 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-34bf6446-177c-4fa0-8d8d-6c4ce11eede1 None None] MFA Rules not processed for user `ec69d412a7954658921341f370c4d627`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:00.213218 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-34bf6446-177c-4fa0-8d8d-6c4ce11eede1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:00.268113 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 935/1878] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:00.272283 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1feef7-7896-411d-aa8f-3c29571e1c52 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:00.326410 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:00.367454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 944/1879] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:00 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:00.374901 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf6446-177c-4fa0-8d8d-6c4ce11eede1 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:00.429600 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1feef7-7896-411d-aa8f-3c29571e1c52 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:00.435662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b96ccd-d0a4-4f12-bf43-2b6ed23823bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:00.437227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b96ccd-d0a4-4f12-bf43-2b6ed23823bf admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:00.437635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b96ccd-d0a4-4f12-bf43-2b6ed23823bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:00.438240 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b96ccd-d0a4-4f12-bf43-2b6ed23823bf admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:00.439577 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b96ccd-d0a4-4f12-bf43-2b6ed23823bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:00.443957 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b96ccd-d0a4-4f12-bf43-2b6ed23823bf admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:00.487172 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf6446-177c-4fa0-8d8d-6c4ce11eede1 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:00.495013 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 936/1880] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:00 2022] POST /identity/v3/projects => generated 387 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:00.499598 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e8c56-b02f-4f54-ba52-f586d94fa198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:00.499801 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b96ccd-d0a4-4f12-bf43-2b6ed23823bf admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:00.501518 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e8c56-b02f-4f54-ba52-f586d94fa198 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:00.502108 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e8c56-b02f-4f54-ba52-f586d94fa198 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:00.502695 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e8c56-b02f-4f54-ba52-f586d94fa198 admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:00.504008 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e8c56-b02f-4f54-ba52-f586d94fa198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:00.508027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e8c56-b02f-4f54-ba52-f586d94fa198 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:00.549560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 945/1881] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:00 2022] POST /identity/v3/projects => generated 409 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:51:00.567455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e8c56-b02f-4f54-ba52-f586d94fa198 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:00.611460 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:00.654538 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b96ccd-d0a4-4f12-bf43-2b6ed23823bf admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:00.775814 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e8c56-b02f-4f54-ba52-f586d94fa198 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:00.792809 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006763d-594e-4e80-aab5-d49d4c8a4f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:00.793968 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006763d-594e-4e80-aab5-d49d4c8a4f82 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:00.794429 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006763d-594e-4e80-aab5-d49d4c8a4f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:00.794850 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006763d-594e-4e80-aab5-d49d4c8a4f82 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:00.796349 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006763d-594e-4e80-aab5-d49d4c8a4f82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:00.801316 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006763d-594e-4e80-aab5-d49d4c8a4f82 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:00.927565 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 946/1882] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:00 2022] POST /identity/v3/users => generated 311 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:00.940859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006763d-594e-4e80-aab5-d49d4c8a4f82 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:01.034976 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006763d-594e-4e80-aab5-d49d4c8a4f82 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:01.051624 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad2c38-1990-4289-a22c-235e8ff2a3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:01.056628 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad2c38-1990-4289-a22c-235e8ff2a3f3 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:01.059406 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad2c38-1990-4289-a22c-235e8ff2a3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:01.061765 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad2c38-1990-4289-a22c-235e8ff2a3f3 admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:01.063489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad2c38-1990-4289-a22c-235e8ff2a3f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:01.066157 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e694e-1ddf-45fa-b910-4a30b270b9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:01.066917 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e694e-1ddf-45fa-b910-4a30b270b9bb admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:01.067279 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e694e-1ddf-45fa-b910-4a30b270b9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:01.067629 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e694e-1ddf-45fa-b910-4a30b270b9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:01.068373 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e694e-1ddf-45fa-b910-4a30b270b9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:01.072138 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e694e-1ddf-45fa-b910-4a30b270b9bb admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:01.074764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad2c38-1990-4289-a22c-235e8ff2a3f3 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:01.094274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 947/1883] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:01.099366 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e694e-1ddf-45fa-b910-4a30b270b9bb admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:01.117991 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e694e-1ddf-45fa-b910-4a30b270b9bb admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:01.131237 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9deafe1-0193-42a1-a282-bcc7eb5c8c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:01.136725 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9deafe1-0193-42a1-a282-bcc7eb5c8c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:01.137760 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9deafe1-0193-42a1-a282-bcc7eb5c8c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:01.138816 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9deafe1-0193-42a1-a282-bcc7eb5c8c58 admin admin] PATH_INFO: `/v3/projects/ac051ce0598b45bfb8c34fee9855431d/users/b614eb7473d14b68b175ff1eeb9d5da3/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:01.148108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 937/1884] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:00 2022] POST /identity/v3/users => generated 300 bytes in 649 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:01.152972 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad2c38-1990-4289-a22c-235e8ff2a3f3 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:01.177265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad2c38-1990-4289-a22c-235e8ff2a3f3 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:01.189056 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780211f-c7da-440d-a9c2-68b966d62230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:01.190260 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780211f-c7da-440d-a9c2-68b966d62230 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:01.190793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780211f-c7da-440d-a9c2-68b966d62230 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:01.191313 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780211f-c7da-440d-a9c2-68b966d62230 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:01.192395 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780211f-c7da-440d-a9c2-68b966d62230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:01.194559 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780211f-c7da-440d-a9c2-68b966d62230 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:01.213724 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 938/1885] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:01.214906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780211f-c7da-440d-a9c2-68b966d62230 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:01.229009 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780211f-c7da-440d-a9c2-68b966d62230 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:01.235896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599a58b-d6e0-46c3-97b2-9f1086045869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:01.236598 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599a58b-d6e0-46c3-97b2-9f1086045869 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:01.236886 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599a58b-d6e0-46c3-97b2-9f1086045869 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:01.237184 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599a58b-d6e0-46c3-97b2-9f1086045869 admin admin] PATH_INFO: `/v3/projects/b914207eeb304302928de3995af223f3/users/087c5390440947569d59786644dfaa58/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:01.244174 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9deafe1-0193-42a1-a282-bcc7eb5c8c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac051ce0598b45bfb8c34fee9855431d, user_id=b614eb7473d14b68b175ff1eeb9d5da3, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:01.254751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9deafe1-0193-42a1-a282-bcc7eb5c8c58 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:01.259049 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599a58b-d6e0-46c3-97b2-9f1086045869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b914207eeb304302928de3995af223f3, user_id=087c5390440947569d59786644dfaa58, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:01.262575 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599a58b-d6e0-46c3-97b2-9f1086045869 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:01.287505 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 939/1886] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:01 2022] PUT /identity/v3/projects/b914207eeb304302928de3995af223f3/users/087c5390440947569d59786644dfaa58/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:01.289893 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599a58b-d6e0-46c3-97b2-9f1086045869 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:01.305032 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:01.309317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 948/1887] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:01 2022] PUT /identity/v3/projects/ac051ce0598b45bfb8c34fee9855431d/users/b614eb7473d14b68b175ff1eeb9d5da3/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:01.314569 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9deafe1-0193-42a1-a282-bcc7eb5c8c58 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:01.461674 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599a58b-d6e0-46c3-97b2-9f1086045869 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:01.488270 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9deafe1-0193-42a1-a282-bcc7eb5c8c58 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:01.526743 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87253437-2841-4605-b041-fbf4a627bc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:01.529183 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87253437-2841-4605-b041-fbf4a627bc77 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:01.530556 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87253437-2841-4605-b041-fbf4a627bc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:01.534629 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87253437-2841-4605-b041-fbf4a627bc77 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:01.537522 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87253437-2841-4605-b041-fbf4a627bc77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:01.553046 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87253437-2841-4605-b041-fbf4a627bc77 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:01.639918 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 949/1888] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:51:01.641910 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87253437-2841-4605-b041-fbf4a627bc77 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:01.690014 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87253437-2841-4605-b041-fbf4a627bc77 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:01.705652 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a36ee8-7d1e-4ceb-a714-c53ad92f5034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:01.706356 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a36ee8-7d1e-4ceb-a714-c53ad92f5034 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:01.706646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a36ee8-7d1e-4ceb-a714-c53ad92f5034 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:01.706922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a36ee8-7d1e-4ceb-a714-c53ad92f5034 admin admin] PATH_INFO: `/v3/projects/ac051ce0598b45bfb8c34fee9855431d/users/b614eb7473d14b68b175ff1eeb9d5da3/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:01.715636 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a36ee8-7d1e-4ceb-a714-c53ad92f5034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac051ce0598b45bfb8c34fee9855431d, user_id=b614eb7473d14b68b175ff1eeb9d5da3, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:01.725597 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af6eb8-1e51-4896-bc44-6334c70a0b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:01.727428 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af6eb8-1e51-4896-bc44-6334c70a0b75 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:01.728199 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af6eb8-1e51-4896-bc44-6334c70a0b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:01.729022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af6eb8-1e51-4896-bc44-6334c70a0b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:01.730343 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a36ee8-7d1e-4ceb-a714-c53ad92f5034 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:01.731123 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af6eb8-1e51-4896-bc44-6334c70a0b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:01.736438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af6eb8-1e51-4896-bc44-6334c70a0b75 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:01.759267 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 950/1889] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:01 2022] PUT /identity/v3/projects/ac051ce0598b45bfb8c34fee9855431d/users/b614eb7473d14b68b175ff1eeb9d5da3/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:01.760141 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 940/1890] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 472 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:01.763783 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b34271-a060-451a-8865-292ae2a9e950 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:01.765426 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b34271-a060-451a-8865-292ae2a9e950 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:01.766040 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b34271-a060-451a-8865-292ae2a9e950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:01.769031 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af6eb8-1e51-4896-bc44-6334c70a0b75 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:01.789429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af6eb8-1e51-4896-bc44-6334c70a0b75 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:01.854589 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-30b34271-a060-451a-8865-292ae2a9e950 None None] MFA Rules not processed for user `b614eb7473d14b68b175ff1eeb9d5da3`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:01.855879 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-30b34271-a060-451a-8865-292ae2a9e950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:02.018585 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:02.075301 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6070b1-b28e-487b-b5d8-deb0617c5489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:02.077944 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6070b1-b28e-487b-b5d8-deb0617c5489 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:02.079743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6070b1-b28e-487b-b5d8-deb0617c5489 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:02.080110 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6070b1-b28e-487b-b5d8-deb0617c5489 admin admin] PATH_INFO: `/v3/projects/b914207eeb304302928de3995af223f3/users/087c5390440947569d59786644dfaa58/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:02.088630 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6070b1-b28e-487b-b5d8-deb0617c5489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b914207eeb304302928de3995af223f3, user_id=087c5390440947569d59786644dfaa58, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:02.099603 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6070b1-b28e-487b-b5d8-deb0617c5489 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:02.131269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 941/1891] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:01 2022] PUT /identity/v3/projects/b914207eeb304302928de3995af223f3/users/087c5390440947569d59786644dfaa58/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:02.146081 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb8231-311e-485d-9f2f-9c8a691ec33a None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:02.146081 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb8231-311e-485d-9f2f-9c8a691ec33a None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:02.146081 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb8231-311e-485d-9f2f-9c8a691ec33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:02.212696 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 951/1892] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:01 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:02.232369 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-04bb8231-311e-485d-9f2f-9c8a691ec33a None None] MFA Rules not processed for user `087c5390440947569d59786644dfaa58`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:02.235926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-04bb8231-311e-485d-9f2f-9c8a691ec33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:02.250019 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b34271-a060-451a-8865-292ae2a9e950 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:02.255545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-30b34271-a060-451a-8865-292ae2a9e950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:02.386533 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:02.424288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b34271-a060-451a-8865-292ae2a9e950 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:02.454968 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 942/1893] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:02 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:02.487698 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a491e-00ac-423d-80b7-19ebaad7de69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:02.488435 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a491e-00ac-423d-80b7-19ebaad7de69 service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:02.488614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a491e-00ac-423d-80b7-19ebaad7de69 service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:02.488889 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a491e-00ac-423d-80b7-19ebaad7de69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:02.568363 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb8231-311e-485d-9f2f-9c8a691ec33a None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:02.570392 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-04bb8231-311e-485d-9f2f-9c8a691ec33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:02.585332 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb8231-311e-485d-9f2f-9c8a691ec33a None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:02.591449 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fb585-0f71-491a-b232-7de567216945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:02.591882 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a491e-00ac-423d-80b7-19ebaad7de69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:02.592313 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fb585-0f71-491a-b232-7de567216945 service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:02.592669 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fb585-0f71-491a-b232-7de567216945 service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:02.593076 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fb585-0f71-491a-b232-7de567216945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:02.593675 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a491e-00ac-423d-80b7-19ebaad7de69 service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:02.606624 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387fb585-0f71-491a-b232-7de567216945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:02.609034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387fb585-0f71-491a-b232-7de567216945 service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:02.610260 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 952/1894] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:02 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:51:02.636337 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 943/1895] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:02.722697 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a491e-00ac-423d-80b7-19ebaad7de69 service cinder] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:02.724187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-853a491e-00ac-423d-80b7-19ebaad7de69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:02.874853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:02.923515 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a491e-00ac-423d-80b7-19ebaad7de69 service cinder] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:02.947277 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db34dfe-6e93-4095-86a6-c1cbf55153f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:02.948531 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fb585-0f71-491a-b232-7de567216945 service cinder] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:02.950390 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db34dfe-6e93-4095-86a6-c1cbf55153f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:02.951594 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db34dfe-6e93-4095-86a6-c1cbf55153f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:02.952313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db34dfe-6e93-4095-86a6-c1cbf55153f6 admin admin] PATH_INFO: `/v3/users/3dbb124984324b688c069d755ee43104` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:02.956211 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db34dfe-6e93-4095-86a6-c1cbf55153f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dbb124984324b688c069d755ee43104)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:02.961259 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db34dfe-6e93-4095-86a6-c1cbf55153f6 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:02.986086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fb585-0f71-491a-b232-7de567216945 service cinder] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:02.997237 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501187e1-8cd7-43e0-91c2-45fcf8860287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:02.999663 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501187e1-8cd7-43e0-91c2-45fcf8860287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:03.000194 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501187e1-8cd7-43e0-91c2-45fcf8860287 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:03.000662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501187e1-8cd7-43e0-91c2-45fcf8860287 admin admin] PATH_INFO: `/v3/users/1f2e204d89304083921180275387922c` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:03.002771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501187e1-8cd7-43e0-91c2-45fcf8860287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f2e204d89304083921180275387922c)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:03.006527 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501187e1-8cd7-43e0-91c2-45fcf8860287 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:03.097632 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-501187e1-8cd7-43e0-91c2-45fcf8860287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f2e204d89304083921180275387922c'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:03.099239 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-501187e1-8cd7-43e0-91c2-45fcf8860287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f2e204d89304083921180275387922c'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:03.107539 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-7db34dfe-6e93-4095-86a6-c1cbf55153f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dbb124984324b688c069d755ee43104'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:03.110118 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-501187e1-8cd7-43e0-91c2-45fcf8860287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f2e204d89304083921180275387922c'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:03.120915 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-7db34dfe-6e93-4095-86a6-c1cbf55153f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dbb124984324b688c069d755ee43104'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:03.134556 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-7db34dfe-6e93-4095-86a6-c1cbf55153f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dbb124984324b688c069d755ee43104'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:03.134760 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-501187e1-8cd7-43e0-91c2-45fcf8860287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f2e204d89304083921180275387922c'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:03.136058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-7db34dfe-6e93-4095-86a6-c1cbf55153f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dbb124984324b688c069d755ee43104'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:03.150070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-501187e1-8cd7-43e0-91c2-45fcf8860287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f2e204d89304083921180275387922c'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:03.157331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-7db34dfe-6e93-4095-86a6-c1cbf55153f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dbb124984324b688c069d755ee43104'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:03.158517 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 944/1896] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:02 2022] DELETE /identity/v3/users/1f2e204d89304083921180275387922c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:03.159410 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501187e1-8cd7-43e0-91c2-45fcf8860287 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:03.160858 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-501187e1-8cd7-43e0-91c2-45fcf8860287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:03.165254 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 953/1897] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:02 2022] DELETE /identity/v3/users/3dbb124984324b688c069d755ee43104 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:03.169018 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8094130-b8a1-40e8-a005-994b2996af68 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:03.169018 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8094130-b8a1-40e8-a005-994b2996af68 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:03.169018 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8094130-b8a1-40e8-a005-994b2996af68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:03.198636 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-a8094130-b8a1-40e8-a005-994b2996af68 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:03.200655 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-a8094130-b8a1-40e8-a005-994b2996af68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:03.256010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501187e1-8cd7-43e0-91c2-45fcf8860287 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:03.291691 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 954/1898] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:03.295701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a44d17-ec4b-4c64-a958-286e173de2dd None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:03.296196 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a44d17-ec4b-4c64-a958-286e173de2dd None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:03.296937 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a44d17-ec4b-4c64-a958-286e173de2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:03.314333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:03.322604 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-b4a44d17-ec4b-4c64-a958-286e173de2dd None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:03.324283 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-b4a44d17-ec4b-4c64-a958-286e173de2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:03.327149 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df554ee9-5105-4a78-946f-7689a1c0a47c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:03.328506 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df554ee9-5105-4a78-946f-7689a1c0a47c service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:03.328945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df554ee9-5105-4a78-946f-7689a1c0a47c service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:03.329820 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df554ee9-5105-4a78-946f-7689a1c0a47c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:03.332576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-df554ee9-5105-4a78-946f-7689a1c0a47c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:03.334593 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 955/1899] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:03.336321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a44d17-ec4b-4c64-a958-286e173de2dd None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:03.339086 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-b4a44d17-ec4b-4c64-a958-286e173de2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:03.437684 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a44d17-ec4b-4c64-a958-286e173de2dd None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:03.445290 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a52083-293b-4c8d-95e9-ec8599268373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:03.446566 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a52083-293b-4c8d-95e9-ec8599268373 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:03.447795 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a52083-293b-4c8d-95e9-ec8599268373 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:03.447795 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a52083-293b-4c8d-95e9-ec8599268373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:03.452655 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df554ee9-5105-4a78-946f-7689a1c0a47c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:03.455565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df554ee9-5105-4a78-946f-7689a1c0a47c service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:03.463279 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:03.469757 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a52083-293b-4c8d-95e9-ec8599268373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:03.473350 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a52083-293b-4c8d-95e9-ec8599268373 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:03.480968 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 945/1900] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:03 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:03.482513 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df554ee9-5105-4a78-946f-7689a1c0a47c service cinder] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:03.484754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-df554ee9-5105-4a78-946f-7689a1c0a47c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:03.508928 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 956/1901] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:03.510808 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df554ee9-5105-4a78-946f-7689a1c0a47c service cinder] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:03.517458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088bff0-3c9d-4c1e-97cc-8e5f34613b8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:03.518806 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088bff0-3c9d-4c1e-97cc-8e5f34613b8e service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:03.519089 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088bff0-3c9d-4c1e-97cc-8e5f34613b8e service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:03.519562 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088bff0-3c9d-4c1e-97cc-8e5f34613b8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:03.539169 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088bff0-3c9d-4c1e-97cc-8e5f34613b8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:03.541550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088bff0-3c9d-4c1e-97cc-8e5f34613b8e service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:03.561451 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 946/1902] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:04.613990 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce0be2-6764-42df-9e6b-582b7b7ec6bd None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:04.614809 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce0be2-6764-42df-9e6b-582b7b7ec6bd None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:04.614809 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce0be2-6764-42df-9e6b-582b7b7ec6bd None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:04.616708 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 957/1903] 10.222.0.94 () {54 vars in 921 bytes} [Wed Aug 24 04:51:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:51:04.635015 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b06b7e-b556-45fb-9372-519d7f846924 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:04.636278 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b06b7e-b556-45fb-9372-519d7f846924 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:04.637054 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b06b7e-b556-45fb-9372-519d7f846924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:04.699009 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-65b06b7e-b556-45fb-9372-519d7f846924 None None] MFA Rules not processed for user `5bdbda2b9c8f48338c5117585a229cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:04.717884 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-65b06b7e-b556-45fb-9372-519d7f846924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:04.786223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce0be2-6764-42df-9e6b-582b7b7ec6bd None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:04.789313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-43ce0be2-6764-42df-9e6b-582b7b7ec6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:04.837591 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce0be2-6764-42df-9e6b-582b7b7ec6bd None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:04.861311 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819500d9-b181-4850-a985-6e75eb69c50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:04.862575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819500d9-b181-4850-a985-6e75eb69c50d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:04.862575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819500d9-b181-4850-a985-6e75eb69c50d admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:04.870194 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819500d9-b181-4850-a985-6e75eb69c50d admin admin] PATH_INFO: `/v3/projects/1c4efe925771485d9ee2d416c6bc9f57` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:04.874688 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819500d9-b181-4850-a985-6e75eb69c50d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c4efe925771485d9ee2d416c6bc9f57)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:04.880818 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819500d9-b181-4850-a985-6e75eb69c50d admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:04.957218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 947/1904] 10.222.0.94 () {58 vars in 1018 bytes} [Wed Aug 24 04:51:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:05.099806 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-819500d9-b181-4850-a985-6e75eb69c50d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c4efe925771485d9ee2d416c6bc9f57', 'request_id': 'req-819500d9-b181-4850-a985-6e75eb69c50d'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:05.115107 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-819500d9-b181-4850-a985-6e75eb69c50d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c4efe925771485d9ee2d416c6bc9f57', 'request_id': 'req-819500d9-b181-4850-a985-6e75eb69c50d'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:05.115598 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b06b7e-b556-45fb-9372-519d7f846924 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:05.118430 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-65b06b7e-b556-45fb-9372-519d7f846924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:05.142078 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-819500d9-b181-4850-a985-6e75eb69c50d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c4efe925771485d9ee2d416c6bc9f57', 'request_id': 'req-819500d9-b181-4850-a985-6e75eb69c50d'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:05.174674 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-819500d9-b181-4850-a985-6e75eb69c50d admin admin] The token cache is being invalidate because project 1c4efe925771485d9ee2d416c6bc9f57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:05.175435 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-819500d9-b181-4850-a985-6e75eb69c50d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:05.176949 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-819500d9-b181-4850-a985-6e75eb69c50d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:05.180583 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 958/1905] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:04 2022] DELETE /identity/v3/projects/1c4efe925771485d9ee2d416c6bc9f57 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:05.188313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819500d9-b181-4850-a985-6e75eb69c50d admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:05.192128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-819500d9-b181-4850-a985-6e75eb69c50d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:05.195486 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b06b7e-b556-45fb-9372-519d7f846924 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:05.363150 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f406a5b-8d92-4b48-9582-663c64ffe0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:05.364209 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f406a5b-8d92-4b48-9582-663c64ffe0eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:05.364939 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f406a5b-8d92-4b48-9582-663c64ffe0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:05.365442 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f406a5b-8d92-4b48-9582-663c64ffe0eb admin admin] PATH_INFO: `/v3/projects/721c16043f624def920592ab340f19eb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:05.366795 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819500d9-b181-4850-a985-6e75eb69c50d admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:05.368691 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f406a5b-8d92-4b48-9582-663c64ffe0eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=721c16043f624def920592ab340f19eb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:05.373156 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae9511-3a1d-4e07-8771-8e30d6a6a67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:05.373789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f406a5b-8d92-4b48-9582-663c64ffe0eb admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:05.374697 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae9511-3a1d-4e07-8771-8e30d6a6a67c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:05.375184 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae9511-3a1d-4e07-8771-8e30d6a6a67c admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:05.375756 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae9511-3a1d-4e07-8771-8e30d6a6a67c admin admin] PATH_INFO: `/v3/users/fd39fb1c35364d4ebca0d26b000ab65c` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:05.377726 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae9511-3a1d-4e07-8771-8e30d6a6a67c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd39fb1c35364d4ebca0d26b000ab65c)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:05.380126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae9511-3a1d-4e07-8771-8e30d6a6a67c admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:05.405190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:05.463391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-9f406a5b-8d92-4b48-9582-663c64ffe0eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '721c16043f624def920592ab340f19eb', 'request_id': 'req-9f406a5b-8d92-4b48-9582-663c64ffe0eb'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:05.484209 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-9f406a5b-8d92-4b48-9582-663c64ffe0eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '721c16043f624def920592ab340f19eb', 'request_id': 'req-9f406a5b-8d92-4b48-9582-663c64ffe0eb'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:05.484482 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-06ae9511-3a1d-4e07-8771-8e30d6a6a67c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd39fb1c35364d4ebca0d26b000ab65c'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:05.498671 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-06ae9511-3a1d-4e07-8771-8e30d6a6a67c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd39fb1c35364d4ebca0d26b000ab65c'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:05.504539 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-9f406a5b-8d92-4b48-9582-663c64ffe0eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '721c16043f624def920592ab340f19eb', 'request_id': 'req-9f406a5b-8d92-4b48-9582-663c64ffe0eb'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:05.518226 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-06ae9511-3a1d-4e07-8771-8e30d6a6a67c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd39fb1c35364d4ebca0d26b000ab65c'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:05.521910 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-06ae9511-3a1d-4e07-8771-8e30d6a6a67c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd39fb1c35364d4ebca0d26b000ab65c'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:05.524440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-9f406a5b-8d92-4b48-9582-663c64ffe0eb admin admin] The token cache is being invalidate because project 721c16043f624def920592ab340f19eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:05.524809 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-9f406a5b-8d92-4b48-9582-663c64ffe0eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:05.525800 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-9f406a5b-8d92-4b48-9582-663c64ffe0eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:05.527823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 948/1906] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:05 2022] DELETE /identity/v3/projects/721c16043f624def920592ab340f19eb => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:05.529196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f406a5b-8d92-4b48-9582-663c64ffe0eb admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:05.532438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-9f406a5b-8d92-4b48-9582-663c64ffe0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:05.560787 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-06ae9511-3a1d-4e07-8771-8e30d6a6a67c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd39fb1c35364d4ebca0d26b000ab65c'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:05.564540 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:05.579123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 959/1907] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:05 2022] DELETE /identity/v3/users/fd39fb1c35364d4ebca0d26b000ab65c => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:05.582316 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae9511-3a1d-4e07-8771-8e30d6a6a67c admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:05.586197 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-06ae9511-3a1d-4e07-8771-8e30d6a6a67c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:05.726200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae9511-3a1d-4e07-8771-8e30d6a6a67c admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:05.735657 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cf517-0920-499c-b2ed-dd7379f0017a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:05.735979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f406a5b-8d92-4b48-9582-663c64ffe0eb admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:05.736699 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cf517-0920-499c-b2ed-dd7379f0017a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:05.736699 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cf517-0920-499c-b2ed-dd7379f0017a admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:05.736996 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cf517-0920-499c-b2ed-dd7379f0017a admin admin] PATH_INFO: `/v3/users/087c5390440947569d59786644dfaa58` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:05.739985 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4cf517-0920-499c-b2ed-dd7379f0017a admin admin] RBAC: Authorizing `identity:delete_user(user_id=087c5390440947569d59786644dfaa58)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:05.742104 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4cf517-0920-499c-b2ed-dd7379f0017a admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:05.814563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-dd4cf517-0920-499c-b2ed-dd7379f0017a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '087c5390440947569d59786644dfaa58'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:05.832800 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-dd4cf517-0920-499c-b2ed-dd7379f0017a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '087c5390440947569d59786644dfaa58'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:05.844299 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-dd4cf517-0920-499c-b2ed-dd7379f0017a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '087c5390440947569d59786644dfaa58'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:05.845356 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-dd4cf517-0920-499c-b2ed-dd7379f0017a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '087c5390440947569d59786644dfaa58'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:05.866888 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e62c98-fb57-425e-a052-15b060e44044 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:05.868243 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-dd4cf517-0920-499c-b2ed-dd7379f0017a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '087c5390440947569d59786644dfaa58'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:05.869138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e62c98-fb57-425e-a052-15b060e44044 service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:05.869880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e62c98-fb57-425e-a052-15b060e44044 service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:05.870387 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e62c98-fb57-425e-a052-15b060e44044 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:05.875731 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-33e62c98-fb57-425e-a052-15b060e44044 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:05.891970 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 960/1908] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:05 2022] DELETE /identity/v3/users/087c5390440947569d59786644dfaa58 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:05.905723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e62c98-fb57-425e-a052-15b060e44044 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:05.915620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e62c98-fb57-425e-a052-15b060e44044 service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:05.939878 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 949/1909] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:06.894623 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cf517-0920-499c-b2ed-dd7379f0017a admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:06.896520 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-dd4cf517-0920-499c-b2ed-dd7379f0017a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:06.919478 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e62c98-fb57-425e-a052-15b060e44044 service nova] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:06.922978 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-33e62c98-fb57-425e-a052-15b060e44044 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:06.962704 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e62c98-fb57-425e-a052-15b060e44044 service nova] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:07.096299 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cf517-0920-499c-b2ed-dd7379f0017a admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:07.110479 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:07.115498 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b65882-b524-4c7b-b18f-fe7848d7cc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:07.116203 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b65882-b524-4c7b-b18f-fe7848d7cc0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:07.116676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b65882-b524-4c7b-b18f-fe7848d7cc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:07.116999 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b65882-b524-4c7b-b18f-fe7848d7cc0b admin admin] PATH_INFO: `/v3/projects/8eac3992a3924a5f9f5b980d7acceb54` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:07.120569 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b65882-b524-4c7b-b18f-fe7848d7cc0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eac3992a3924a5f9f5b980d7acceb54)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:07.122631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b65882-b524-4c7b-b18f-fe7848d7cc0b admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:07.166509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:07.188476 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb974bd4-ef6a-4898-afee-31ef00ab5a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:07.190093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb974bd4-ef6a-4898-afee-31ef00ab5a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:07.190862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb974bd4-ef6a-4898-afee-31ef00ab5a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:07.191294 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb974bd4-ef6a-4898-afee-31ef00ab5a7c admin admin] PATH_INFO: `/v3/projects/b914207eeb304302928de3995af223f3` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:07.193335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb974bd4-ef6a-4898-afee-31ef00ab5a7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b914207eeb304302928de3995af223f3)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:07.196924 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb974bd4-ef6a-4898-afee-31ef00ab5a7c admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:07.216750 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-55b65882-b524-4c7b-b18f-fe7848d7cc0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eac3992a3924a5f9f5b980d7acceb54', 'request_id': 'req-55b65882-b524-4c7b-b18f-fe7848d7cc0b'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:07.227762 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-55b65882-b524-4c7b-b18f-fe7848d7cc0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eac3992a3924a5f9f5b980d7acceb54', 'request_id': 'req-55b65882-b524-4c7b-b18f-fe7848d7cc0b'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:07.242267 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-55b65882-b524-4c7b-b18f-fe7848d7cc0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eac3992a3924a5f9f5b980d7acceb54', 'request_id': 'req-55b65882-b524-4c7b-b18f-fe7848d7cc0b'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:07.267471 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-55b65882-b524-4c7b-b18f-fe7848d7cc0b admin admin] The token cache is being invalidate because project 8eac3992a3924a5f9f5b980d7acceb54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:07.268146 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-55b65882-b524-4c7b-b18f-fe7848d7cc0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:07.269539 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-55b65882-b524-4c7b-b18f-fe7848d7cc0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:07.273584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 961/1910] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:06 2022] DELETE /identity/v3/projects/8eac3992a3924a5f9f5b980d7acceb54 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:07.278790 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b65882-b524-4c7b-b18f-fe7848d7cc0b admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:07.282244 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-55b65882-b524-4c7b-b18f-fe7848d7cc0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:07.301550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-fb974bd4-ef6a-4898-afee-31ef00ab5a7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b914207eeb304302928de3995af223f3', 'request_id': 'req-fb974bd4-ef6a-4898-afee-31ef00ab5a7c'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:07.314622 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-fb974bd4-ef6a-4898-afee-31ef00ab5a7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b914207eeb304302928de3995af223f3', 'request_id': 'req-fb974bd4-ef6a-4898-afee-31ef00ab5a7c'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:07.328934 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-fb974bd4-ef6a-4898-afee-31ef00ab5a7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b914207eeb304302928de3995af223f3', 'request_id': 'req-fb974bd4-ef6a-4898-afee-31ef00ab5a7c'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:07.354746 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-fb974bd4-ef6a-4898-afee-31ef00ab5a7c admin admin] The token cache is being invalidate because project b914207eeb304302928de3995af223f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:07.355381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-fb974bd4-ef6a-4898-afee-31ef00ab5a7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:07.356562 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-fb974bd4-ef6a-4898-afee-31ef00ab5a7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:07.379547 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 950/1911] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:06 2022] DELETE /identity/v3/projects/b914207eeb304302928de3995af223f3 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:07.385503 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e42029-bf76-4608-8ec1-944c6d269e3b None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:07.386008 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e42029-bf76-4608-8ec1-944c6d269e3b None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:07.386496 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e42029-bf76-4608-8ec1-944c6d269e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:07.412476 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b65882-b524-4c7b-b18f-fe7848d7cc0b admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:07.433022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-c8e42029-bf76-4608-8ec1-944c6d269e3b None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:07.436155 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-c8e42029-bf76-4608-8ec1-944c6d269e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:07.560065 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14f9c0-0dcf-4f83-bddb-7041b49edbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:07.562178 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14f9c0-0dcf-4f83-bddb-7041b49edbb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:07.563112 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14f9c0-0dcf-4f83-bddb-7041b49edbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:07.563744 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14f9c0-0dcf-4f83-bddb-7041b49edbb0 admin admin] PATH_INFO: `/v3/users/9fdff0d4f25340f6a5c8b049ac947228` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:07.566951 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14f9c0-0dcf-4f83-bddb-7041b49edbb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fdff0d4f25340f6a5c8b049ac947228)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:07.579415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14f9c0-0dcf-4f83-bddb-7041b49edbb0 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:07.614678 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 951/1912] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:07.627947 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bedc89-2026-4a79-9b05-47e04e143cc0 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:07.628586 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bedc89-2026-4a79-9b05-47e04e143cc0 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:07.628885 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bedc89-2026-4a79-9b05-47e04e143cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:07.748762 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-de14f9c0-0dcf-4f83-bddb-7041b49edbb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fdff0d4f25340f6a5c8b049ac947228'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:07.750281 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-60bedc89-2026-4a79-9b05-47e04e143cc0 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:07.752259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-60bedc89-2026-4a79-9b05-47e04e143cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:07.769633 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-de14f9c0-0dcf-4f83-bddb-7041b49edbb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fdff0d4f25340f6a5c8b049ac947228'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:07.775387 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 952/1913] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:07.778042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bedc89-2026-4a79-9b05-47e04e143cc0 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:07.781650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:07.799445 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-de14f9c0-0dcf-4f83-bddb-7041b49edbb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fdff0d4f25340f6a5c8b049ac947228'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:07.802274 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bedc89-2026-4a79-9b05-47e04e143cc0 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:07.802820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-de14f9c0-0dcf-4f83-bddb-7041b49edbb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fdff0d4f25340f6a5c8b049ac947228'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:07.812306 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef150ce-2b61-4f24-a8a3-a3b1a06c0c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:07.813693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef150ce-2b61-4f24-a8a3-a3b1a06c0c80 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:07.814565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef150ce-2b61-4f24-a8a3-a3b1a06c0c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:07.815101 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef150ce-2b61-4f24-a8a3-a3b1a06c0c80 admin admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:07.816382 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef150ce-2b61-4f24-a8a3-a3b1a06c0c80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:51:07.817004 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef150ce-2b61-4f24-a8a3-a3b1a06c0c80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:07.821218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef150ce-2b61-4f24-a8a3-a3b1a06c0c80 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:07.833336 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-de14f9c0-0dcf-4f83-bddb-7041b49edbb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fdff0d4f25340f6a5c8b049ac947228'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:07.853463 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 962/1914] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:07 2022] DELETE /identity/v3/users/9fdff0d4f25340f6a5c8b049ac947228 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:07.857645 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 953/1915] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:51:07.862346 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14f9c0-0dcf-4f83-bddb-7041b49edbb0 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:07.865238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-de14f9c0-0dcf-4f83-bddb-7041b49edbb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:08.074148 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14f9c0-0dcf-4f83-bddb-7041b49edbb0 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:08.084103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15517cd2-cb39-4d61-b5de-cee65ff853b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:08.084769 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15517cd2-cb39-4d61-b5de-cee65ff853b2 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:08.085188 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15517cd2-cb39-4d61-b5de-cee65ff853b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:08.085725 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15517cd2-cb39-4d61-b5de-cee65ff853b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:08.087660 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15517cd2-cb39-4d61-b5de-cee65ff853b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:08.095932 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15517cd2-cb39-4d61-b5de-cee65ff853b2 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:08.181621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 963/1916] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:07 2022] POST /identity/v3/projects => generated 387 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:51:08.191591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef150ce-2b61-4f24-a8a3-a3b1a06c0c80 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:08.217113 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef150ce-2b61-4f24-a8a3-a3b1a06c0c80 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:08.409138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:08.498996 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ec557-7edc-4dba-86ae-d375e127365f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:08.500819 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ec557-7edc-4dba-86ae-d375e127365f admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:08.501775 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ec557-7edc-4dba-86ae-d375e127365f admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:08.502414 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ec557-7edc-4dba-86ae-d375e127365f admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:08.504834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ec557-7edc-4dba-86ae-d375e127365f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:08.510317 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ec557-7edc-4dba-86ae-d375e127365f admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:08.580173 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 954/1917] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:08 2022] POST /identity/v3/users => generated 294 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:08.586221 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15517cd2-cb39-4d61-b5de-cee65ff853b2 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:08.617307 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15517cd2-cb39-4d61-b5de-cee65ff853b2 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:08.625563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba323a-030b-4b62-8f79-bad02022d4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:08.626591 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba323a-030b-4b62-8f79-bad02022d4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:08.627027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba323a-030b-4b62-8f79-bad02022d4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:08.627408 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba323a-030b-4b62-8f79-bad02022d4b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:08.628416 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba323a-030b-4b62-8f79-bad02022d4b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:08.630588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba323a-030b-4b62-8f79-bad02022d4b7 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:08.667922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 964/1918] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:08.675683 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ec557-7edc-4dba-86ae-d375e127365f admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:08.686774 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba323a-030b-4b62-8f79-bad02022d4b7 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:08.695456 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-dbba323a-030b-4b62-8f79-bad02022d4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:08.726083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ec557-7edc-4dba-86ae-d375e127365f admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:08.747283 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c156cd-f784-469e-b66d-f0cc134b9eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:08.748429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c156cd-f784-469e-b66d-f0cc134b9eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:08.749061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c156cd-f784-469e-b66d-f0cc134b9eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:08.749531 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c156cd-f784-469e-b66d-f0cc134b9eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:08.750663 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c156cd-f784-469e-b66d-f0cc134b9eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:08.753597 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c156cd-f784-469e-b66d-f0cc134b9eb8 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:08.771778 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba323a-030b-4b62-8f79-bad02022d4b7 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:08.784093 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacf387-5201-4bf4-a362-21c75833f60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:08.785205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacf387-5201-4bf4-a362-21c75833f60a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:08.785744 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacf387-5201-4bf4-a362-21c75833f60a admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:08.786769 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacf387-5201-4bf4-a362-21c75833f60a admin admin] PATH_INFO: `/v3/projects/0e72a47d2eed47d69a6b69e5896563fe` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:08.788126 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 955/1919] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:08.789806 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eacf387-5201-4bf4-a362-21c75833f60a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e72a47d2eed47d69a6b69e5896563fe)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:08.793364 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eacf387-5201-4bf4-a362-21c75833f60a admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:08.793684 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c156cd-f784-469e-b66d-f0cc134b9eb8 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:08.852144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c156cd-f784-469e-b66d-f0cc134b9eb8 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:08.862592 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54512d8f-1b77-45da-83f1-293253927632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:08.863777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54512d8f-1b77-45da-83f1-293253927632 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:08.864264 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54512d8f-1b77-45da-83f1-293253927632 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:08.864900 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54512d8f-1b77-45da-83f1-293253927632 admin admin] PATH_INFO: `/v3/projects/54e70a4e89524926809adadbd29f72bb/users/f8f136548df54f9b8f63583f9b3d5fa8/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:08.898723 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6eacf387-5201-4bf4-a362-21c75833f60a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e72a47d2eed47d69a6b69e5896563fe', 'request_id': 'req-6eacf387-5201-4bf4-a362-21c75833f60a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:08.902024 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54512d8f-1b77-45da-83f1-293253927632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e70a4e89524926809adadbd29f72bb, user_id=f8f136548df54f9b8f63583f9b3d5fa8, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:08.908440 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6eacf387-5201-4bf4-a362-21c75833f60a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e72a47d2eed47d69a6b69e5896563fe', 'request_id': 'req-6eacf387-5201-4bf4-a362-21c75833f60a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:08.908756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54512d8f-1b77-45da-83f1-293253927632 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:08.938355 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6eacf387-5201-4bf4-a362-21c75833f60a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e72a47d2eed47d69a6b69e5896563fe', 'request_id': 'req-6eacf387-5201-4bf4-a362-21c75833f60a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:08.943148 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 956/1920] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:08 2022] PUT /identity/v3/projects/54e70a4e89524926809adadbd29f72bb/users/f8f136548df54f9b8f63583f9b3d5fa8/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:08.955956 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82248f-1970-4ba5-9d9e-f11e80c679b4 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:08.956797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82248f-1970-4ba5-9d9e-f11e80c679b4 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:08.957578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82248f-1970-4ba5-9d9e-f11e80c679b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:08.957777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6eacf387-5201-4bf4-a362-21c75833f60a admin admin] The token cache is being invalidate because project 0e72a47d2eed47d69a6b69e5896563fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:08.958078 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6eacf387-5201-4bf4-a362-21c75833f60a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:08.958854 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6eacf387-5201-4bf4-a362-21c75833f60a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:08.961007 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 965/1921] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:08 2022] DELETE /identity/v3/projects/0e72a47d2eed47d69a6b69e5896563fe => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:08.971619 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035768cc-a659-4194-bfd1-ed66ed8f9af1 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:08.971948 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035768cc-a659-4194-bfd1-ed66ed8f9af1 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:08.972428 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035768cc-a659-4194-bfd1-ed66ed8f9af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:09.018608 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-fc82248f-1970-4ba5-9d9e-f11e80c679b4 None None] MFA Rules not processed for user `f8f136548df54f9b8f63583f9b3d5fa8`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:09.019639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-fc82248f-1970-4ba5-9d9e-f11e80c679b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:09.024630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-035768cc-a659-4194-bfd1-ed66ed8f9af1 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:09.028133 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-035768cc-a659-4194-bfd1-ed66ed8f9af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:09.099174 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:09.162703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 966/1922] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:09.172226 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4492cd-ab32-4b0f-a0dc-4bb766dd9359 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:09.172767 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4492cd-ab32-4b0f-a0dc-4bb766dd9359 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:09.172903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4492cd-ab32-4b0f-a0dc-4bb766dd9359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:09.188420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 957/1923] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:09.196150 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82248f-1970-4ba5-9d9e-f11e80c679b4 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:09.199790 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-fc82248f-1970-4ba5-9d9e-f11e80c679b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:09.209548 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-ca4492cd-ab32-4b0f-a0dc-4bb766dd9359 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:09.209548 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ca4492cd-ab32-4b0f-a0dc-4bb766dd9359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:09.217373 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 967/1924] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:09.222438 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4492cd-ab32-4b0f-a0dc-4bb766dd9359 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:09.222942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82248f-1970-4ba5-9d9e-f11e80c679b4 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:09.229307 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170c568-11b0-4dae-bf3c-3800dff36c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:09.230012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170c568-11b0-4dae-bf3c-3800dff36c73 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:09.230340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170c568-11b0-4dae-bf3c-3800dff36c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:09.230701 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170c568-11b0-4dae-bf3c-3800dff36c73 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:09.231575 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b170c568-11b0-4dae-bf3c-3800dff36c73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:09.234033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b170c568-11b0-4dae-bf3c-3800dff36c73 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:09.237185 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4492cd-ab32-4b0f-a0dc-4bb766dd9359 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:09.249556 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858b0a5-c053-494b-b3c7-f384e6de36d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:09.250645 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858b0a5-c053-494b-b3c7-f384e6de36d4 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:09.251222 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858b0a5-c053-494b-b3c7-f384e6de36d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:09.251704 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858b0a5-c053-494b-b3c7-f384e6de36d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:09.252800 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858b0a5-c053-494b-b3c7-f384e6de36d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:51:09.253352 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858b0a5-c053-494b-b3c7-f384e6de36d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:09.256668 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858b0a5-c053-494b-b3c7-f384e6de36d4 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:09.269814 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 958/1925] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:09 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:09.274210 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170c568-11b0-4dae-bf3c-3800dff36c73 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:09.277484 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 968/1926] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:51:09.282889 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858b0a5-c053-494b-b3c7-f384e6de36d4 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:09.293518 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858b0a5-c053-494b-b3c7-f384e6de36d4 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:09.390143 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314970e7-59cd-40d4-a403-4c57d8893a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:09.391169 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314970e7-59cd-40d4-a403-4c57d8893a21 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:09.391462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170c568-11b0-4dae-bf3c-3800dff36c73 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:09.391625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314970e7-59cd-40d4-a403-4c57d8893a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:09.391874 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314970e7-59cd-40d4-a403-4c57d8893a21 admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:09.392712 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314970e7-59cd-40d4-a403-4c57d8893a21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:09.395199 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314970e7-59cd-40d4-a403-4c57d8893a21 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:09.397338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f06a4e-aa6c-48cb-8266-ba13f01df541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:09.398302 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f06a4e-aa6c-48cb-8266-ba13f01df541 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:09.398730 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f06a4e-aa6c-48cb-8266-ba13f01df541 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:09.399188 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f06a4e-aa6c-48cb-8266-ba13f01df541 admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:09.400143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f06a4e-aa6c-48cb-8266-ba13f01df541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:09.402643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f06a4e-aa6c-48cb-8266-ba13f01df541 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:09.419456 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:09.439172 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 969/1927] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:09 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:51:09.443157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 959/1928] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:09 2022] POST /identity/v3/users => generated 299 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:51:09.449039 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314970e7-59cd-40d4-a403-4c57d8893a21 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:09.450212 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f06a4e-aa6c-48cb-8266-ba13f01df541 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:09.467496 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f06a4e-aa6c-48cb-8266-ba13f01df541 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:09.581554 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314970e7-59cd-40d4-a403-4c57d8893a21 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:09.589955 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49075cfd-7088-4ecf-8ebc-0c139bbc9cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:09.591042 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49075cfd-7088-4ecf-8ebc-0c139bbc9cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:09.591561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49075cfd-7088-4ecf-8ebc-0c139bbc9cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:09.592618 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49075cfd-7088-4ecf-8ebc-0c139bbc9cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:09.594196 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49075cfd-7088-4ecf-8ebc-0c139bbc9cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:09.597186 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561c7ef-22db-42ca-af45-9ba9ab1e1f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:09.597427 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49075cfd-7088-4ecf-8ebc-0c139bbc9cb5 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:09.599853 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561c7ef-22db-42ca-af45-9ba9ab1e1f96 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:09.600435 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561c7ef-22db-42ca-af45-9ba9ab1e1f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:09.600971 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561c7ef-22db-42ca-af45-9ba9ab1e1f96 admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:09.602434 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561c7ef-22db-42ca-af45-9ba9ab1e1f96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:09.609048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561c7ef-22db-42ca-af45-9ba9ab1e1f96 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:09.625172 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 970/1929] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:09.627147 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49075cfd-7088-4ecf-8ebc-0c139bbc9cb5 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:09.661651 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49075cfd-7088-4ecf-8ebc-0c139bbc9cb5 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:09.661750 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 960/1930] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:09 2022] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:51:09.661828 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92da2a8-25a2-462b-8f92-df20fc7c893b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:09.661828 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92da2a8-25a2-462b-8f92-df20fc7c893b admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:09.661828 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92da2a8-25a2-462b-8f92-df20fc7c893b admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:09.662329 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92da2a8-25a2-462b-8f92-df20fc7c893b admin admin] PATH_INFO: `/v3/projects/55a5a52b1a2e4b17af3c2f3c864ec370/users/14069ea269bf40dba8d214e7943a7b79/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:09.664244 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561c7ef-22db-42ca-af45-9ba9ab1e1f96 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:09.682732 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561c7ef-22db-42ca-af45-9ba9ab1e1f96 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:09.689602 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb5c8b-abe3-40bb-98a9-889d86a77e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:09.691219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb5c8b-abe3-40bb-98a9-889d86a77e0c admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:09.691219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb5c8b-abe3-40bb-98a9-889d86a77e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:09.691219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb5c8b-abe3-40bb-98a9-889d86a77e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:09.691670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb5c8b-abe3-40bb-98a9-889d86a77e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:09.693092 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb5c8b-abe3-40bb-98a9-889d86a77e0c admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:09.704473 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92da2a8-25a2-462b-8f92-df20fc7c893b admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a5a52b1a2e4b17af3c2f3c864ec370, user_id=14069ea269bf40dba8d214e7943a7b79, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:09.708877 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 961/1931] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:09.710273 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92da2a8-25a2-462b-8f92-df20fc7c893b admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:09.713195 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb5c8b-abe3-40bb-98a9-889d86a77e0c admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:09.736726 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb5c8b-abe3-40bb-98a9-889d86a77e0c admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:09.739896 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 971/1932] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:09 2022] PUT /identity/v3/projects/55a5a52b1a2e4b17af3c2f3c864ec370/users/14069ea269bf40dba8d214e7943a7b79/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:09.746146 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92da2a8-25a2-462b-8f92-df20fc7c893b admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:09.769637 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:09.855669 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3e1dd-74eb-4b58-af98-b5663a404395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:09.857161 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3e1dd-74eb-4b58-af98-b5663a404395 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:09.858475 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3e1dd-74eb-4b58-af98-b5663a404395 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:09.859180 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3e1dd-74eb-4b58-af98-b5663a404395 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:09.860702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3e1dd-74eb-4b58-af98-b5663a404395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:09.864134 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3e1dd-74eb-4b58-af98-b5663a404395 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:09.889481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 962/1933] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:51:09.892091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92da2a8-25a2-462b-8f92-df20fc7c893b admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:09.893966 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3e1dd-74eb-4b58-af98-b5663a404395 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:09.901333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d702f-39d8-421c-9ea6-c5f05f660e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:09.902423 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d702f-39d8-421c-9ea6-c5f05f660e6f admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:09.903030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d702f-39d8-421c-9ea6-c5f05f660e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:09.903349 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d702f-39d8-421c-9ea6-c5f05f660e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:09.904679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d702f-39d8-421c-9ea6-c5f05f660e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:09.907757 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d702f-39d8-421c-9ea6-c5f05f660e6f admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:09.909324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3e1dd-74eb-4b58-af98-b5663a404395 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:09.915288 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922ee3a-c6be-4edb-ba66-3c6f63405a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:09.916435 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922ee3a-c6be-4edb-ba66-3c6f63405a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:09.916719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922ee3a-c6be-4edb-ba66-3c6f63405a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:09.917006 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922ee3a-c6be-4edb-ba66-3c6f63405a41 admin admin] PATH_INFO: `/v3/projects/d1d55bb98df042c5a39a66deb163d249/users/1ac0f185952f49b9a46990b07953ce71/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:09.930080 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 972/1934] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:51:09.936181 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d702f-39d8-421c-9ea6-c5f05f660e6f admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:09.957221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922ee3a-c6be-4edb-ba66-3c6f63405a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d55bb98df042c5a39a66deb163d249, user_id=1ac0f185952f49b9a46990b07953ce71, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:09.960318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922ee3a-c6be-4edb-ba66-3c6f63405a41 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:09.968414 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d702f-39d8-421c-9ea6-c5f05f660e6f admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:09.979474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028d562-4dbc-4b82-86b1-66d5fc08c9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:09.980735 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028d562-4dbc-4b82-86b1-66d5fc08c9a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:09.981289 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028d562-4dbc-4b82-86b1-66d5fc08c9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:09.981948 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028d562-4dbc-4b82-86b1-66d5fc08c9a4 admin admin] PATH_INFO: `/v3/projects/55a5a52b1a2e4b17af3c2f3c864ec370/users/14069ea269bf40dba8d214e7943a7b79/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:09.987819 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 963/1935] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:09 2022] PUT /identity/v3/projects/d1d55bb98df042c5a39a66deb163d249/users/1ac0f185952f49b9a46990b07953ce71/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:09.991938 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028d562-4dbc-4b82-86b1-66d5fc08c9a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a5a52b1a2e4b17af3c2f3c864ec370, user_id=14069ea269bf40dba8d214e7943a7b79, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:09.997208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028d562-4dbc-4b82-86b1-66d5fc08c9a4 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:10.007120 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc587e1c-a01f-40da-b9e8-2d65582a3522 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:10.007586 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc587e1c-a01f-40da-b9e8-2d65582a3522 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:10.008230 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc587e1c-a01f-40da-b9e8-2d65582a3522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:10.028580 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 973/1936] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:09 2022] PUT /identity/v3/projects/55a5a52b1a2e4b17af3c2f3c864ec370/users/14069ea269bf40dba8d214e7943a7b79/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:10.041163 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb889d-64ad-46bb-ab46-2cb03aa128e7 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:10.041688 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb889d-64ad-46bb-ab46-2cb03aa128e7 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:10.042014 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb889d-64ad-46bb-ab46-2cb03aa128e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:10.062068 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-bc587e1c-a01f-40da-b9e8-2d65582a3522 None None] MFA Rules not processed for user `1ac0f185952f49b9a46990b07953ce71`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:10.064009 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-bc587e1c-a01f-40da-b9e8-2d65582a3522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:10.100014 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-44cb889d-64ad-46bb-ab46-2cb03aa128e7 None None] MFA Rules not processed for user `14069ea269bf40dba8d214e7943a7b79`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:10.102503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-44cb889d-64ad-46bb-ab46-2cb03aa128e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:10.156971 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:10.218996 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 964/1937] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:10.245659 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc587e1c-a01f-40da-b9e8-2d65582a3522 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:10.248658 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-bc587e1c-a01f-40da-b9e8-2d65582a3522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:10.251223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 974/1938] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:10.308145 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb889d-64ad-46bb-ab46-2cb03aa128e7 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:10.309894 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-44cb889d-64ad-46bb-ab46-2cb03aa128e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:10.481035 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb889d-64ad-46bb-ab46-2cb03aa128e7 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:10.504569 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181639e3-afe2-4bb9-8c16-b618608bab5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:10.505876 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181639e3-afe2-4bb9-8c16-b618608bab5c service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:10.506373 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181639e3-afe2-4bb9-8c16-b618608bab5c service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:10.510207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181639e3-afe2-4bb9-8c16-b618608bab5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:10.514573 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc587e1c-a01f-40da-b9e8-2d65582a3522 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:10.520148 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b6993-3123-424d-a61f-18e7c7547e38 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbec984d81c84035887220056b3790ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:10.520885 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6993-3123-424d-a61f-18e7c7547e38 service glance] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:10.521391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6993-3123-424d-a61f-18e7c7547e38 service glance] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:10.521710 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6993-3123-424d-a61f-18e7c7547e38 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:10.536770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b6993-3123-424d-a61f-18e7c7547e38 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:10.539191 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b6993-3123-424d-a61f-18e7c7547e38 service glance] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:10.547038 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181639e3-afe2-4bb9-8c16-b618608bab5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:10.555473 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181639e3-afe2-4bb9-8c16-b618608bab5c service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:10.557146 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 965/1939] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:51:10.558471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b6993-3123-424d-a61f-18e7c7547e38 service glance] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:10.562563 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-863b6993-3123-424d-a61f-18e7c7547e38 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:10.605984 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 975/1940] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:51:10.834372 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b6993-3123-424d-a61f-18e7c7547e38 service glance] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:10.872999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669679f6-9e05-4deb-a6da-d2c4d0a4a9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:10.872999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669679f6-9e05-4deb-a6da-d2c4d0a4a9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:10.872999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669679f6-9e05-4deb-a6da-d2c4d0a4a9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:10.873622 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669679f6-9e05-4deb-a6da-d2c4d0a4a9b4 admin admin] PATH_INFO: `/v3/users/ec69d412a7954658921341f370c4d627` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:10.881794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669679f6-9e05-4deb-a6da-d2c4d0a4a9b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec69d412a7954658921341f370c4d627)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:10.894511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669679f6-9e05-4deb-a6da-d2c4d0a4a9b4 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:11.068117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-669679f6-9e05-4deb-a6da-d2c4d0a4a9b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec69d412a7954658921341f370c4d627'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:11.069104 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-669679f6-9e05-4deb-a6da-d2c4d0a4a9b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec69d412a7954658921341f370c4d627'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:11.088189 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-669679f6-9e05-4deb-a6da-d2c4d0a4a9b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec69d412a7954658921341f370c4d627'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:11.107744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:11.137972 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-669679f6-9e05-4deb-a6da-d2c4d0a4a9b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec69d412a7954658921341f370c4d627'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:11.158636 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-669679f6-9e05-4deb-a6da-d2c4d0a4a9b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec69d412a7954658921341f370c4d627'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:11.177769 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 966/1941] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:10 2022] DELETE /identity/v3/users/ec69d412a7954658921341f370c4d627 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:11.183412 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9a81d-5c16-4e14-b97b-b5cae7152598 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:11.183976 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9a81d-5c16-4e14-b97b-b5cae7152598 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:11.184069 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9a81d-5c16-4e14-b97b-b5cae7152598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:11.230039 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-18f9a81d-5c16-4e14-b97b-b5cae7152598 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:11.236011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-18f9a81d-5c16-4e14-b97b-b5cae7152598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:11.276593 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:11.438640 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 976/1942] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:11.534260 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669679f6-9e05-4deb-a6da-d2c4d0a4a9b4 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:11.541271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-669679f6-9e05-4deb-a6da-d2c4d0a4a9b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:11.778374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669679f6-9e05-4deb-a6da-d2c4d0a4a9b4 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:11.792071 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5bb9c-d90a-4293-b2b5-f6c7d591ed22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:11.793191 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5bb9c-d90a-4293-b2b5-f6c7d591ed22 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:11.794482 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5bb9c-d90a-4293-b2b5-f6c7d591ed22 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:11.795893 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5bb9c-d90a-4293-b2b5-f6c7d591ed22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:11.834218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5bb9c-d90a-4293-b2b5-f6c7d591ed22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:11.842680 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5bb9c-d90a-4293-b2b5-f6c7d591ed22 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:11.912792 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 967/1943] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:51:13.502108 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9a81d-5c16-4e14-b97b-b5cae7152598 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:13.503730 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-18f9a81d-5c16-4e14-b97b-b5cae7152598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:13.528635 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9a81d-5c16-4e14-b97b-b5cae7152598 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:13.540758 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c06ee-c9f9-48f6-b20e-82f6ecd4b167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:13.541764 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c06ee-c9f9-48f6-b20e-82f6ecd4b167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:13.542204 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c06ee-c9f9-48f6-b20e-82f6ecd4b167 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:13.542636 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c06ee-c9f9-48f6-b20e-82f6ecd4b167 admin admin] PATH_INFO: `/v3/users/f8f136548df54f9b8f63583f9b3d5fa8` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:13.546189 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c06ee-c9f9-48f6-b20e-82f6ecd4b167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8f136548df54f9b8f63583f9b3d5fa8)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:13.549462 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c06ee-c9f9-48f6-b20e-82f6ecd4b167 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:13.679347 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-8b6c06ee-c9f9-48f6-b20e-82f6ecd4b167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8f136548df54f9b8f63583f9b3d5fa8'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:13.700409 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-8b6c06ee-c9f9-48f6-b20e-82f6ecd4b167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8f136548df54f9b8f63583f9b3d5fa8'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:13.721990 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-8b6c06ee-c9f9-48f6-b20e-82f6ecd4b167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8f136548df54f9b8f63583f9b3d5fa8'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:13.722893 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-8b6c06ee-c9f9-48f6-b20e-82f6ecd4b167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8f136548df54f9b8f63583f9b3d5fa8'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:13.742944 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-8b6c06ee-c9f9-48f6-b20e-82f6ecd4b167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8f136548df54f9b8f63583f9b3d5fa8'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:13.751640 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 977/1944] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:13 2022] DELETE /identity/v3/users/f8f136548df54f9b8f63583f9b3d5fa8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:13.759236 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299df06d-e322-48a4-b8e4-a066e1c2b702 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:13.760082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299df06d-e322-48a4-b8e4-a066e1c2b702 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:13.760531 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299df06d-e322-48a4-b8e4-a066e1c2b702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:13.814058 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-299df06d-e322-48a4-b8e4-a066e1c2b702 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:13.832882 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-299df06d-e322-48a4-b8e4-a066e1c2b702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:13.984301 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 968/1945] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:13.999518 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c06ee-c9f9-48f6-b20e-82f6ecd4b167 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:14.001786 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-8b6c06ee-c9f9-48f6-b20e-82f6ecd4b167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:14.185812 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c06ee-c9f9-48f6-b20e-82f6ecd4b167 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:14.202350 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9381c-2566-4925-81bb-1364e05d680a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:14.202350 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9381c-2566-4925-81bb-1364e05d680a service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:14.202350 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9381c-2566-4925-81bb-1364e05d680a service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:14.202350 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9381c-2566-4925-81bb-1364e05d680a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:14.221434 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9381c-2566-4925-81bb-1364e05d680a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:14.225916 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9381c-2566-4925-81bb-1364e05d680a service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:14.227183 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299df06d-e322-48a4-b8e4-a066e1c2b702 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:14.228860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-299df06d-e322-48a4-b8e4-a066e1c2b702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:14.243960 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 978/1946] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:14.252091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299df06d-e322-48a4-b8e4-a066e1c2b702 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:14.259155 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb0d4e-8f77-4cba-9876-c23bbf347c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:14.260454 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb0d4e-8f77-4cba-9876-c23bbf347c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:14.266795 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb0d4e-8f77-4cba-9876-c23bbf347c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:14.273885 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb0d4e-8f77-4cba-9876-c23bbf347c2c admin admin] PATH_INFO: `/v3/projects/22f6cf536e97448f820e8fabed7ef2ad` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:14.277613 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb0d4e-8f77-4cba-9876-c23bbf347c2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=22f6cf536e97448f820e8fabed7ef2ad)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:14.281422 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb0d4e-8f77-4cba-9876-c23bbf347c2c admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:14.397671 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e2eb0d4e-8f77-4cba-9876-c23bbf347c2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f6cf536e97448f820e8fabed7ef2ad', 'request_id': 'req-e2eb0d4e-8f77-4cba-9876-c23bbf347c2c'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:14.414331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e2eb0d4e-8f77-4cba-9876-c23bbf347c2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f6cf536e97448f820e8fabed7ef2ad', 'request_id': 'req-e2eb0d4e-8f77-4cba-9876-c23bbf347c2c'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:14.464034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e2eb0d4e-8f77-4cba-9876-c23bbf347c2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f6cf536e97448f820e8fabed7ef2ad', 'request_id': 'req-e2eb0d4e-8f77-4cba-9876-c23bbf347c2c'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:14.490132 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e2eb0d4e-8f77-4cba-9876-c23bbf347c2c admin admin] The token cache is being invalidate because project 22f6cf536e97448f820e8fabed7ef2ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:14.490854 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e2eb0d4e-8f77-4cba-9876-c23bbf347c2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:14.494134 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e2eb0d4e-8f77-4cba-9876-c23bbf347c2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:14.498368 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 969/1947] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:14 2022] DELETE /identity/v3/projects/22f6cf536e97448f820e8fabed7ef2ad => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:14.508317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9381c-2566-4925-81bb-1364e05d680a service neutron] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:14.534699 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9381c-2566-4925-81bb-1364e05d680a service neutron] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:14.656665 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:14.710105 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85485478-476c-45dd-b691-ccf5af333627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:14.715729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85485478-476c-45dd-b691-ccf5af333627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:14.716153 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85485478-476c-45dd-b691-ccf5af333627 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:14.717244 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85485478-476c-45dd-b691-ccf5af333627 admin admin] PATH_INFO: `/v3/users/b614eb7473d14b68b175ff1eeb9d5da3` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:14.723679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85485478-476c-45dd-b691-ccf5af333627 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b614eb7473d14b68b175ff1eeb9d5da3)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:14.727563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85485478-476c-45dd-b691-ccf5af333627 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:14.829507 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb0d4e-8f77-4cba-9876-c23bbf347c2c admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:14.829507 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e2eb0d4e-8f77-4cba-9876-c23bbf347c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:14.841068 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:14.849458 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-85485478-476c-45dd-b691-ccf5af333627 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b614eb7473d14b68b175ff1eeb9d5da3'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:14.853499 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb0d4e-8f77-4cba-9876-c23bbf347c2c admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:14.868398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-85485478-476c-45dd-b691-ccf5af333627 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b614eb7473d14b68b175ff1eeb9d5da3'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:14.872073 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9476b9-a0dc-4d29-8ad3-ad0dcef7342f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:14.873783 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9476b9-a0dc-4d29-8ad3-ad0dcef7342f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:14.873783 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9476b9-a0dc-4d29-8ad3-ad0dcef7342f admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:14.874072 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9476b9-a0dc-4d29-8ad3-ad0dcef7342f admin admin] PATH_INFO: `/v3/projects/54e70a4e89524926809adadbd29f72bb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:14.875520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9476b9-a0dc-4d29-8ad3-ad0dcef7342f admin admin] RBAC: Authorizing `identity:delete_project(project_id=54e70a4e89524926809adadbd29f72bb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:14.877603 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9476b9-a0dc-4d29-8ad3-ad0dcef7342f admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:14.882371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-85485478-476c-45dd-b691-ccf5af333627 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b614eb7473d14b68b175ff1eeb9d5da3'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:14.883549 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-85485478-476c-45dd-b691-ccf5af333627 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b614eb7473d14b68b175ff1eeb9d5da3'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:14.911588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-85485478-476c-45dd-b691-ccf5af333627 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b614eb7473d14b68b175ff1eeb9d5da3'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:14.918841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 979/1948] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:14 2022] DELETE /identity/v3/users/b614eb7473d14b68b175ff1eeb9d5da3 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:14.964358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-6a9476b9-a0dc-4d29-8ad3-ad0dcef7342f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54e70a4e89524926809adadbd29f72bb', 'request_id': 'req-6a9476b9-a0dc-4d29-8ad3-ad0dcef7342f'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:14.980625 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-6a9476b9-a0dc-4d29-8ad3-ad0dcef7342f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54e70a4e89524926809adadbd29f72bb', 'request_id': 'req-6a9476b9-a0dc-4d29-8ad3-ad0dcef7342f'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:15.001175 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-6a9476b9-a0dc-4d29-8ad3-ad0dcef7342f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54e70a4e89524926809adadbd29f72bb', 'request_id': 'req-6a9476b9-a0dc-4d29-8ad3-ad0dcef7342f'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:15.032717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-6a9476b9-a0dc-4d29-8ad3-ad0dcef7342f admin admin] The token cache is being invalidate because project 54e70a4e89524926809adadbd29f72bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:15.033350 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-6a9476b9-a0dc-4d29-8ad3-ad0dcef7342f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:15.034836 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-6a9476b9-a0dc-4d29-8ad3-ad0dcef7342f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:15.038570 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 970/1949] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:14 2022] DELETE /identity/v3/projects/54e70a4e89524926809adadbd29f72bb => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:15.046456 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85485478-476c-45dd-b691-ccf5af333627 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:15.050418 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-85485478-476c-45dd-b691-ccf5af333627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:15.225276 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85485478-476c-45dd-b691-ccf5af333627 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:15.385760 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73298f5-9b5e-4c0a-b24b-96a1ed8da71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:15.387832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73298f5-9b5e-4c0a-b24b-96a1ed8da71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:15.388692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73298f5-9b5e-4c0a-b24b-96a1ed8da71e admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:15.389354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73298f5-9b5e-4c0a-b24b-96a1ed8da71e admin admin] PATH_INFO: `/v3/users/14069ea269bf40dba8d214e7943a7b79` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:15.392595 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73298f5-9b5e-4c0a-b24b-96a1ed8da71e admin admin] RBAC: Authorizing `identity:delete_user(user_id=14069ea269bf40dba8d214e7943a7b79)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:15.399527 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73298f5-9b5e-4c0a-b24b-96a1ed8da71e admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:15.406398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:15.491503 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9476b9-a0dc-4d29-8ad3-ad0dcef7342f admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:15.493435 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-6a9476b9-a0dc-4d29-8ad3-ad0dcef7342f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:15.551194 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9476b9-a0dc-4d29-8ad3-ad0dcef7342f admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:15.590007 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3408ad-6c35-4238-a216-6becf0212f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:15.599437 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3408ad-6c35-4238-a216-6becf0212f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:15.600104 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3408ad-6c35-4238-a216-6becf0212f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:15.600632 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3408ad-6c35-4238-a216-6becf0212f93 admin admin] PATH_INFO: `/v3/projects/ac051ce0598b45bfb8c34fee9855431d` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:15.608324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3408ad-6c35-4238-a216-6becf0212f93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac051ce0598b45bfb8c34fee9855431d)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:15.614569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3408ad-6c35-4238-a216-6becf0212f93 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:15.633928 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b73298f5-9b5e-4c0a-b24b-96a1ed8da71e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14069ea269bf40dba8d214e7943a7b79'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:15.652311 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b73298f5-9b5e-4c0a-b24b-96a1ed8da71e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14069ea269bf40dba8d214e7943a7b79'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:15.730438 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b73298f5-9b5e-4c0a-b24b-96a1ed8da71e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14069ea269bf40dba8d214e7943a7b79'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:15.732579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b73298f5-9b5e-4c0a-b24b-96a1ed8da71e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14069ea269bf40dba8d214e7943a7b79'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:15.762456 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-bd3408ad-6c35-4238-a216-6becf0212f93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac051ce0598b45bfb8c34fee9855431d', 'request_id': 'req-bd3408ad-6c35-4238-a216-6becf0212f93'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:15.778231 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-bd3408ad-6c35-4238-a216-6becf0212f93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac051ce0598b45bfb8c34fee9855431d', 'request_id': 'req-bd3408ad-6c35-4238-a216-6becf0212f93'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:15.802574 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-bd3408ad-6c35-4238-a216-6becf0212f93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac051ce0598b45bfb8c34fee9855431d', 'request_id': 'req-bd3408ad-6c35-4238-a216-6becf0212f93'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:15.818350 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b73298f5-9b5e-4c0a-b24b-96a1ed8da71e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14069ea269bf40dba8d214e7943a7b79'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:15.828611 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-bd3408ad-6c35-4238-a216-6becf0212f93 admin admin] The token cache is being invalidate because project ac051ce0598b45bfb8c34fee9855431d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:15.828944 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-bd3408ad-6c35-4238-a216-6becf0212f93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:15.832024 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-bd3408ad-6c35-4238-a216-6becf0212f93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:15.836208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 971/1950] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:15 2022] DELETE /identity/v3/projects/ac051ce0598b45bfb8c34fee9855431d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:15.843069 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d32613-1374-4ef0-85ef-6f8e95560697 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:15.843069 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d32613-1374-4ef0-85ef-6f8e95560697 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:15.843418 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d32613-1374-4ef0-85ef-6f8e95560697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:15.864669 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 980/1951] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:15 2022] DELETE /identity/v3/users/14069ea269bf40dba8d214e7943a7b79 => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:15.914884 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-24d32613-1374-4ef0-85ef-6f8e95560697 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:15.917701 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-24d32613-1374-4ef0-85ef-6f8e95560697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:16.144681 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 972/1952] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:16.160986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017cdd8-25fa-4cb6-ab94-19b6159ddfe7 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:16.161474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017cdd8-25fa-4cb6-ab94-19b6159ddfe7 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:16.162151 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017cdd8-25fa-4cb6-ab94-19b6159ddfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:16.258321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-d017cdd8-25fa-4cb6-ab94-19b6159ddfe7 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:16.269773 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-d017cdd8-25fa-4cb6-ab94-19b6159ddfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:16.313030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 981/1953] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:16.320445 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d32613-1374-4ef0-85ef-6f8e95560697 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:16.350557 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d32613-1374-4ef0-85ef-6f8e95560697 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:16.373560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf60be-5eb9-4cb4-9fc1-236c341370ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:16.374696 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf60be-5eb9-4cb4-9fc1-236c341370ec admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:16.375143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf60be-5eb9-4cb4-9fc1-236c341370ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:16.380008 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf60be-5eb9-4cb4-9fc1-236c341370ec admin admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:16.381278 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf60be-5eb9-4cb4-9fc1-236c341370ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:51:16.385100 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf60be-5eb9-4cb4-9fc1-236c341370ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:16.389231 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf60be-5eb9-4cb4-9fc1-236c341370ec admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:16.418426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:16.443348 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 973/1954] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:51:16.451056 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017cdd8-25fa-4cb6-ab94-19b6159ddfe7 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:16.474092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017cdd8-25fa-4cb6-ab94-19b6159ddfe7 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:16.483938 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9ddaa-4bf4-4249-a7fb-34432d465a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:16.484612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9ddaa-4bf4-4249-a7fb-34432d465a82 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:16.485111 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9ddaa-4bf4-4249-a7fb-34432d465a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:16.485383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9ddaa-4bf4-4249-a7fb-34432d465a82 admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:16.486085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9ddaa-4bf4-4249-a7fb-34432d465a82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:16.490264 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9ddaa-4bf4-4249-a7fb-34432d465a82 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:16.593125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 982/1955] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:16 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:51:16.597618 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf60be-5eb9-4cb4-9fc1-236c341370ec admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:16.620635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf60be-5eb9-4cb4-9fc1-236c341370ec admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:16.673578 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9ddaa-4bf4-4249-a7fb-34432d465a82 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:16.675923 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-d1f9ddaa-4bf4-4249-a7fb-34432d465a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:16.730952 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887d6b8-d6a4-4be6-addb-569afca1d4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:16.731565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887d6b8-d6a4-4be6-addb-569afca1d4ec admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:16.732589 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887d6b8-d6a4-4be6-addb-569afca1d4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:16.732965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887d6b8-d6a4-4be6-addb-569afca1d4ec admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:16.734415 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0887d6b8-d6a4-4be6-addb-569afca1d4ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:16.738217 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0887d6b8-d6a4-4be6-addb-569afca1d4ec admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:16.791971 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 974/1956] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:16 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:16.793700 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887d6b8-d6a4-4be6-addb-569afca1d4ec admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:16.807988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9ddaa-4bf4-4249-a7fb-34432d465a82 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:16.812664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887d6b8-d6a4-4be6-addb-569afca1d4ec admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:16.815078 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e846c0-a3ee-448a-b00e-2e638d9a8566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:16.815915 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e846c0-a3ee-448a-b00e-2e638d9a8566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:16.816247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e846c0-a3ee-448a-b00e-2e638d9a8566 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:16.816520 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e846c0-a3ee-448a-b00e-2e638d9a8566 admin admin] PATH_INFO: `/v3/projects/55a5a52b1a2e4b17af3c2f3c864ec370` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:16.818640 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e846c0-a3ee-448a-b00e-2e638d9a8566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55a5a52b1a2e4b17af3c2f3c864ec370)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:16.819943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e630a19-991b-4cd4-8eb2-5da02935ebc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:16.820876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e630a19-991b-4cd4-8eb2-5da02935ebc3 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:16.821318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e630a19-991b-4cd4-8eb2-5da02935ebc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:16.821816 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e630a19-991b-4cd4-8eb2-5da02935ebc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:16.822799 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e630a19-991b-4cd4-8eb2-5da02935ebc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:16.823048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e846c0-a3ee-448a-b00e-2e638d9a8566 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:16.824609 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e630a19-991b-4cd4-8eb2-5da02935ebc3 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:16.838616 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 975/1957] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:51:16.843762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e630a19-991b-4cd4-8eb2-5da02935ebc3 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:16.854525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e630a19-991b-4cd4-8eb2-5da02935ebc3 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:16.860326 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8348ab-8aa7-4296-aca2-6fe8911c94da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:16.861220 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8348ab-8aa7-4296-aca2-6fe8911c94da admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:16.861548 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8348ab-8aa7-4296-aca2-6fe8911c94da admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:16.861875 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8348ab-8aa7-4296-aca2-6fe8911c94da admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:16.863000 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8348ab-8aa7-4296-aca2-6fe8911c94da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:16.864627 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8348ab-8aa7-4296-aca2-6fe8911c94da admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:16.879488 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 976/1958] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:51:16.887271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8348ab-8aa7-4296-aca2-6fe8911c94da admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:16.910323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8348ab-8aa7-4296-aca2-6fe8911c94da admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:16.919894 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-33e846c0-a3ee-448a-b00e-2e638d9a8566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55a5a52b1a2e4b17af3c2f3c864ec370', 'request_id': 'req-33e846c0-a3ee-448a-b00e-2e638d9a8566'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:16.947063 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-33e846c0-a3ee-448a-b00e-2e638d9a8566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55a5a52b1a2e4b17af3c2f3c864ec370', 'request_id': 'req-33e846c0-a3ee-448a-b00e-2e638d9a8566'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:16.960692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:16.978297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-33e846c0-a3ee-448a-b00e-2e638d9a8566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55a5a52b1a2e4b17af3c2f3c864ec370', 'request_id': 'req-33e846c0-a3ee-448a-b00e-2e638d9a8566'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:17.003889 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-33e846c0-a3ee-448a-b00e-2e638d9a8566 admin admin] The token cache is being invalidate because project 55a5a52b1a2e4b17af3c2f3c864ec370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:17.003889 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-33e846c0-a3ee-448a-b00e-2e638d9a8566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:17.003889 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-33e846c0-a3ee-448a-b00e-2e638d9a8566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:17.005420 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 983/1959] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:16 2022] DELETE /identity/v3/projects/55a5a52b1a2e4b17af3c2f3c864ec370 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:17.012753 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add211ed-4ba9-4166-92df-f8d3c57be456 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:17.014448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add211ed-4ba9-4166-92df-f8d3c57be456 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:17.014448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add211ed-4ba9-4166-92df-f8d3c57be456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:17.055166 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-add211ed-4ba9-4166-92df-f8d3c57be456 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:17.057345 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-add211ed-4ba9-4166-92df-f8d3c57be456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:17.133001 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acaf923-c8bd-45be-8915-1ecbe82ab455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:17.134722 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acaf923-c8bd-45be-8915-1ecbe82ab455 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:17.135420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acaf923-c8bd-45be-8915-1ecbe82ab455 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:17.136128 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acaf923-c8bd-45be-8915-1ecbe82ab455 admin admin] PATH_INFO: `/v3/projects/a84ae79f83fe45d39385810fa403fd32/users/69c28399b75e4fd594febe05ef4c3293/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:17.168352 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acaf923-c8bd-45be-8915-1ecbe82ab455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a84ae79f83fe45d39385810fa403fd32, user_id=69c28399b75e4fd594febe05ef4c3293, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:17.174899 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acaf923-c8bd-45be-8915-1ecbe82ab455 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:17.209251 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 984/1960] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:17.219119 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 977/1961] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:16 2022] PUT /identity/v3/projects/a84ae79f83fe45d39385810fa403fd32/users/69c28399b75e4fd594febe05ef4c3293/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:17.219683 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb92ed9-b286-4a4f-89cf-c1aeb50d9472 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:17.220070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb92ed9-b286-4a4f-89cf-c1aeb50d9472 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:17.220823 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb92ed9-b286-4a4f-89cf-c1aeb50d9472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:17.241742 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56877a77-c223-49eb-bb66-2ba0059bc63c None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:17.241742 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56877a77-c223-49eb-bb66-2ba0059bc63c None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:17.241742 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56877a77-c223-49eb-bb66-2ba0059bc63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:17.252473 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-5bb92ed9-b286-4a4f-89cf-c1aeb50d9472 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:17.254222 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-5bb92ed9-b286-4a4f-89cf-c1aeb50d9472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:17.291464 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-56877a77-c223-49eb-bb66-2ba0059bc63c None None] MFA Rules not processed for user `69c28399b75e4fd594febe05ef4c3293`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:17.292997 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-56877a77-c223-49eb-bb66-2ba0059bc63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:17.348591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:17.422487 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 985/1962] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:17.429030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb92ed9-b286-4a4f-89cf-c1aeb50d9472 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:17.433754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 978/1963] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:17.442544 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56877a77-c223-49eb-bb66-2ba0059bc63c None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:17.450179 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-56877a77-c223-49eb-bb66-2ba0059bc63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:17.486012 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb92ed9-b286-4a4f-89cf-c1aeb50d9472 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:17.486281 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56877a77-c223-49eb-bb66-2ba0059bc63c None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:17.497254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f86bac-474b-439e-8b91-6418863e6007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:17.498710 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f86bac-474b-439e-8b91-6418863e6007 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:17.499157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f86bac-474b-439e-8b91-6418863e6007 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:17.499513 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f86bac-474b-439e-8b91-6418863e6007 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:17.500876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f86bac-474b-439e-8b91-6418863e6007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:17.503224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f86bac-474b-439e-8b91-6418863e6007 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:17.521319 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34a0e0-1ad3-4e5c-ab96-b699fb02d22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:17.522811 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34a0e0-1ad3-4e5c-ab96-b699fb02d22e admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:17.523003 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34a0e0-1ad3-4e5c-ab96-b699fb02d22e admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:17.523603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34a0e0-1ad3-4e5c-ab96-b699fb02d22e admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:17.531472 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34a0e0-1ad3-4e5c-ab96-b699fb02d22e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:51:17.531810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34a0e0-1ad3-4e5c-ab96-b699fb02d22e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:17.533677 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34a0e0-1ad3-4e5c-ab96-b699fb02d22e admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:17.590369 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 979/1964] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:17 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:17.596003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f86bac-474b-439e-8b91-6418863e6007 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:17.602157 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 986/1965] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:51:17.608895 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34a0e0-1ad3-4e5c-ab96-b699fb02d22e admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:17.657441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34a0e0-1ad3-4e5c-ab96-b699fb02d22e admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:17.804512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f86bac-474b-439e-8b91-6418863e6007 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:17.821240 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b10aa-20c0-4116-b75f-5953f03653b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:17.822246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b10aa-20c0-4116-b75f-5953f03653b1 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:17.823377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b10aa-20c0-4116-b75f-5953f03653b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:17.823843 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b10aa-20c0-4116-b75f-5953f03653b1 admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:17.825932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b10aa-20c0-4116-b75f-5953f03653b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:17.841865 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b10aa-20c0-4116-b75f-5953f03653b1 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:17.843420 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ad957-f9d1-4baf-ac21-a3ed82f120ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:17.845034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ad957-f9d1-4baf-ac21-a3ed82f120ef admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:17.845331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ad957-f9d1-4baf-ac21-a3ed82f120ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:17.845625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ad957-f9d1-4baf-ac21-a3ed82f120ef admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:17.846438 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ad957-f9d1-4baf-ac21-a3ed82f120ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:17.848851 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ad957-f9d1-4baf-ac21-a3ed82f120ef admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:17.881178 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:17.916438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 980/1966] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:17 2022] POST /identity/v3/users => generated 290 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:17.921121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b10aa-20c0-4116-b75f-5953f03653b1 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:17.921846 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 987/1967] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:17 2022] POST /identity/v3/projects => generated 379 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:51:17.928690 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ad957-f9d1-4baf-ac21-a3ed82f120ef admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:17.946811 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b10aa-20c0-4116-b75f-5953f03653b1 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:18.134222 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a1917-b12a-4773-bd42-e1a1fc04b40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:18.135401 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a1917-b12a-4773-bd42-e1a1fc04b40d admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:18.136112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a1917-b12a-4773-bd42-e1a1fc04b40d admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:18.137148 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a1917-b12a-4773-bd42-e1a1fc04b40d admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:18.144040 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a1917-b12a-4773-bd42-e1a1fc04b40d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:18.148825 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a1917-b12a-4773-bd42-e1a1fc04b40d admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:18.162913 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ad957-f9d1-4baf-ac21-a3ed82f120ef admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:18.179499 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 981/1968] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:18.181897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a1917-b12a-4773-bd42-e1a1fc04b40d admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:18.191677 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f20ba-55f8-42c4-bae9-98741cb0c1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:18.196144 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f20ba-55f8-42c4-bae9-98741cb0c1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:18.196652 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f20ba-55f8-42c4-bae9-98741cb0c1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:18.199864 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f20ba-55f8-42c4-bae9-98741cb0c1a0 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:18.200524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f20ba-55f8-42c4-bae9-98741cb0c1a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:18.206796 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f20ba-55f8-42c4-bae9-98741cb0c1a0 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:18.224950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a1917-b12a-4773-bd42-e1a1fc04b40d admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:18.246367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c1ff1-6bb4-479e-a33a-1acf74374c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:18.249187 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c1ff1-6bb4-479e-a33a-1acf74374c0c admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:18.249638 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c1ff1-6bb4-479e-a33a-1acf74374c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:18.259751 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c1ff1-6bb4-479e-a33a-1acf74374c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:18.261175 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c1ff1-6bb4-479e-a33a-1acf74374c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:18.266287 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c1ff1-6bb4-479e-a33a-1acf74374c0c admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:18.301972 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 988/1969] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:17 2022] POST /identity/v3/users => generated 290 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:18.303578 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f20ba-55f8-42c4-bae9-98741cb0c1a0 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:18.309306 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 982/1970] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:18.311908 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c1ff1-6bb4-479e-a33a-1acf74374c0c admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:18.339867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c1ff1-6bb4-479e-a33a-1acf74374c0c admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:18.349519 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f20ba-55f8-42c4-bae9-98741cb0c1a0 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:18.370913 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d265e7-d25f-42f8-8ba2-01c55695e631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:18.370913 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d265e7-d25f-42f8-8ba2-01c55695e631 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:18.370913 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d265e7-d25f-42f8-8ba2-01c55695e631 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:18.370913 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d265e7-d25f-42f8-8ba2-01c55695e631 admin admin] PATH_INFO: `/v3/projects/c6920c1d7c7f4e3e9b023cd4eb7f0c8d/users/12d47db3f75d46d39c2c6ee574c52004/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:18.373092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87297d1d-879b-47ba-a68b-050cf6a065d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:18.374403 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87297d1d-879b-47ba-a68b-050cf6a065d3 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:18.374542 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87297d1d-879b-47ba-a68b-050cf6a065d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:18.375048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87297d1d-879b-47ba-a68b-050cf6a065d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:18.376242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87297d1d-879b-47ba-a68b-050cf6a065d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:18.379608 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87297d1d-879b-47ba-a68b-050cf6a065d3 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:18.410495 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 989/1971] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:18.414868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87297d1d-879b-47ba-a68b-050cf6a065d3 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:18.430334 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d265e7-d25f-42f8-8ba2-01c55695e631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6920c1d7c7f4e3e9b023cd4eb7f0c8d, user_id=12d47db3f75d46d39c2c6ee574c52004, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:18.434270 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87297d1d-879b-47ba-a68b-050cf6a065d3 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:18.434534 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d265e7-d25f-42f8-8ba2-01c55695e631 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:18.447057 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8644b-f732-4825-82d8-f2b6c4fa4e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:18.448395 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8644b-f732-4825-82d8-f2b6c4fa4e3a admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:18.449294 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8644b-f732-4825-82d8-f2b6c4fa4e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:18.450812 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8644b-f732-4825-82d8-f2b6c4fa4e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:18.452396 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8644b-f732-4825-82d8-f2b6c4fa4e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:18.455731 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8644b-f732-4825-82d8-f2b6c4fa4e3a admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:18.471363 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 983/1972] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:18 2022] PUT /identity/v3/projects/c6920c1d7c7f4e3e9b023cd4eb7f0c8d/users/12d47db3f75d46d39c2c6ee574c52004/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:18.484978 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 990/1973] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:51:18.490781 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d265e7-d25f-42f8-8ba2-01c55695e631 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:18.495504 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6cfb6-64e1-47b8-8d93-0ab1c3649b66 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:18.496654 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6cfb6-64e1-47b8-8d93-0ab1c3649b66 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:18.498249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6cfb6-64e1-47b8-8d93-0ab1c3649b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:18.500809 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:18.573003 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-fbb6cfb6-64e1-47b8-8d93-0ab1c3649b66 None None] MFA Rules not processed for user `12d47db3f75d46d39c2c6ee574c52004`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:18.576135 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-fbb6cfb6-64e1-47b8-8d93-0ab1c3649b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:18.606090 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d265e7-d25f-42f8-8ba2-01c55695e631 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:18.612149 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda3202-39c8-4f88-9cc2-7e71bc26a650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:18.612865 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda3202-39c8-4f88-9cc2-7e71bc26a650 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:18.613150 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda3202-39c8-4f88-9cc2-7e71bc26a650 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:18.613586 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda3202-39c8-4f88-9cc2-7e71bc26a650 admin admin] PATH_INFO: `/v3/projects/6cd49dbbdb7140caa5e569465f9f54f9/users/54d3cf7e10aa45a49692dd06105b1e14/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:18.636068 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda3202-39c8-4f88-9cc2-7e71bc26a650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd49dbbdb7140caa5e569465f9f54f9, user_id=54d3cf7e10aa45a49692dd06105b1e14, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:18.639118 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda3202-39c8-4f88-9cc2-7e71bc26a650 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:18.663755 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 984/1974] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:18 2022] PUT /identity/v3/projects/6cd49dbbdb7140caa5e569465f9f54f9/users/54d3cf7e10aa45a49692dd06105b1e14/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:18.695347 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581147e-272c-4c2f-a2bc-2b082ef9954b None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:18.696977 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581147e-272c-4c2f-a2bc-2b082ef9954b None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:18.698288 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581147e-272c-4c2f-a2bc-2b082ef9954b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:18.749381 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 991/1975] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:18.754928 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6cfb6-64e1-47b8-8d93-0ab1c3649b66 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:18.762221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-2581147e-272c-4c2f-a2bc-2b082ef9954b None None] MFA Rules not processed for user `54d3cf7e10aa45a49692dd06105b1e14`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:18.768469 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-2581147e-272c-4c2f-a2bc-2b082ef9954b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:18.777377 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6cfb6-64e1-47b8-8d93-0ab1c3649b66 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:18.879730 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:18.916021 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a10f8-a56f-4565-89fa-a41a8111f1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:18.919929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a10f8-a56f-4565-89fa-a41a8111f1b5 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:18.921087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a10f8-a56f-4565-89fa-a41a8111f1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:18.921087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a10f8-a56f-4565-89fa-a41a8111f1b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:18.922100 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a10f8-a56f-4565-89fa-a41a8111f1b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:18.926146 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a10f8-a56f-4565-89fa-a41a8111f1b5 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:18.993491 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 992/1976] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:18 2022] POST /identity/v3/projects => generated 379 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:18.996883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a10f8-a56f-4565-89fa-a41a8111f1b5 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:19.007204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 985/1977] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:19.013637 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581147e-272c-4c2f-a2bc-2b082ef9954b None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:19.035023 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581147e-272c-4c2f-a2bc-2b082ef9954b None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:19.144788 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a10f8-a56f-4565-89fa-a41a8111f1b5 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:19.157572 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52d24d-abfb-4c23-a0b4-c5e5258d8295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:19.158220 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52d24d-abfb-4c23-a0b4-c5e5258d8295 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:19.158339 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48653fae-1664-4b03-8a74-e0671c8d5992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:19.158495 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52d24d-abfb-4c23-a0b4-c5e5258d8295 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:19.159009 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52d24d-abfb-4c23-a0b4-c5e5258d8295 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:19.159589 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48653fae-1664-4b03-8a74-e0671c8d5992 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:19.159698 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52d24d-abfb-4c23-a0b4-c5e5258d8295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:19.160533 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48653fae-1664-4b03-8a74-e0671c8d5992 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:19.161719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52d24d-abfb-4c23-a0b4-c5e5258d8295 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:19.162309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48653fae-1664-4b03-8a74-e0671c8d5992 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:19.163716 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48653fae-1664-4b03-8a74-e0671c8d5992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:19.168976 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48653fae-1664-4b03-8a74-e0671c8d5992 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:19.221553 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 986/1978] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:19 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:19.222614 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52d24d-abfb-4c23-a0b4-c5e5258d8295 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:19.233620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:19.240369 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 993/1979] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:18 2022] POST /identity/v3/users => generated 296 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:51:19.245751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48653fae-1664-4b03-8a74-e0671c8d5992 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:19.281441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48653fae-1664-4b03-8a74-e0671c8d5992 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:19.344238 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52d24d-abfb-4c23-a0b4-c5e5258d8295 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:19.366999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d601b-2ef1-40e6-b972-709c094804ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:19.367844 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d601b-2ef1-40e6-b972-709c094804ed admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:19.368218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d601b-2ef1-40e6-b972-709c094804ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:19.368502 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d601b-2ef1-40e6-b972-709c094804ed admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:19.369176 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d601b-2ef1-40e6-b972-709c094804ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:19.371652 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d601b-2ef1-40e6-b972-709c094804ed admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:19.469860 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ddef5-ded3-452c-b2e4-f12f63f3c84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:19.470916 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ddef5-ded3-452c-b2e4-f12f63f3c84f admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:19.471415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ddef5-ded3-452c-b2e4-f12f63f3c84f admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:19.471909 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ddef5-ded3-452c-b2e4-f12f63f3c84f admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:19.473500 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 987/1980] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:19 2022] POST /identity/v3/users => generated 297 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:19.475162 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ddef5-ded3-452c-b2e4-f12f63f3c84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:19.477473 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d601b-2ef1-40e6-b972-709c094804ed admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:19.481293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ddef5-ded3-452c-b2e4-f12f63f3c84f admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:19.491348 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d601b-2ef1-40e6-b972-709c094804ed admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:19.498472 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f40e63-619b-4621-b3e7-e6426a6ebc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:19.499734 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f40e63-619b-4621-b3e7-e6426a6ebc1f admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:19.500350 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f40e63-619b-4621-b3e7-e6426a6ebc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:19.500879 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f40e63-619b-4621-b3e7-e6426a6ebc1f admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:19.501954 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f40e63-619b-4621-b3e7-e6426a6ebc1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:19.503954 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f40e63-619b-4621-b3e7-e6426a6ebc1f admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:19.505284 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 994/1981] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:19.510101 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ddef5-ded3-452c-b2e4-f12f63f3c84f admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:19.520042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 988/1982] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:51:19.525522 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f40e63-619b-4621-b3e7-e6426a6ebc1f admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:19.531976 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ddef5-ded3-452c-b2e4-f12f63f3c84f admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:19.548040 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f40e63-619b-4621-b3e7-e6426a6ebc1f admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:19.551772 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b12b4-8a19-42ff-8170-8adf619861fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:19.552532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b12b4-8a19-42ff-8170-8adf619861fe admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:19.552905 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b12b4-8a19-42ff-8170-8adf619861fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:19.553204 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b12b4-8a19-42ff-8170-8adf619861fe admin admin] PATH_INFO: `/v3/projects/c68808f920d045799923db9044b3f3e7/users/02957721b4024b8e8678d7567f7d9f76/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:19.567218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363a5d3-ec1e-457f-964a-931231c3e44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:19.571253 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363a5d3-ec1e-457f-964a-931231c3e44b admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:19.572280 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363a5d3-ec1e-457f-964a-931231c3e44b admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:19.572583 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363a5d3-ec1e-457f-964a-931231c3e44b admin admin] PATH_INFO: `/v3/projects/c9aa23ca973842cd87fead6f3208edd6/users/9025d77e39864b6ba3a14b55077d0910/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:19.600429 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b12b4-8a19-42ff-8170-8adf619861fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c68808f920d045799923db9044b3f3e7, user_id=02957721b4024b8e8678d7567f7d9f76, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:19.603925 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b12b4-8a19-42ff-8170-8adf619861fe admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:19.615545 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363a5d3-ec1e-457f-964a-931231c3e44b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9aa23ca973842cd87fead6f3208edd6, user_id=9025d77e39864b6ba3a14b55077d0910, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:19.626434 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363a5d3-ec1e-457f-964a-931231c3e44b admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:19.636041 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 995/1983] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:19 2022] PUT /identity/v3/projects/c68808f920d045799923db9044b3f3e7/users/02957721b4024b8e8678d7567f7d9f76/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:19.641605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b12b4-8a19-42ff-8170-8adf619861fe admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:19.670440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 989/1984] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:19 2022] PUT /identity/v3/projects/c9aa23ca973842cd87fead6f3208edd6/users/9025d77e39864b6ba3a14b55077d0910/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:19.677250 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363a5d3-ec1e-457f-964a-931231c3e44b admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:19.796682 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:19.867038 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b12b4-8a19-42ff-8170-8adf619861fe admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:19.875314 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363a5d3-ec1e-457f-964a-931231c3e44b admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:19.881869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990905a-2315-4dbb-8a5e-5405173791cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:19.882925 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990905a-2315-4dbb-8a5e-5405173791cd admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:19.883401 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990905a-2315-4dbb-8a5e-5405173791cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:19.883858 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990905a-2315-4dbb-8a5e-5405173791cd admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:19.885161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990905a-2315-4dbb-8a5e-5405173791cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:19.885973 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9e5e3-7639-4981-9ede-b06781cbedef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:19.887536 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9e5e3-7639-4981-9ede-b06781cbedef admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:19.888916 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990905a-2315-4dbb-8a5e-5405173791cd admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:19.889207 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9e5e3-7639-4981-9ede-b06781cbedef admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:19.890258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9e5e3-7639-4981-9ede-b06781cbedef admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:19.892046 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9e5e3-7639-4981-9ede-b06781cbedef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:19.896431 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9e5e3-7639-4981-9ede-b06781cbedef admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:19.933894 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 990/1985] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:19.942036 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9e5e3-7639-4981-9ede-b06781cbedef admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:19.944172 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 996/1986] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:51:19.946707 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990905a-2315-4dbb-8a5e-5405173791cd admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:19.985331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990905a-2315-4dbb-8a5e-5405173791cd admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:19.985579 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9e5e3-7639-4981-9ede-b06781cbedef admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:19.995531 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9b3d7-aa0b-4886-a0da-79588bd29e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:19.997015 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9b3d7-aa0b-4886-a0da-79588bd29e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:19.998149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9b3d7-aa0b-4886-a0da-79588bd29e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:19.999045 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9b3d7-aa0b-4886-a0da-79588bd29e42 admin admin] PATH_INFO: `/v3/projects/c9aa23ca973842cd87fead6f3208edd6/users/9025d77e39864b6ba3a14b55077d0910/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:20.002774 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be9b3d7-aa0b-4886-a0da-79588bd29e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9aa23ca973842cd87fead6f3208edd6, user_id=9025d77e39864b6ba3a14b55077d0910, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:20.007681 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be9b3d7-aa0b-4886-a0da-79588bd29e42 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:20.009968 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6284e3-54e3-44cb-85e6-bc11dafdd277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:20.011071 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6284e3-54e3-44cb-85e6-bc11dafdd277 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:20.011546 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6284e3-54e3-44cb-85e6-bc11dafdd277 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:20.012015 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6284e3-54e3-44cb-85e6-bc11dafdd277 admin admin] PATH_INFO: `/v3/projects/c68808f920d045799923db9044b3f3e7/users/02957721b4024b8e8678d7567f7d9f76/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:20.032113 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6284e3-54e3-44cb-85e6-bc11dafdd277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c68808f920d045799923db9044b3f3e7, user_id=02957721b4024b8e8678d7567f7d9f76, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:20.044586 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 997/1987] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:19 2022] PUT /identity/v3/projects/c9aa23ca973842cd87fead6f3208edd6/users/9025d77e39864b6ba3a14b55077d0910/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:20.047872 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6284e3-54e3-44cb-85e6-bc11dafdd277 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:20.060898 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90052e4-5f3d-4d40-b489-c7fc844a6928 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:20.061624 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90052e4-5f3d-4d40-b489-c7fc844a6928 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:20.062303 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90052e4-5f3d-4d40-b489-c7fc844a6928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:20.084677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 991/1988] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:19 2022] PUT /identity/v3/projects/c68808f920d045799923db9044b3f3e7/users/02957721b4024b8e8678d7567f7d9f76/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:20.104551 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c45ad3-993b-4e79-bd40-09c1f883efb0 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:20.105255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c45ad3-993b-4e79-bd40-09c1f883efb0 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:20.106164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c45ad3-993b-4e79-bd40-09c1f883efb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:20.158227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-b90052e4-5f3d-4d40-b489-c7fc844a6928 None None] MFA Rules not processed for user `9025d77e39864b6ba3a14b55077d0910`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:20.166186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-b90052e4-5f3d-4d40-b489-c7fc844a6928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:20.208995 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-e7c45ad3-993b-4e79-bd40-09c1f883efb0 None None] MFA Rules not processed for user `02957721b4024b8e8678d7567f7d9f76`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:20.220817 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e7c45ad3-993b-4e79-bd40-09c1f883efb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:20.342543 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:20.521381 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 998/1989] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:20 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:20.538341 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 992/1990] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:20.553351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90052e4-5f3d-4d40-b489-c7fc844a6928 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:20.565026 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-b90052e4-5f3d-4d40-b489-c7fc844a6928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:20.571894 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c45ad3-993b-4e79-bd40-09c1f883efb0 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:20.574082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e7c45ad3-993b-4e79-bd40-09c1f883efb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:20.676392 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c45ad3-993b-4e79-bd40-09c1f883efb0 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:20.694531 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c950f-eace-4e03-abe1-141b8c4233c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:20.695677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c950f-eace-4e03-abe1-141b8c4233c8 service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:20.696656 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c950f-eace-4e03-abe1-141b8c4233c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:20.697057 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c950f-eace-4e03-abe1-141b8c4233c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:20.725696 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c950f-eace-4e03-abe1-141b8c4233c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:20.727463 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c950f-eace-4e03-abe1-141b8c4233c8 service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:20.744800 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 993/1991] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:20.769762 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90052e4-5f3d-4d40-b489-c7fc844a6928 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:20.783743 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8af2cb-d3c9-43be-bd7e-a25c4a396710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:20.784698 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8af2cb-d3c9-43be-bd7e-a25c4a396710 service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:20.785189 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8af2cb-d3c9-43be-bd7e-a25c4a396710 service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:20.785687 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8af2cb-d3c9-43be-bd7e-a25c4a396710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:20.813782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8af2cb-d3c9-43be-bd7e-a25c4a396710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:20.819155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8af2cb-d3c9-43be-bd7e-a25c4a396710 service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:20.855085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 999/1992] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:20 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:20.858639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c950f-eace-4e03-abe1-141b8c4233c8 service cinder] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:20.879891 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c950f-eace-4e03-abe1-141b8c4233c8 service cinder] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:20.901041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3cdc8-b183-4de1-b13d-25998b1bc35b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:20.901791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3cdc8-b183-4de1-b13d-25998b1bc35b service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:20.902076 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3cdc8-b183-4de1-b13d-25998b1bc35b service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:20.902354 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3cdc8-b183-4de1-b13d-25998b1bc35b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:21.008643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3cdc8-b183-4de1-b13d-25998b1bc35b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:21.033449 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3cdc8-b183-4de1-b13d-25998b1bc35b service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:21.055998 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 994/1993] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:22.256039 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8af2cb-d3c9-43be-bd7e-a25c4a396710 service cinder] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:22.415866 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:22.478901 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8af2cb-d3c9-43be-bd7e-a25c4a396710 service cinder] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:22.489280 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9f2e5-99ee-40fe-b42a-bba498193188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:22.490496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9f2e5-99ee-40fe-b42a-bba498193188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:22.490996 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9f2e5-99ee-40fe-b42a-bba498193188 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:22.491513 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9f2e5-99ee-40fe-b42a-bba498193188 admin admin] PATH_INFO: `/v3/users/54d3cf7e10aa45a49692dd06105b1e14` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:22.494126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9f2e5-99ee-40fe-b42a-bba498193188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54d3cf7e10aa45a49692dd06105b1e14)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:22.500910 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9f2e5-99ee-40fe-b42a-bba498193188 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:22.608717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-a1e9f2e5-99ee-40fe-b42a-bba498193188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54d3cf7e10aa45a49692dd06105b1e14'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:22.622105 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-a1e9f2e5-99ee-40fe-b42a-bba498193188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54d3cf7e10aa45a49692dd06105b1e14'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:22.632599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-a1e9f2e5-99ee-40fe-b42a-bba498193188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54d3cf7e10aa45a49692dd06105b1e14'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:22.633444 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-a1e9f2e5-99ee-40fe-b42a-bba498193188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54d3cf7e10aa45a49692dd06105b1e14'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:22.651344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-a1e9f2e5-99ee-40fe-b42a-bba498193188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54d3cf7e10aa45a49692dd06105b1e14'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:22.660621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1000/1994] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:22 2022] DELETE /identity/v3/users/54d3cf7e10aa45a49692dd06105b1e14 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:22.670949 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738425c7-297d-4c95-b032-d2d8d93cd54b None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:22.674665 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738425c7-297d-4c95-b032-d2d8d93cd54b None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:22.675659 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738425c7-297d-4c95-b032-d2d8d93cd54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:22.756101 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-738425c7-297d-4c95-b032-d2d8d93cd54b None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:22.760475 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-738425c7-297d-4c95-b032-d2d8d93cd54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:22.908015 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 995/1995] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:22.925128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9f2e5-99ee-40fe-b42a-bba498193188 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:22.927441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-a1e9f2e5-99ee-40fe-b42a-bba498193188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:23.039148 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9f2e5-99ee-40fe-b42a-bba498193188 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:23.046941 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d952cd-e5bf-4f02-b52e-4b88bf5d4c7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:23.048031 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d952cd-e5bf-4f02-b52e-4b88bf5d4c7d service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:23.048505 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d952cd-e5bf-4f02-b52e-4b88bf5d4c7d service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:23.048901 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d952cd-e5bf-4f02-b52e-4b88bf5d4c7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:23.067542 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d952cd-e5bf-4f02-b52e-4b88bf5d4c7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:23.071223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d952cd-e5bf-4f02-b52e-4b88bf5d4c7d service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:23.097279 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1001/1996] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:24.562459 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738425c7-297d-4c95-b032-d2d8d93cd54b None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:24.565353 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-738425c7-297d-4c95-b032-d2d8d93cd54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:24.606709 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738425c7-297d-4c95-b032-d2d8d93cd54b None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:24.628772 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd04f6-bcce-4799-a2da-f76b8b4c7976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:24.630574 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd04f6-bcce-4799-a2da-f76b8b4c7976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:24.631565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd04f6-bcce-4799-a2da-f76b8b4c7976 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:24.632338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd04f6-bcce-4799-a2da-f76b8b4c7976 admin admin] PATH_INFO: `/v3/projects/6cd49dbbdb7140caa5e569465f9f54f9` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:24.636238 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd04f6-bcce-4799-a2da-f76b8b4c7976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cd49dbbdb7140caa5e569465f9f54f9)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:24.643117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd04f6-bcce-4799-a2da-f76b8b4c7976 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:24.646377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:24.785179 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e5bd04f6-bcce-4799-a2da-f76b8b4c7976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd49dbbdb7140caa5e569465f9f54f9', 'request_id': 'req-e5bd04f6-bcce-4799-a2da-f76b8b4c7976'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:24.816823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e5bd04f6-bcce-4799-a2da-f76b8b4c7976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd49dbbdb7140caa5e569465f9f54f9', 'request_id': 'req-e5bd04f6-bcce-4799-a2da-f76b8b4c7976'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:24.846151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e5bd04f6-bcce-4799-a2da-f76b8b4c7976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd49dbbdb7140caa5e569465f9f54f9', 'request_id': 'req-e5bd04f6-bcce-4799-a2da-f76b8b4c7976'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:24.883686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e5bd04f6-bcce-4799-a2da-f76b8b4c7976 admin admin] The token cache is being invalidate because project 6cd49dbbdb7140caa5e569465f9f54f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:24.883686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e5bd04f6-bcce-4799-a2da-f76b8b4c7976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:24.885077 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e5bd04f6-bcce-4799-a2da-f76b8b4c7976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:24.888121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 996/1997] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:24 2022] DELETE /identity/v3/projects/6cd49dbbdb7140caa5e569465f9f54f9 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:24.895702 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d952cd-e5bf-4f02-b52e-4b88bf5d4c7d service neutron] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:24.924196 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d952cd-e5bf-4f02-b52e-4b88bf5d4c7d service neutron] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:25.052183 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79981d-8862-4713-be86-2730b5d345e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:25.053765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79981d-8862-4713-be86-2730b5d345e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:25.055071 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79981d-8862-4713-be86-2730b5d345e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:25.055071 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79981d-8862-4713-be86-2730b5d345e3 admin admin] PATH_INFO: `/v3/users/9025d77e39864b6ba3a14b55077d0910` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:25.058992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79981d-8862-4713-be86-2730b5d345e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9025d77e39864b6ba3a14b55077d0910)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:25.063510 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79981d-8862-4713-be86-2730b5d345e3 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:25.092924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:25.148349 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-5f79981d-8862-4713-be86-2730b5d345e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9025d77e39864b6ba3a14b55077d0910'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:25.158522 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-5f79981d-8862-4713-be86-2730b5d345e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9025d77e39864b6ba3a14b55077d0910'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:25.173091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-5f79981d-8862-4713-be86-2730b5d345e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9025d77e39864b6ba3a14b55077d0910'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:25.174320 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-5f79981d-8862-4713-be86-2730b5d345e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9025d77e39864b6ba3a14b55077d0910'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:25.192095 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-5f79981d-8862-4713-be86-2730b5d345e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9025d77e39864b6ba3a14b55077d0910'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:25.206245 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1002/1998] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:24 2022] DELETE /identity/v3/users/9025d77e39864b6ba3a14b55077d0910 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:25.990540 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd04f6-bcce-4799-a2da-f76b8b4c7976 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:25.993731 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e5bd04f6-bcce-4799-a2da-f76b8b4c7976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:26.022955 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd04f6-bcce-4799-a2da-f76b8b4c7976 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:26.164644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cce95-9797-4840-9b8b-3ef8764dcc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:26.165732 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cce95-9797-4840-9b8b-3ef8764dcc2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:26.166214 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cce95-9797-4840-9b8b-3ef8764dcc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:26.167253 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cce95-9797-4840-9b8b-3ef8764dcc2c admin admin] PATH_INFO: `/v3/users/69c28399b75e4fd594febe05ef4c3293` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:26.169744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cce95-9797-4840-9b8b-3ef8764dcc2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c28399b75e4fd594febe05ef4c3293)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:26.170838 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79981d-8862-4713-be86-2730b5d345e3 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:26.173798 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cce95-9797-4840-9b8b-3ef8764dcc2c admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:26.174929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-5f79981d-8862-4713-be86-2730b5d345e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:26.236816 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79981d-8862-4713-be86-2730b5d345e3 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:26.268081 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4ab00-e5ff-4bfe-a3c9-efeb8b41993e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:26.269172 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4ab00-e5ff-4bfe-a3c9-efeb8b41993e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:26.269717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4ab00-e5ff-4bfe-a3c9-efeb8b41993e admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:26.270205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4ab00-e5ff-4bfe-a3c9-efeb8b41993e admin admin] PATH_INFO: `/v3/projects/c9aa23ca973842cd87fead6f3208edd6` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:26.272656 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4ab00-e5ff-4bfe-a3c9-efeb8b41993e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9aa23ca973842cd87fead6f3208edd6)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:26.277227 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4ab00-e5ff-4bfe-a3c9-efeb8b41993e admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:26.333011 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-7a8cce95-9797-4840-9b8b-3ef8764dcc2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c28399b75e4fd594febe05ef4c3293'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:26.334890 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-7a8cce95-9797-4840-9b8b-3ef8764dcc2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c28399b75e4fd594febe05ef4c3293'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:26.354715 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-7a8cce95-9797-4840-9b8b-3ef8764dcc2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c28399b75e4fd594febe05ef4c3293'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:26.392254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-7a8cce95-9797-4840-9b8b-3ef8764dcc2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c28399b75e4fd594febe05ef4c3293'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:26.405783 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-37e4ab00-e5ff-4bfe-a3c9-efeb8b41993e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9aa23ca973842cd87fead6f3208edd6', 'request_id': 'req-37e4ab00-e5ff-4bfe-a3c9-efeb8b41993e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:26.408563 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-7a8cce95-9797-4840-9b8b-3ef8764dcc2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c28399b75e4fd594febe05ef4c3293'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:26.423034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 997/1999] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:25 2022] DELETE /identity/v3/users/69c28399b75e4fd594febe05ef4c3293 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:26.428826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cfe9a-9cc3-4c71-bf25-b2710cf34120 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:26.429523 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-37e4ab00-e5ff-4bfe-a3c9-efeb8b41993e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9aa23ca973842cd87fead6f3208edd6', 'request_id': 'req-37e4ab00-e5ff-4bfe-a3c9-efeb8b41993e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:26.429884 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cfe9a-9cc3-4c71-bf25-b2710cf34120 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:26.430821 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cfe9a-9cc3-4c71-bf25-b2710cf34120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:26.461027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-37e4ab00-e5ff-4bfe-a3c9-efeb8b41993e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9aa23ca973842cd87fead6f3208edd6', 'request_id': 'req-37e4ab00-e5ff-4bfe-a3c9-efeb8b41993e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:26.484988 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-4f0cfe9a-9cc3-4c71-bf25-b2710cf34120 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:26.485541 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-37e4ab00-e5ff-4bfe-a3c9-efeb8b41993e admin admin] The token cache is being invalidate because project c9aa23ca973842cd87fead6f3208edd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:26.486241 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-37e4ab00-e5ff-4bfe-a3c9-efeb8b41993e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:26.488241 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-37e4ab00-e5ff-4bfe-a3c9-efeb8b41993e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:26.489328 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-4f0cfe9a-9cc3-4c71-bf25-b2710cf34120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:26.492075 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1003/2000] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:26 2022] DELETE /identity/v3/projects/c9aa23ca973842cd87fead6f3208edd6 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:26.499161 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:26.499507 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640563a-27cd-40c2-aace-eff2fd74c4cb None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:26.500225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640563a-27cd-40c2-aace-eff2fd74c4cb None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:26.500953 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640563a-27cd-40c2-aace-eff2fd74c4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:26.547321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-c640563a-27cd-40c2-aace-eff2fd74c4cb None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:26.550610 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-c640563a-27cd-40c2-aace-eff2fd74c4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:26.676267 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 998/2001] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:26.695512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cfe9a-9cc3-4c71-bf25-b2710cf34120 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:26.697752 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-4f0cfe9a-9cc3-4c71-bf25-b2710cf34120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:26.746720 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1004/2002] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:26.766610 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476df1e-814f-4ec2-8cbe-1b3e39df615a None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:26.767848 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476df1e-814f-4ec2-8cbe-1b3e39df615a None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:26.771235 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476df1e-814f-4ec2-8cbe-1b3e39df615a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:26.843751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-c476df1e-814f-4ec2-8cbe-1b3e39df615a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:26.845832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-c476df1e-814f-4ec2-8cbe-1b3e39df615a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:26.862888 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1005/2003] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:26.868256 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476df1e-814f-4ec2-8cbe-1b3e39df615a None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:26.888751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476df1e-814f-4ec2-8cbe-1b3e39df615a None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:26.896811 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001110e6-e04e-49e8-b880-eeceb0c445ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:26.897513 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001110e6-e04e-49e8-b880-eeceb0c445ec admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:26.897988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001110e6-e04e-49e8-b880-eeceb0c445ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:26.898476 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001110e6-e04e-49e8-b880-eeceb0c445ec admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:26.899654 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001110e6-e04e-49e8-b880-eeceb0c445ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:51:26.900160 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001110e6-e04e-49e8-b880-eeceb0c445ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:26.903662 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001110e6-e04e-49e8-b880-eeceb0c445ec admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:26.907902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cfe9a-9cc3-4c71-bf25-b2710cf34120 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:26.909837 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:26.923018 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c407eb-e2a5-4de0-aa1b-f15c319d07af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:26.924040 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c407eb-e2a5-4de0-aa1b-f15c319d07af service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:26.924499 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c407eb-e2a5-4de0-aa1b-f15c319d07af service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:26.925457 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c407eb-e2a5-4de0-aa1b-f15c319d07af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:26.938156 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1006/2004] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:51:26.945276 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001110e6-e04e-49e8-b880-eeceb0c445ec admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:26.945613 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c407eb-e2a5-4de0-aa1b-f15c319d07af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:26.947145 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c407eb-e2a5-4de0-aa1b-f15c319d07af service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:26.961744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 999/2005] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:26.976781 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001110e6-e04e-49e8-b880-eeceb0c445ec admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:26.986473 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84384836-c315-4e9d-86fe-6eb99aa859a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:26.987806 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84384836-c315-4e9d-86fe-6eb99aa859a2 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:26.988254 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84384836-c315-4e9d-86fe-6eb99aa859a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:26.988684 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84384836-c315-4e9d-86fe-6eb99aa859a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:26.990269 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84384836-c315-4e9d-86fe-6eb99aa859a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:26.992672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84384836-c315-4e9d-86fe-6eb99aa859a2 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:27.040077 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1007/2006] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:26 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:27.048850 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c407eb-e2a5-4de0-aa1b-f15c319d07af service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:27.065376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c407eb-e2a5-4de0-aa1b-f15c319d07af service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:27.179873 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374eab2-1dcb-4b73-82aa-9279ceb8214b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:27.182226 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374eab2-1dcb-4b73-82aa-9279ceb8214b admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:27.182894 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374eab2-1dcb-4b73-82aa-9279ceb8214b admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:27.183576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374eab2-1dcb-4b73-82aa-9279ceb8214b admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:27.185775 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374eab2-1dcb-4b73-82aa-9279ceb8214b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:27.189714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374eab2-1dcb-4b73-82aa-9279ceb8214b admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:27.230319 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1000/2007] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:27 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:27.236223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84384836-c315-4e9d-86fe-6eb99aa859a2 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:27.250998 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84384836-c315-4e9d-86fe-6eb99aa859a2 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:27.256867 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66749ad-f6f1-4bcc-802a-ea65c19eed91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:27.257552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66749ad-f6f1-4bcc-802a-ea65c19eed91 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:27.257841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66749ad-f6f1-4bcc-802a-ea65c19eed91 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:27.258371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66749ad-f6f1-4bcc-802a-ea65c19eed91 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:27.259337 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66749ad-f6f1-4bcc-802a-ea65c19eed91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:27.261218 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66749ad-f6f1-4bcc-802a-ea65c19eed91 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:27.282006 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1008/2008] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:27.288971 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374eab2-1dcb-4b73-82aa-9279ceb8214b admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:27.311514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374eab2-1dcb-4b73-82aa-9279ceb8214b admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:27.321509 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59069c4-0207-4524-b634-45eba5d21b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:27.322528 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59069c4-0207-4524-b634-45eba5d21b07 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:27.323010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59069c4-0207-4524-b634-45eba5d21b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:27.323499 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59069c4-0207-4524-b634-45eba5d21b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:27.325275 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59069c4-0207-4524-b634-45eba5d21b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:27.328782 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59069c4-0207-4524-b634-45eba5d21b07 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:27.360003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1001/2009] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:27.363265 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66749ad-f6f1-4bcc-802a-ea65c19eed91 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:27.385740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66749ad-f6f1-4bcc-802a-ea65c19eed91 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:27.395921 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db4f5e-ff35-4cc5-8b15-8ce3e889f4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:27.397226 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db4f5e-ff35-4cc5-8b15-8ce3e889f4e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:27.397844 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db4f5e-ff35-4cc5-8b15-8ce3e889f4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:27.398425 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db4f5e-ff35-4cc5-8b15-8ce3e889f4e4 admin admin] PATH_INFO: `/v3/projects/a23937d2b9be417aa48212bce08bcb54/users/0671b4b4647c4061b92b871400f0b1df/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:27.428591 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db4f5e-ff35-4cc5-8b15-8ce3e889f4e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23937d2b9be417aa48212bce08bcb54, user_id=0671b4b4647c4061b92b871400f0b1df, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:27.435551 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db4f5e-ff35-4cc5-8b15-8ce3e889f4e4 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:27.459525 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1009/2010] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:27 2022] PUT /identity/v3/projects/a23937d2b9be417aa48212bce08bcb54/users/0671b4b4647c4061b92b871400f0b1df/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:27.479027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9ce14-4929-417e-a709-2d051df55021 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:27.479314 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9ce14-4929-417e-a709-2d051df55021 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:27.479593 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9ce14-4929-417e-a709-2d051df55021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:27.521071 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-24a9ce14-4929-417e-a709-2d051df55021 None None] MFA Rules not processed for user `0671b4b4647c4061b92b871400f0b1df`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:27.522672 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-24a9ce14-4929-417e-a709-2d051df55021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:27.563162 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:27.611958 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db4f5e-ff35-4cc5-8b15-8ce3e889f4e4 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:27.618267 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-d7db4f5e-ff35-4cc5-8b15-8ce3e889f4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:27.704694 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1002/2011] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:27.708946 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9ce14-4929-417e-a709-2d051df55021 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:27.775020 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db4f5e-ff35-4cc5-8b15-8ce3e889f4e4 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:27.781061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee9526-fcc2-4b32-8ce9-f5a0b8fd2bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:27.781925 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee9526-fcc2-4b32-8ce9-f5a0b8fd2bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:27.782274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee9526-fcc2-4b32-8ce9-f5a0b8fd2bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:27.782621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee9526-fcc2-4b32-8ce9-f5a0b8fd2bf1 admin admin] PATH_INFO: `/v3/projects/a84ae79f83fe45d39385810fa403fd32` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:27.784003 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee9526-fcc2-4b32-8ce9-f5a0b8fd2bf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a84ae79f83fe45d39385810fa403fd32)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:27.786105 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee9526-fcc2-4b32-8ce9-f5a0b8fd2bf1 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:27.818535 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9ce14-4929-417e-a709-2d051df55021 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:27.827510 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca4d69-9092-4a59-9a20-eb6bffb2c144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:27.830553 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca4d69-9092-4a59-9a20-eb6bffb2c144 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:27.830792 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca4d69-9092-4a59-9a20-eb6bffb2c144 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:27.831368 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca4d69-9092-4a59-9a20-eb6bffb2c144 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:27.834018 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca4d69-9092-4a59-9a20-eb6bffb2c144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:27.839160 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca4d69-9092-4a59-9a20-eb6bffb2c144 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:27.876968 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-15ee9526-fcc2-4b32-8ce9-f5a0b8fd2bf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a84ae79f83fe45d39385810fa403fd32', 'request_id': 'req-15ee9526-fcc2-4b32-8ce9-f5a0b8fd2bf1'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:27.891018 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-15ee9526-fcc2-4b32-8ce9-f5a0b8fd2bf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a84ae79f83fe45d39385810fa403fd32', 'request_id': 'req-15ee9526-fcc2-4b32-8ce9-f5a0b8fd2bf1'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:27.911610 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-15ee9526-fcc2-4b32-8ce9-f5a0b8fd2bf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a84ae79f83fe45d39385810fa403fd32', 'request_id': 'req-15ee9526-fcc2-4b32-8ce9-f5a0b8fd2bf1'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:27.916915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1003/2012] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:27 2022] POST /identity/v3/projects => generated 383 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:27.922317 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca4d69-9092-4a59-9a20-eb6bffb2c144 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:27.930273 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-15ee9526-fcc2-4b32-8ce9-f5a0b8fd2bf1 admin admin] The token cache is being invalidate because project a84ae79f83fe45d39385810fa403fd32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:27.930655 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-15ee9526-fcc2-4b32-8ce9-f5a0b8fd2bf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:27.931524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-15ee9526-fcc2-4b32-8ce9-f5a0b8fd2bf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:27.935096 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1010/2013] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:27 2022] DELETE /identity/v3/projects/a84ae79f83fe45d39385810fa403fd32 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:27.946906 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee9526-fcc2-4b32-8ce9-f5a0b8fd2bf1 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:27.948823 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-15ee9526-fcc2-4b32-8ce9-f5a0b8fd2bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:28.008522 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:28.091573 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee9526-fcc2-4b32-8ce9-f5a0b8fd2bf1 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:28.100337 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d8b37-d7d1-4854-adf8-bb1a9d41f8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:28.100528 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca4d69-9092-4a59-9a20-eb6bffb2c144 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:28.101215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d8b37-d7d1-4854-adf8-bb1a9d41f8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:28.101381 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d8b37-d7d1-4854-adf8-bb1a9d41f8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:28.101683 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d8b37-d7d1-4854-adf8-bb1a9d41f8b3 admin admin] PATH_INFO: `/v3/users/12d47db3f75d46d39c2c6ee574c52004` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:28.107158 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d8b37-d7d1-4854-adf8-bb1a9d41f8b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12d47db3f75d46d39c2c6ee574c52004)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:28.107158 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d8b37-d7d1-4854-adf8-bb1a9d41f8b3 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:28.112457 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f10ea-4fac-4f82-93db-6ab3ecbaa1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:28.115158 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f10ea-4fac-4f82-93db-6ab3ecbaa1ca admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:28.115158 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f10ea-4fac-4f82-93db-6ab3ecbaa1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:28.115158 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f10ea-4fac-4f82-93db-6ab3ecbaa1ca admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:28.116195 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f10ea-4fac-4f82-93db-6ab3ecbaa1ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:28.119448 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f10ea-4fac-4f82-93db-6ab3ecbaa1ca admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:28.167287 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1004/2014] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:27 2022] POST /identity/v3/users => generated 298 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:28.173842 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f10ea-4fac-4f82-93db-6ab3ecbaa1ca admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:28.177813 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-1a9f10ea-4fac-4f82-93db-6ab3ecbaa1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:28.202058 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f10ea-4fac-4f82-93db-6ab3ecbaa1ca admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:28.210649 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac360e-8c5b-4593-a4bb-e69196c4fe13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:28.211608 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac360e-8c5b-4593-a4bb-e69196c4fe13 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:28.212078 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac360e-8c5b-4593-a4bb-e69196c4fe13 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:28.212433 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b57d8b37-d7d1-4854-adf8-bb1a9d41f8b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12d47db3f75d46d39c2c6ee574c52004'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:28.212615 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac360e-8c5b-4593-a4bb-e69196c4fe13 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:28.213670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac360e-8c5b-4593-a4bb-e69196c4fe13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:28.219097 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac360e-8c5b-4593-a4bb-e69196c4fe13 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:28.232738 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b57d8b37-d7d1-4854-adf8-bb1a9d41f8b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12d47db3f75d46d39c2c6ee574c52004'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:28.248285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b57d8b37-d7d1-4854-adf8-bb1a9d41f8b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12d47db3f75d46d39c2c6ee574c52004'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:28.249798 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b57d8b37-d7d1-4854-adf8-bb1a9d41f8b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12d47db3f75d46d39c2c6ee574c52004'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:28.249982 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1005/2015] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:28.255262 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac360e-8c5b-4593-a4bb-e69196c4fe13 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:28.258057 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-daac360e-8c5b-4593-a4bb-e69196c4fe13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:28.280354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b57d8b37-d7d1-4854-adf8-bb1a9d41f8b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12d47db3f75d46d39c2c6ee574c52004'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:28.282005 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac360e-8c5b-4593-a4bb-e69196c4fe13 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:28.289604 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1011/2016] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:27 2022] DELETE /identity/v3/users/12d47db3f75d46d39c2c6ee574c52004 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:28.291744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8cc3f9-fe79-46fb-a05c-ccaef9f35a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:28.294650 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cc3f9-fe79-46fb-a05c-ccaef9f35a6f admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:28.295387 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cc3f9-fe79-46fb-a05c-ccaef9f35a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:28.296243 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cc3f9-fe79-46fb-a05c-ccaef9f35a6f admin admin] PATH_INFO: `/v3/projects/3fd10250a03e42dcbd09ea48157ec3e2/users/eadeb07b57614438a7428833f9b48405/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:28.325564 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8cc3f9-fe79-46fb-a05c-ccaef9f35a6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fd10250a03e42dcbd09ea48157ec3e2, user_id=eadeb07b57614438a7428833f9b48405, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:28.331631 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8cc3f9-fe79-46fb-a05c-ccaef9f35a6f admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:28.362246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:28.376909 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1006/2017] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:28 2022] PUT /identity/v3/projects/3fd10250a03e42dcbd09ea48157ec3e2/users/eadeb07b57614438a7428833f9b48405/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:28.380547 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d8b37-d7d1-4854-adf8-bb1a9d41f8b3 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:28.516637 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d8b37-d7d1-4854-adf8-bb1a9d41f8b3 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:28.616856 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8cc3f9-fe79-46fb-a05c-ccaef9f35a6f admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:28.619448 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-cc8cc3f9-fe79-46fb-a05c-ccaef9f35a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:28.640821 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:28.656769 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e303e4-53d5-4609-9f7a-3b6703f3238d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:28.656769 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e303e4-53d5-4609-9f7a-3b6703f3238d admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:28.656769 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e303e4-53d5-4609-9f7a-3b6703f3238d admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:28.657744 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e303e4-53d5-4609-9f7a-3b6703f3238d admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:28.658318 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e303e4-53d5-4609-9f7a-3b6703f3238d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:28.660172 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e303e4-53d5-4609-9f7a-3b6703f3238d admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:28.692017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1012/2018] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:28.698098 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e303e4-53d5-4609-9f7a-3b6703f3238d admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:28.744464 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e303e4-53d5-4609-9f7a-3b6703f3238d admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:28.758687 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318740bc-dfcd-4f52-bd15-ce57dd646fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:28.759769 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318740bc-dfcd-4f52-bd15-ce57dd646fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:28.760281 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318740bc-dfcd-4f52-bd15-ce57dd646fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:28.760785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318740bc-dfcd-4f52-bd15-ce57dd646fa8 admin admin] PATH_INFO: `/v3/projects/3fd10250a03e42dcbd09ea48157ec3e2/users/eadeb07b57614438a7428833f9b48405/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:28.765378 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318740bc-dfcd-4f52-bd15-ce57dd646fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fd10250a03e42dcbd09ea48157ec3e2, user_id=eadeb07b57614438a7428833f9b48405, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:28.780036 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8cc3f9-fe79-46fb-a05c-ccaef9f35a6f admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:28.785152 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318740bc-dfcd-4f52-bd15-ce57dd646fa8 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:28.799602 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139afbe-1090-4a94-b1c8-d9881f465d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:28.800791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139afbe-1090-4a94-b1c8-d9881f465d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:28.801453 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139afbe-1090-4a94-b1c8-d9881f465d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:28.801919 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139afbe-1090-4a94-b1c8-d9881f465d6c admin admin] PATH_INFO: `/v3/users/4cb0b71c2bda4920844e5d0d7f6cbc01` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:28.804687 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139afbe-1090-4a94-b1c8-d9881f465d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cb0b71c2bda4920844e5d0d7f6cbc01)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:28.808387 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139afbe-1090-4a94-b1c8-d9881f465d6c admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:28.811570 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1013/2019] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:28 2022] PUT /identity/v3/projects/3fd10250a03e42dcbd09ea48157ec3e2/users/eadeb07b57614438a7428833f9b48405/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:28.831937 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977536d2-ffd4-4d09-a32c-1dfc32bd467b None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:28.831937 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977536d2-ffd4-4d09-a32c-1dfc32bd467b None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:28.831937 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977536d2-ffd4-4d09-a32c-1dfc32bd467b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:28.892917 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-977536d2-ffd4-4d09-a32c-1dfc32bd467b None None] MFA Rules not processed for user `eadeb07b57614438a7428833f9b48405`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:28.896260 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-977536d2-ffd4-4d09-a32c-1dfc32bd467b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:28.907820 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-1139afbe-1090-4a94-b1c8-d9881f465d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cb0b71c2bda4920844e5d0d7f6cbc01'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:28.908731 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-1139afbe-1090-4a94-b1c8-d9881f465d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cb0b71c2bda4920844e5d0d7f6cbc01'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:28.924158 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-1139afbe-1090-4a94-b1c8-d9881f465d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cb0b71c2bda4920844e5d0d7f6cbc01'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:28.951440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-1139afbe-1090-4a94-b1c8-d9881f465d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cb0b71c2bda4920844e5d0d7f6cbc01'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:28.962037 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-1139afbe-1090-4a94-b1c8-d9881f465d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cb0b71c2bda4920844e5d0d7f6cbc01'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:28.977502 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1007/2020] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:28 2022] DELETE /identity/v3/users/4cb0b71c2bda4920844e5d0d7f6cbc01 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:28.979235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139afbe-1090-4a94-b1c8-d9881f465d6c admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:28.983215 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-1139afbe-1090-4a94-b1c8-d9881f465d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:29.032626 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1014/2021] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:29.034447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b168d09-8b94-47a4-abf0-edbe0a3a4111 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:29.034726 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b168d09-8b94-47a4-abf0-edbe0a3a4111 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:29.035071 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b168d09-8b94-47a4-abf0-edbe0a3a4111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:29.060549 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-5b168d09-8b94-47a4-abf0-edbe0a3a4111 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:29.062021 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-5b168d09-8b94-47a4-abf0-edbe0a3a4111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:29.075794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139afbe-1090-4a94-b1c8-d9881f465d6c admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:29.081118 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8593f9d-c006-480c-a727-3532cb85bf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:29.082107 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8593f9d-c006-480c-a727-3532cb85bf00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:29.082107 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8593f9d-c006-480c-a727-3532cb85bf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:29.082430 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8593f9d-c006-480c-a727-3532cb85bf00 admin admin] PATH_INFO: `/v3/projects/c6920c1d7c7f4e3e9b023cd4eb7f0c8d` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:29.083821 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8593f9d-c006-480c-a727-3532cb85bf00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6920c1d7c7f4e3e9b023cd4eb7f0c8d)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:29.086344 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8593f9d-c006-480c-a727-3532cb85bf00 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:29.119241 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:29.168149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1015/2022] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:29.168149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b168d09-8b94-47a4-abf0-edbe0a3a4111 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:29.169597 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-5b168d09-8b94-47a4-abf0-edbe0a3a4111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:29.175245 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-c8593f9d-c006-480c-a727-3532cb85bf00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6920c1d7c7f4e3e9b023cd4eb7f0c8d', 'request_id': 'req-c8593f9d-c006-480c-a727-3532cb85bf00'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:29.190991 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-c8593f9d-c006-480c-a727-3532cb85bf00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6920c1d7c7f4e3e9b023cd4eb7f0c8d', 'request_id': 'req-c8593f9d-c006-480c-a727-3532cb85bf00'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:29.204903 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-c8593f9d-c006-480c-a727-3532cb85bf00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6920c1d7c7f4e3e9b023cd4eb7f0c8d', 'request_id': 'req-c8593f9d-c006-480c-a727-3532cb85bf00'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:29.224012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-c8593f9d-c006-480c-a727-3532cb85bf00 admin admin] The token cache is being invalidate because project c6920c1d7c7f4e3e9b023cd4eb7f0c8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:29.224222 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-c8593f9d-c006-480c-a727-3532cb85bf00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:29.224785 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-c8593f9d-c006-480c-a727-3532cb85bf00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:29.226490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1008/2023] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:28 2022] DELETE /identity/v3/projects/c6920c1d7c7f4e3e9b023cd4eb7f0c8d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:29.227397 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8593f9d-c006-480c-a727-3532cb85bf00 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:29.231864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-c8593f9d-c006-480c-a727-3532cb85bf00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:29.279489 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b168d09-8b94-47a4-abf0-edbe0a3a4111 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:29.305392 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:29.325518 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8593f9d-c006-480c-a727-3532cb85bf00 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:29.330387 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa225594-611a-4fd1-9eaa-f5a4745c8590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:29.331021 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa225594-611a-4fd1-9eaa-f5a4745c8590 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:29.331298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa225594-611a-4fd1-9eaa-f5a4745c8590 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:29.331588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa225594-611a-4fd1-9eaa-f5a4745c8590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:29.334108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-aa225594-611a-4fd1-9eaa-f5a4745c8590 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:29.367263 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18973c75-826d-4d85-a614-ae06c719575d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:29.368722 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18973c75-826d-4d85-a614-ae06c719575d service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:29.369436 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18973c75-826d-4d85-a614-ae06c719575d service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:29.369956 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18973c75-826d-4d85-a614-ae06c719575d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:29.375278 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-18973c75-826d-4d85-a614-ae06c719575d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:29.431400 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa225594-611a-4fd1-9eaa-f5a4745c8590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:29.433340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa225594-611a-4fd1-9eaa-f5a4745c8590 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:29.445560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1009/2024] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:29.446539 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa225594-611a-4fd1-9eaa-f5a4745c8590 service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:29.447987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-aa225594-611a-4fd1-9eaa-f5a4745c8590 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:29.462454 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa225594-611a-4fd1-9eaa-f5a4745c8590 service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:29.469789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e10a91-1a5a-43f5-872f-f2f1422b2144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:29.470771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e10a91-1a5a-43f5-872f-f2f1422b2144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:29.470898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e10a91-1a5a-43f5-872f-f2f1422b2144 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:29.471164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e10a91-1a5a-43f5-872f-f2f1422b2144 admin admin] PATH_INFO: `/v3/users/02957721b4024b8e8678d7567f7d9f76` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:29.473148 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e10a91-1a5a-43f5-872f-f2f1422b2144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02957721b4024b8e8678d7567f7d9f76)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:29.475321 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e10a91-1a5a-43f5-872f-f2f1422b2144 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:29.488871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18973c75-826d-4d85-a614-ae06c719575d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:29.490738 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18973c75-826d-4d85-a614-ae06c719575d service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:29.504844 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1016/2025] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:29.551038 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-16e10a91-1a5a-43f5-872f-f2f1422b2144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02957721b4024b8e8678d7567f7d9f76'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:29.552355 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-16e10a91-1a5a-43f5-872f-f2f1422b2144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02957721b4024b8e8678d7567f7d9f76'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:29.567617 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-16e10a91-1a5a-43f5-872f-f2f1422b2144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02957721b4024b8e8678d7567f7d9f76'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:29.570849 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:29.605199 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-16e10a91-1a5a-43f5-872f-f2f1422b2144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02957721b4024b8e8678d7567f7d9f76'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:29.650428 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-16e10a91-1a5a-43f5-872f-f2f1422b2144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02957721b4024b8e8678d7567f7d9f76'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:29.670141 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1010/2026] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:29 2022] DELETE /identity/v3/users/02957721b4024b8e8678d7567f7d9f76 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:30.050478 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18973c75-826d-4d85-a614-ae06c719575d service cinder] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:30.054302 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-18973c75-826d-4d85-a614-ae06c719575d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:30.081831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18973c75-826d-4d85-a614-ae06c719575d service cinder] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:30.263079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7ba57-5f23-4620-a2da-418c78488b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:30.263917 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7ba57-5f23-4620-a2da-418c78488b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:30.266130 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7ba57-5f23-4620-a2da-418c78488b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:30.266646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7ba57-5f23-4620-a2da-418c78488b8c admin admin] PATH_INFO: `/v3/projects/3f8fa411f52e41199fc9d3707ec00b46` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:30.270689 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7ba57-5f23-4620-a2da-418c78488b8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f8fa411f52e41199fc9d3707ec00b46)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:30.274860 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7ba57-5f23-4620-a2da-418c78488b8c admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:30.392881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-d2b7ba57-5f23-4620-a2da-418c78488b8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f8fa411f52e41199fc9d3707ec00b46', 'request_id': 'req-d2b7ba57-5f23-4620-a2da-418c78488b8c'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:30.406940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-d2b7ba57-5f23-4620-a2da-418c78488b8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f8fa411f52e41199fc9d3707ec00b46', 'request_id': 'req-d2b7ba57-5f23-4620-a2da-418c78488b8c'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:30.419563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-d2b7ba57-5f23-4620-a2da-418c78488b8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f8fa411f52e41199fc9d3707ec00b46', 'request_id': 'req-d2b7ba57-5f23-4620-a2da-418c78488b8c'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:30.436240 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-d2b7ba57-5f23-4620-a2da-418c78488b8c admin admin] The token cache is being invalidate because project 3f8fa411f52e41199fc9d3707ec00b46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:30.436516 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-d2b7ba57-5f23-4620-a2da-418c78488b8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:30.437323 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-d2b7ba57-5f23-4620-a2da-418c78488b8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:30.440318 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1017/2027] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:30 2022] DELETE /identity/v3/projects/3f8fa411f52e41199fc9d3707ec00b46 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:30.446034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e10a91-1a5a-43f5-872f-f2f1422b2144 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:30.448136 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-16e10a91-1a5a-43f5-872f-f2f1422b2144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:30.456348 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7ba57-5f23-4620-a2da-418c78488b8c admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:30.458318 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-d2b7ba57-5f23-4620-a2da-418c78488b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:30.466174 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:30.471192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e10a91-1a5a-43f5-872f-f2f1422b2144 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:30.548581 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7ba57-5f23-4620-a2da-418c78488b8c admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:30.555813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a81047-4b42-4eac-bf10-a40b7812ec5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:30.556519 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a81047-4b42-4eac-bf10-a40b7812ec5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:30.556820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a81047-4b42-4eac-bf10-a40b7812ec5d admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:30.557077 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a81047-4b42-4eac-bf10-a40b7812ec5d admin admin] PATH_INFO: `/v3/projects/c68808f920d045799923db9044b3f3e7` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:30.558881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a81047-4b42-4eac-bf10-a40b7812ec5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c68808f920d045799923db9044b3f3e7)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:30.561816 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a81047-4b42-4eac-bf10-a40b7812ec5d admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:30.583518 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7675c6d-2263-4c12-87a8-3a5a615d7b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:30.584490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7675c6d-2263-4c12-87a8-3a5a615d7b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:30.584874 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7675c6d-2263-4c12-87a8-3a5a615d7b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:30.585644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7675c6d-2263-4c12-87a8-3a5a615d7b74 admin admin] PATH_INFO: `/v3/users/0ee1a1a949824adf9d5d02039a85fa0b` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:30.587532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7675c6d-2263-4c12-87a8-3a5a615d7b74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ee1a1a949824adf9d5d02039a85fa0b)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:30.589760 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7675c6d-2263-4c12-87a8-3a5a615d7b74 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:30.635174 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-71a81047-4b42-4eac-bf10-a40b7812ec5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c68808f920d045799923db9044b3f3e7', 'request_id': 'req-71a81047-4b42-4eac-bf10-a40b7812ec5d'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:30.647507 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-71a81047-4b42-4eac-bf10-a40b7812ec5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c68808f920d045799923db9044b3f3e7', 'request_id': 'req-71a81047-4b42-4eac-bf10-a40b7812ec5d'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:30.660555 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-71a81047-4b42-4eac-bf10-a40b7812ec5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c68808f920d045799923db9044b3f3e7', 'request_id': 'req-71a81047-4b42-4eac-bf10-a40b7812ec5d'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:30.667343 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a7675c6d-2263-4c12-87a8-3a5a615d7b74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ee1a1a949824adf9d5d02039a85fa0b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:30.669166 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a7675c6d-2263-4c12-87a8-3a5a615d7b74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ee1a1a949824adf9d5d02039a85fa0b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:30.678326 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-71a81047-4b42-4eac-bf10-a40b7812ec5d admin admin] The token cache is being invalidate because project c68808f920d045799923db9044b3f3e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:30.678889 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-71a81047-4b42-4eac-bf10-a40b7812ec5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:30.680104 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-71a81047-4b42-4eac-bf10-a40b7812ec5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:30.682813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1018/2028] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:30 2022] DELETE /identity/v3/projects/c68808f920d045799923db9044b3f3e7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:30.685158 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a7675c6d-2263-4c12-87a8-3a5a615d7b74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ee1a1a949824adf9d5d02039a85fa0b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:30.696238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e57f9-460d-4756-9705-17a901eccdd4 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:30.696748 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e57f9-460d-4756-9705-17a901eccdd4 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:30.697191 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e57f9-460d-4756-9705-17a901eccdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:30.707126 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a7675c6d-2263-4c12-87a8-3a5a615d7b74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ee1a1a949824adf9d5d02039a85fa0b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:30.732015 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-a18e57f9-460d-4756-9705-17a901eccdd4 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:30.732304 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a7675c6d-2263-4c12-87a8-3a5a615d7b74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ee1a1a949824adf9d5d02039a85fa0b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:30.732465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-a18e57f9-460d-4756-9705-17a901eccdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:30.736030 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1011/2029] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:30 2022] DELETE /identity/v3/users/0ee1a1a949824adf9d5d02039a85fa0b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:30.813670 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1019/2030] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:30.823865 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cd7f3-ff64-4da3-beb2-052e28c1ca61 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:30.824829 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cd7f3-ff64-4da3-beb2-052e28c1ca61 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:30.826136 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cd7f3-ff64-4da3-beb2-052e28c1ca61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:30.866444 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-5d2cd7f3-ff64-4da3-beb2-052e28c1ca61 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:30.868764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-5d2cd7f3-ff64-4da3-beb2-052e28c1ca61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:30.952471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:30.976174 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1012/2031] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:30.977984 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e57f9-460d-4756-9705-17a901eccdd4 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:30.997160 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e57f9-460d-4756-9705-17a901eccdd4 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:31.021442 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24d6e6-bac8-4fcb-9736-721363a83bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:31.021442 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24d6e6-bac8-4fcb-9736-721363a83bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:31.021442 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24d6e6-bac8-4fcb-9736-721363a83bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:31.021442 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24d6e6-bac8-4fcb-9736-721363a83bf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:31.022816 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24d6e6-bac8-4fcb-9736-721363a83bf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:51:31.022816 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24d6e6-bac8-4fcb-9736-721363a83bf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:31.022816 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24d6e6-bac8-4fcb-9736-721363a83bf1 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:31.048918 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1020/2032] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:51:31.054179 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cd7f3-ff64-4da3-beb2-052e28c1ca61 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:31.067060 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cd7f3-ff64-4da3-beb2-052e28c1ca61 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:31.072865 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399bf00-08b1-4a6f-b27b-8170fac17739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:31.073647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399bf00-08b1-4a6f-b27b-8170fac17739 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:31.073939 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399bf00-08b1-4a6f-b27b-8170fac17739 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:31.074257 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399bf00-08b1-4a6f-b27b-8170fac17739 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:31.075206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399bf00-08b1-4a6f-b27b-8170fac17739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:31.077710 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399bf00-08b1-4a6f-b27b-8170fac17739 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:31.121964 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1013/2033] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:31 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:51:31.127519 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24d6e6-bac8-4fcb-9736-721363a83bf1 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:31.140222 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24d6e6-bac8-4fcb-9736-721363a83bf1 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:31.167328 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:31.242139 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdb078-cc84-452c-aa53-eb826ff571c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:31.243664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399bf00-08b1-4a6f-b27b-8170fac17739 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:31.244525 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdb078-cc84-452c-aa53-eb826ff571c8 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:31.244911 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdb078-cc84-452c-aa53-eb826ff571c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:31.245293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdb078-cc84-452c-aa53-eb826ff571c8 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:31.247496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdb078-cc84-452c-aa53-eb826ff571c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:31.247768 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-7399bf00-08b1-4a6f-b27b-8170fac17739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:31.250821 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdb078-cc84-452c-aa53-eb826ff571c8 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:31.265558 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399bf00-08b1-4a6f-b27b-8170fac17739 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:31.272866 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0638e2-6c51-4df8-9854-c63fb1e5835d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:31.273639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0638e2-6c51-4df8-9854-c63fb1e5835d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:31.273818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0638e2-6c51-4df8-9854-c63fb1e5835d admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:31.274079 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0638e2-6c51-4df8-9854-c63fb1e5835d admin admin] PATH_INFO: `/v3/projects/5a430f3bb9c548cdac785a2af46ab0b2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:31.275408 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0638e2-6c51-4df8-9854-c63fb1e5835d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a430f3bb9c548cdac785a2af46ab0b2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:31.277382 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0638e2-6c51-4df8-9854-c63fb1e5835d admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:31.333395 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1021/2034] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:31 2022] POST /identity/v3/users => generated 286 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:31.336255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdb078-cc84-452c-aa53-eb826ff571c8 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:31.372889 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdb078-cc84-452c-aa53-eb826ff571c8 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:31.385254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-6f0638e2-6c51-4df8-9854-c63fb1e5835d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a430f3bb9c548cdac785a2af46ab0b2', 'request_id': 'req-6f0638e2-6c51-4df8-9854-c63fb1e5835d'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:31.394305 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-6f0638e2-6c51-4df8-9854-c63fb1e5835d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a430f3bb9c548cdac785a2af46ab0b2', 'request_id': 'req-6f0638e2-6c51-4df8-9854-c63fb1e5835d'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:31.407522 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-6f0638e2-6c51-4df8-9854-c63fb1e5835d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a430f3bb9c548cdac785a2af46ab0b2', 'request_id': 'req-6f0638e2-6c51-4df8-9854-c63fb1e5835d'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:31.430523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-6f0638e2-6c51-4df8-9854-c63fb1e5835d admin admin] The token cache is being invalidate because project 5a430f3bb9c548cdac785a2af46ab0b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:31.430849 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-6f0638e2-6c51-4df8-9854-c63fb1e5835d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:31.431671 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-6f0638e2-6c51-4df8-9854-c63fb1e5835d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:31.433518 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1014/2035] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:31 2022] DELETE /identity/v3/projects/5a430f3bb9c548cdac785a2af46ab0b2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:31.440249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66094b8-6912-409f-84b1-d28c260d6278 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:31.440539 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66094b8-6912-409f-84b1-d28c260d6278 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:31.440811 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66094b8-6912-409f-84b1-d28c260d6278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:31.466100 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-e66094b8-6912-409f-84b1-d28c260d6278 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:31.467448 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e66094b8-6912-409f-84b1-d28c260d6278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:31.470986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e205067-2e6e-4e86-86d3-fdea05d11f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:31.472011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e205067-2e6e-4e86-86d3-fdea05d11f2d admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:31.472465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e205067-2e6e-4e86-86d3-fdea05d11f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:31.472922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e205067-2e6e-4e86-86d3-fdea05d11f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:31.473789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e205067-2e6e-4e86-86d3-fdea05d11f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:31.477360 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e205067-2e6e-4e86-86d3-fdea05d11f2d admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:31.477647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1015/2036] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:31.486759 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89628439-d55c-4a8f-9a2c-e55a671122a8 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:31.486944 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89628439-d55c-4a8f-9a2c-e55a671122a8 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:31.487201 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89628439-d55c-4a8f-9a2c-e55a671122a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:31.501754 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1022/2037] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:51:31.504346 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e205067-2e6e-4e86-86d3-fdea05d11f2d admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:31.507539 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-1e205067-2e6e-4e86-86d3-fdea05d11f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:31.511644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-89628439-d55c-4a8f-9a2c-e55a671122a8 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:31.513926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-89628439-d55c-4a8f-9a2c-e55a671122a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:31.526933 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1016/2038] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:31.528668 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89628439-d55c-4a8f-9a2c-e55a671122a8 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:31.532659 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e205067-2e6e-4e86-86d3-fdea05d11f2d admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:31.540040 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89628439-d55c-4a8f-9a2c-e55a671122a8 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:31.541601 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568511e-23cb-4ad5-8543-41a3474c94d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:31.542711 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568511e-23cb-4ad5-8543-41a3474c94d7 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:31.543585 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568511e-23cb-4ad5-8543-41a3474c94d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:31.544667 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568511e-23cb-4ad5-8543-41a3474c94d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:31.545293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd243cbd-a5a0-41cd-9b26-e93e36e5722c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:31.545664 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568511e-23cb-4ad5-8543-41a3474c94d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:31.546046 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd243cbd-a5a0-41cd-9b26-e93e36e5722c admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:31.546333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd243cbd-a5a0-41cd-9b26-e93e36e5722c admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:31.546609 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd243cbd-a5a0-41cd-9b26-e93e36e5722c admin admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:31.547363 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd243cbd-a5a0-41cd-9b26-e93e36e5722c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:51:31.547679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd243cbd-a5a0-41cd-9b26-e93e36e5722c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:31.549806 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568511e-23cb-4ad5-8543-41a3474c94d7 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:31.549992 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd243cbd-a5a0-41cd-9b26-e93e36e5722c admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:31.566575 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1017/2039] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:51:31.572454 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd243cbd-a5a0-41cd-9b26-e93e36e5722c admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:31.578106 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1023/2040] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:31.584024 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568511e-23cb-4ad5-8543-41a3474c94d7 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:31.597970 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd243cbd-a5a0-41cd-9b26-e93e36e5722c admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:31.610029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568511e-23cb-4ad5-8543-41a3474c94d7 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:31.613922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c6d0e-f6fd-4cba-9e53-ecb0b313f9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:31.615376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c6d0e-f6fd-4cba-9e53-ecb0b313f9bb admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:31.615713 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c31721-9556-40df-afdf-1881d366865c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:31.616131 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c6d0e-f6fd-4cba-9e53-ecb0b313f9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:31.616426 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c31721-9556-40df-afdf-1881d366865c admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:31.616528 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c6d0e-f6fd-4cba-9e53-ecb0b313f9bb admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:31.616749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c31721-9556-40df-afdf-1881d366865c admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:31.617217 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c31721-9556-40df-afdf-1881d366865c admin admin] PATH_INFO: `/v3/projects/d16d1f6648cc41a48967d605fca1d6e1/users/5a52ac4245134f228971c972ce8ad04b/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:31.617715 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c6d0e-f6fd-4cba-9e53-ecb0b313f9bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:31.623119 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c6d0e-f6fd-4cba-9e53-ecb0b313f9bb admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:31.636353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c31721-9556-40df-afdf-1881d366865c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d16d1f6648cc41a48967d605fca1d6e1, user_id=5a52ac4245134f228971c972ce8ad04b, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:31.640557 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c31721-9556-40df-afdf-1881d366865c admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:31.661983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1024/2041] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:31 2022] PUT /identity/v3/projects/d16d1f6648cc41a48967d605fca1d6e1/users/5a52ac4245134f228971c972ce8ad04b/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:31.677542 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1018/2042] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:31 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:51:31.685348 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c6d0e-f6fd-4cba-9e53-ecb0b313f9bb admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:31.685954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13b49e-4392-402a-b5e1-92252200ed03 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:31.686433 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13b49e-4392-402a-b5e1-92252200ed03 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:31.686883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13b49e-4392-402a-b5e1-92252200ed03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:31.734735 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-8d13b49e-4392-402a-b5e1-92252200ed03 None None] MFA Rules not processed for user `5a52ac4245134f228971c972ce8ad04b`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:31.736198 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-8d13b49e-4392-402a-b5e1-92252200ed03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:31.795816 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c6d0e-f6fd-4cba-9e53-ecb0b313f9bb admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:31.802000 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315d947-cb9a-46cc-8f2b-71b0c1367019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:31.802631 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315d947-cb9a-46cc-8f2b-71b0c1367019 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:31.802908 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315d947-cb9a-46cc-8f2b-71b0c1367019 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:31.803179 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315d947-cb9a-46cc-8f2b-71b0c1367019 admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:31.803828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e315d947-cb9a-46cc-8f2b-71b0c1367019 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:31.805916 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e315d947-cb9a-46cc-8f2b-71b0c1367019 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:31.816822 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1025/2043] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:31.823099 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:31.839409 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13b49e-4392-402a-b5e1-92252200ed03 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:31.839642 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1019/2044] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:31 2022] POST /identity/v3/users => generated 283 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:51:31.842046 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-8d13b49e-4392-402a-b5e1-92252200ed03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:31.845828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315d947-cb9a-46cc-8f2b-71b0c1367019 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:31.847516 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:31.861853 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315d947-cb9a-46cc-8f2b-71b0c1367019 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:31.871416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfe9fc-ab7f-4fdb-93ff-f901725ea4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:31.872251 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfe9fc-ab7f-4fdb-93ff-f901725ea4fa admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:31.872635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfe9fc-ab7f-4fdb-93ff-f901725ea4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:31.873024 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfe9fc-ab7f-4fdb-93ff-f901725ea4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:31.874013 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfe9fc-ab7f-4fdb-93ff-f901725ea4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:31.876507 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfe9fc-ab7f-4fdb-93ff-f901725ea4fa admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:31.895817 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1020/2045] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:51:31.900838 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfe9fc-ab7f-4fdb-93ff-f901725ea4fa admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:31.912254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfe9fc-ab7f-4fdb-93ff-f901725ea4fa admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:31.917981 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d57f44-c679-4dfb-8b29-19d1850d42d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:31.919086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d57f44-c679-4dfb-8b29-19d1850d42d7 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:31.919446 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d57f44-c679-4dfb-8b29-19d1850d42d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:31.919719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d57f44-c679-4dfb-8b29-19d1850d42d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:31.920417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d57f44-c679-4dfb-8b29-19d1850d42d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:31.922030 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d57f44-c679-4dfb-8b29-19d1850d42d7 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:31.933377 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13b49e-4392-402a-b5e1-92252200ed03 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:31.936191 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1021/2046] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:51:31.939388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad033a-5b44-4f03-aafe-1ba5f1c9f121 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:31.940097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad033a-5b44-4f03-aafe-1ba5f1c9f121 service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:31.940624 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad033a-5b44-4f03-aafe-1ba5f1c9f121 service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:31.940897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d57f44-c679-4dfb-8b29-19d1850d42d7 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:31.941300 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad033a-5b44-4f03-aafe-1ba5f1c9f121 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:31.953184 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d57f44-c679-4dfb-8b29-19d1850d42d7 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:31.959157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2014c44-b113-44b7-905e-6ca8921a5871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:31.959931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2014c44-b113-44b7-905e-6ca8921a5871 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:31.960640 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2014c44-b113-44b7-905e-6ca8921a5871 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:31.960845 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2014c44-b113-44b7-905e-6ca8921a5871 admin admin] PATH_INFO: `/v3/projects/b5c3d37cef2f41d6b63a28661c3b1e95/users/d57ab7ae3e804ecb87482d1033f924c5/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:31.962311 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad033a-5b44-4f03-aafe-1ba5f1c9f121 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:31.966183 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad033a-5b44-4f03-aafe-1ba5f1c9f121 service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:31.982479 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2014c44-b113-44b7-905e-6ca8921a5871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5c3d37cef2f41d6b63a28661c3b1e95, user_id=d57ab7ae3e804ecb87482d1033f924c5, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:31.985799 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1026/2047] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:51:31.986056 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2014c44-b113-44b7-905e-6ca8921a5871 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:32.008132 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1022/2048] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:31 2022] PUT /identity/v3/projects/b5c3d37cef2f41d6b63a28661c3b1e95/users/d57ab7ae3e804ecb87482d1033f924c5/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:32.020199 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a844a19-bbb0-4346-a73c-3d786ac6af4e None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:32.020815 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a844a19-bbb0-4346-a73c-3d786ac6af4e None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:32.021266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a844a19-bbb0-4346-a73c-3d786ac6af4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:32.027339 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2014c44-b113-44b7-905e-6ca8921a5871 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:32.061470 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-4a844a19-bbb0-4346-a73c-3d786ac6af4e None None] MFA Rules not processed for user `d57ab7ae3e804ecb87482d1033f924c5`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:32.062717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-4a844a19-bbb0-4346-a73c-3d786ac6af4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:32.138954 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2014c44-b113-44b7-905e-6ca8921a5871 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:32.146498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85789f20-2643-4eec-8302-f7f6036e2da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:32.147169 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85789f20-2643-4eec-8302-f7f6036e2da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:32.147581 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85789f20-2643-4eec-8302-f7f6036e2da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:32.147761 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85789f20-2643-4eec-8302-f7f6036e2da8 admin admin] PATH_INFO: `/v3/users/5a52ac4245134f228971c972ce8ad04b` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:32.149067 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85789f20-2643-4eec-8302-f7f6036e2da8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a52ac4245134f228971c972ce8ad04b)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:32.151067 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85789f20-2643-4eec-8302-f7f6036e2da8 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:32.151606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1027/2049] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:32.157017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a844a19-bbb0-4346-a73c-3d786ac6af4e None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:32.167849 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a844a19-bbb0-4346-a73c-3d786ac6af4e None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:32.173365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c7821-5de5-4994-9f2a-28efb0bf52ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:32.174019 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c7821-5de5-4994-9f2a-28efb0bf52ce admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:32.174294 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c7821-5de5-4994-9f2a-28efb0bf52ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:32.174560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c7821-5de5-4994-9f2a-28efb0bf52ce admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:32.175195 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c7821-5de5-4994-9f2a-28efb0bf52ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:32.177087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c7821-5de5-4994-9f2a-28efb0bf52ce admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:32.210986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1028/2050] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:32 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:51:32.215107 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c7821-5de5-4994-9f2a-28efb0bf52ce admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:32.215426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-85789f20-2643-4eec-8302-f7f6036e2da8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a52ac4245134f228971c972ce8ad04b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:32.216112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-85789f20-2643-4eec-8302-f7f6036e2da8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a52ac4245134f228971c972ce8ad04b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:32.225206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-85789f20-2643-4eec-8302-f7f6036e2da8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a52ac4245134f228971c972ce8ad04b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:32.240514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-85789f20-2643-4eec-8302-f7f6036e2da8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a52ac4245134f228971c972ce8ad04b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:32.251923 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-85789f20-2643-4eec-8302-f7f6036e2da8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a52ac4245134f228971c972ce8ad04b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:32.259684 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1023/2051] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:32 2022] DELETE /identity/v3/users/5a52ac4245134f228971c972ce8ad04b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:32.265582 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e636d3-b8b7-47d1-b8e7-f6e552478935 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:32.266134 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e636d3-b8b7-47d1-b8e7-f6e552478935 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:32.266471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e636d3-b8b7-47d1-b8e7-f6e552478935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:32.289882 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-00e636d3-b8b7-47d1-b8e7-f6e552478935 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:32.292372 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-00e636d3-b8b7-47d1-b8e7-f6e552478935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:32.303985 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c7821-5de5-4994-9f2a-28efb0bf52ce admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:32.319633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:32.326392 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:32.372199 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1024/2052] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:32.379821 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86bb27-f6e0-447f-844a-e48d7c32cd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:32.380475 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86bb27-f6e0-447f-844a-e48d7c32cd19 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:32.380762 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86bb27-f6e0-447f-844a-e48d7c32cd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:32.381038 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86bb27-f6e0-447f-844a-e48d7c32cd19 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:32.381737 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86bb27-f6e0-447f-844a-e48d7c32cd19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:32.383282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e636d3-b8b7-47d1-b8e7-f6e552478935 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:32.383779 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86bb27-f6e0-447f-844a-e48d7c32cd19 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:32.384845 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-00e636d3-b8b7-47d1-b8e7-f6e552478935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:32.417594 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1029/2053] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:32 2022] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:51:32.419111 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86bb27-f6e0-447f-844a-e48d7c32cd19 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:32.424060 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-9c86bb27-f6e0-447f-844a-e48d7c32cd19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:32.439892 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86bb27-f6e0-447f-844a-e48d7c32cd19 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:32.446669 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af2ca3-5683-4ce4-84e2-0b1dae6af95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:32.447696 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af2ca3-5683-4ce4-84e2-0b1dae6af95f admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:32.447974 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af2ca3-5683-4ce4-84e2-0b1dae6af95f admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:32.448516 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af2ca3-5683-4ce4-84e2-0b1dae6af95f admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:32.449269 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af2ca3-5683-4ce4-84e2-0b1dae6af95f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:32.451788 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af2ca3-5683-4ce4-84e2-0b1dae6af95f admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:32.463442 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1030/2054] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:51:32.470007 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af2ca3-5683-4ce4-84e2-0b1dae6af95f admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:32.473570 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e636d3-b8b7-47d1-b8e7-f6e552478935 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:32.478395 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c7dc7-b202-401e-969e-016b5125a6a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:32.479892 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c7dc7-b202-401e-969e-016b5125a6a5 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:32.480184 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c7dc7-b202-401e-969e-016b5125a6a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:32.480460 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c7dc7-b202-401e-969e-016b5125a6a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:32.484344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af2ca3-5683-4ce4-84e2-0b1dae6af95f admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:32.491325 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a752089-5425-4f57-ae03-3082f51d47f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:32.492068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a752089-5425-4f57-ae03-3082f51d47f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:32.492324 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a752089-5425-4f57-ae03-3082f51d47f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:32.494092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a752089-5425-4f57-ae03-3082f51d47f0 admin admin] PATH_INFO: `/v3/projects/9405179c931c4ee2aa562dd0ef608c2a/users/028d321dcf964fbebdbb6484940ec4e9/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:32.496723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c7dc7-b202-401e-969e-016b5125a6a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:32.500119 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c7dc7-b202-401e-969e-016b5125a6a5 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:32.514487 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1025/2055] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:51:32.527007 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a752089-5425-4f57-ae03-3082f51d47f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9405179c931c4ee2aa562dd0ef608c2a, user_id=028d321dcf964fbebdbb6484940ec4e9, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:32.527007 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a752089-5425-4f57-ae03-3082f51d47f0 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:32.547478 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1031/2056] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:32 2022] PUT /identity/v3/projects/9405179c931c4ee2aa562dd0ef608c2a/users/028d321dcf964fbebdbb6484940ec4e9/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:32.551824 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c7dc7-b202-401e-969e-016b5125a6a5 service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:32.565718 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c7dc7-b202-401e-969e-016b5125a6a5 service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:32.685968 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d35148-aaf0-4479-8b5a-3aac2c747f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:32.687144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d35148-aaf0-4479-8b5a-3aac2c747f21 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:32.687462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d35148-aaf0-4479-8b5a-3aac2c747f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:32.687841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d35148-aaf0-4479-8b5a-3aac2c747f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:32.689285 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d35148-aaf0-4479-8b5a-3aac2c747f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:32.696607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d35148-aaf0-4479-8b5a-3aac2c747f21 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:32.729532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1026/2057] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:51:32.732568 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a752089-5425-4f57-ae03-3082f51d47f0 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:32.745708 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a752089-5425-4f57-ae03-3082f51d47f0 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:32.758778 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9de75-222c-41aa-8bb1-2cda5fe2f31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:32.759411 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9de75-222c-41aa-8bb1-2cda5fe2f31e admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:32.759855 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9de75-222c-41aa-8bb1-2cda5fe2f31e admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:32.760338 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9de75-222c-41aa-8bb1-2cda5fe2f31e admin admin] PATH_INFO: `/v3/projects/9405179c931c4ee2aa562dd0ef608c2a/users/028d321dcf964fbebdbb6484940ec4e9/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:32.764182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9de75-222c-41aa-8bb1-2cda5fe2f31e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9405179c931c4ee2aa562dd0ef608c2a, user_id=028d321dcf964fbebdbb6484940ec4e9, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:32.780536 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9de75-222c-41aa-8bb1-2cda5fe2f31e admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:32.795990 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1032/2058] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:32 2022] PUT /identity/v3/projects/9405179c931c4ee2aa562dd0ef608c2a/users/028d321dcf964fbebdbb6484940ec4e9/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:32.817937 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b19ba0-774e-4838-8731-7731b8300c8b None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:32.819013 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b19ba0-774e-4838-8731-7731b8300c8b None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:32.819013 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b19ba0-774e-4838-8731-7731b8300c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:32.883026 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-09b19ba0-774e-4838-8731-7731b8300c8b None None] MFA Rules not processed for user `028d321dcf964fbebdbb6484940ec4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:32.885463 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-09b19ba0-774e-4838-8731-7731b8300c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:32.958766 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:32.988864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1027/2059] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:33.010274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9de75-222c-41aa-8bb1-2cda5fe2f31e admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:33.012727 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-cdf9de75-222c-41aa-8bb1-2cda5fe2f31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:33.062181 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b19ba0-774e-4838-8731-7731b8300c8b None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:33.064959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-09b19ba0-774e-4838-8731-7731b8300c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:33.219577 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9de75-222c-41aa-8bb1-2cda5fe2f31e admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:33.226288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456305ed-c845-420d-8cf3-362c728fc726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:33.227242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456305ed-c845-420d-8cf3-362c728fc726 service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:33.227612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456305ed-c845-420d-8cf3-362c728fc726 service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:33.227953 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456305ed-c845-420d-8cf3-362c728fc726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:33.236527 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b19ba0-774e-4838-8731-7731b8300c8b None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:33.239710 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456305ed-c845-420d-8cf3-362c728fc726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:33.241897 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456305ed-c845-420d-8cf3-362c728fc726 service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:33.251946 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988822e-334c-4378-bbf8-13d3fa26a18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:33.253170 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988822e-334c-4378-bbf8-13d3fa26a18b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:33.253999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988822e-334c-4378-bbf8-13d3fa26a18b admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:33.255617 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1033/2060] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:33.255878 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988822e-334c-4378-bbf8-13d3fa26a18b admin admin] PATH_INFO: `/v3/projects/d16d1f6648cc41a48967d605fca1d6e1` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:33.258263 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988822e-334c-4378-bbf8-13d3fa26a18b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d16d1f6648cc41a48967d605fca1d6e1)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:33.264309 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988822e-334c-4378-bbf8-13d3fa26a18b admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:33.377980 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456305ed-c845-420d-8cf3-362c728fc726 service cinder] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:33.380511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a988822e-334c-4378-bbf8-13d3fa26a18b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd16d1f6648cc41a48967d605fca1d6e1', 'request_id': 'req-a988822e-334c-4378-bbf8-13d3fa26a18b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:33.392441 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a988822e-334c-4378-bbf8-13d3fa26a18b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd16d1f6648cc41a48967d605fca1d6e1', 'request_id': 'req-a988822e-334c-4378-bbf8-13d3fa26a18b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:33.394571 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456305ed-c845-420d-8cf3-362c728fc726 service cinder] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:33.406275 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a988822e-334c-4378-bbf8-13d3fa26a18b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd16d1f6648cc41a48967d605fca1d6e1', 'request_id': 'req-a988822e-334c-4378-bbf8-13d3fa26a18b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:33.423987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a988822e-334c-4378-bbf8-13d3fa26a18b admin admin] The token cache is being invalidate because project d16d1f6648cc41a48967d605fca1d6e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:33.424409 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a988822e-334c-4378-bbf8-13d3fa26a18b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:33.425242 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a988822e-334c-4378-bbf8-13d3fa26a18b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:33.427697 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1028/2061] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:33 2022] DELETE /identity/v3/projects/d16d1f6648cc41a48967d605fca1d6e1 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:33.435172 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f230816-f673-44e6-ba52-27ae788885a4 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:33.435728 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f230816-f673-44e6-ba52-27ae788885a4 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:33.436152 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f230816-f673-44e6-ba52-27ae788885a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:33.465916 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-6f230816-f673-44e6-ba52-27ae788885a4 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:33.466908 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-6f230816-f673-44e6-ba52-27ae788885a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:33.517037 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d816194-c33b-4060-953f-00cb581a6328 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:33.518151 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d816194-c33b-4060-953f-00cb581a6328 service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:33.518714 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d816194-c33b-4060-953f-00cb581a6328 service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:33.519260 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d816194-c33b-4060-953f-00cb581a6328 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:33.522532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-1d816194-c33b-4060-953f-00cb581a6328 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:33.544736 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1029/2062] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:33.554075 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd5610-3229-43bf-a2af-850275fd821e None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:33.554695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd5610-3229-43bf-a2af-850275fd821e None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:33.555458 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:33.556465 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd5610-3229-43bf-a2af-850275fd821e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:33.585026 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-cabd5610-3229-43bf-a2af-850275fd821e None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:33.586516 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-cabd5610-3229-43bf-a2af-850275fd821e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:33.596745 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1030/2063] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:33.601841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd5610-3229-43bf-a2af-850275fd821e None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:33.613565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd5610-3229-43bf-a2af-850275fd821e None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:33.620248 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad227a-7136-4773-9266-c741ac4e3ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:33.621687 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad227a-7136-4773-9266-c741ac4e3ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:33.621816 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad227a-7136-4773-9266-c741ac4e3ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:33.622068 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad227a-7136-4773-9266-c741ac4e3ff6 admin admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:33.622733 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad227a-7136-4773-9266-c741ac4e3ff6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:51:33.623195 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad227a-7136-4773-9266-c741ac4e3ff6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:33.625435 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad227a-7136-4773-9266-c741ac4e3ff6 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:33.637903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d816194-c33b-4060-953f-00cb581a6328 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:33.640849 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d816194-c33b-4060-953f-00cb581a6328 service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:33.648542 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1031/2064] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:51:33.652173 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1034/2065] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:33.659322 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad227a-7136-4773-9266-c741ac4e3ff6 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:33.663902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:33.671993 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad227a-7136-4773-9266-c741ac4e3ff6 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:33.680405 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5484c1-dc76-4f76-97d7-f0f21675a8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:33.681082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5484c1-dc76-4f76-97d7-f0f21675a8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:33.682917 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5484c1-dc76-4f76-97d7-f0f21675a8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:33.683380 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5484c1-dc76-4f76-97d7-f0f21675a8d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:33.685519 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5484c1-dc76-4f76-97d7-f0f21675a8d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:33.688855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5484c1-dc76-4f76-97d7-f0f21675a8d7 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:33.735201 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1032/2066] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:33 2022] POST /identity/v3/projects => generated 375 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:33.740828 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d816194-c33b-4060-953f-00cb581a6328 service cinder] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:33.754891 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d816194-c33b-4060-953f-00cb581a6328 service cinder] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:33.861977 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb65e20-510e-410d-b094-e57b64f9659e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:33.862628 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb65e20-510e-410d-b094-e57b64f9659e admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:33.862911 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb65e20-510e-410d-b094-e57b64f9659e admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:33.863185 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb65e20-510e-410d-b094-e57b64f9659e admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:33.863913 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb65e20-510e-410d-b094-e57b64f9659e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:33.865922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb65e20-510e-410d-b094-e57b64f9659e admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:33.894865 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1035/2067] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:33 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:33.899941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5484c1-dc76-4f76-97d7-f0f21675a8d7 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:33.912177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5484c1-dc76-4f76-97d7-f0f21675a8d7 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:33.918063 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ba74d-1cf7-435a-b382-089c43edff30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:33.919194 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ba74d-1cf7-435a-b382-089c43edff30 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:33.919494 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ba74d-1cf7-435a-b382-089c43edff30 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:33.919786 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ba74d-1cf7-435a-b382-089c43edff30 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:33.920552 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ba74d-1cf7-435a-b382-089c43edff30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:33.922312 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ba74d-1cf7-435a-b382-089c43edff30 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:33.937781 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1033/2068] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:33.939736 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb65e20-510e-410d-b094-e57b64f9659e admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:33.952435 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb65e20-510e-410d-b094-e57b64f9659e admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:33.957602 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83a8c9-b9cb-400c-95b0-a21e452dc759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:33.958244 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83a8c9-b9cb-400c-95b0-a21e452dc759 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:33.958528 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83a8c9-b9cb-400c-95b0-a21e452dc759 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:33.958804 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83a8c9-b9cb-400c-95b0-a21e452dc759 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:33.959472 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83a8c9-b9cb-400c-95b0-a21e452dc759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:33.961125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83a8c9-b9cb-400c-95b0-a21e452dc759 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:33.974441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1036/2069] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:33.989284 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ba74d-1cf7-435a-b382-089c43edff30 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:34.009638 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ba74d-1cf7-435a-b382-089c43edff30 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:34.019485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3482f77-b44d-4ec0-a710-a4d850635ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:34.020666 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3482f77-b44d-4ec0-a710-a4d850635ce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:34.021164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3482f77-b44d-4ec0-a710-a4d850635ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:34.021715 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3482f77-b44d-4ec0-a710-a4d850635ce1 admin admin] PATH_INFO: `/v3/projects/fe0b524c031b4e7497d137792cd99512/users/2747256757d849d5a98e88525fb9c568/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:34.054036 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3482f77-b44d-4ec0-a710-a4d850635ce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe0b524c031b4e7497d137792cd99512, user_id=2747256757d849d5a98e88525fb9c568, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:34.060608 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3482f77-b44d-4ec0-a710-a4d850635ce1 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:34.087953 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1034/2070] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:33 2022] PUT /identity/v3/projects/fe0b524c031b4e7497d137792cd99512/users/2747256757d849d5a98e88525fb9c568/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:34.108714 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae84ed-1a68-454f-8ab0-5eb10a23062b None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:34.109172 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae84ed-1a68-454f-8ab0-5eb10a23062b None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:34.109710 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae84ed-1a68-454f-8ab0-5eb10a23062b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:34.142645 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-79ae84ed-1a68-454f-8ab0-5eb10a23062b None None] MFA Rules not processed for user `2747256757d849d5a98e88525fb9c568`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:34.143807 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-79ae84ed-1a68-454f-8ab0-5eb10a23062b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:34.234106 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1037/2071] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:34.235334 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3482f77-b44d-4ec0-a710-a4d850635ce1 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:34.345857 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3482f77-b44d-4ec0-a710-a4d850635ce1 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:34.350935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622145d-95bc-46fd-9a2a-87f3386afa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:34.351660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622145d-95bc-46fd-9a2a-87f3386afa40 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:34.352033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622145d-95bc-46fd-9a2a-87f3386afa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:34.352309 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622145d-95bc-46fd-9a2a-87f3386afa40 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:34.352984 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622145d-95bc-46fd-9a2a-87f3386afa40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:34.355228 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622145d-95bc-46fd-9a2a-87f3386afa40 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:34.392220 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1035/2072] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:34 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:51:34.397680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae84ed-1a68-454f-8ab0-5eb10a23062b None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:34.410133 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae84ed-1a68-454f-8ab0-5eb10a23062b None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:34.446571 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:34.486920 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902884c4-132a-4c7e-a82b-72013bd08167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:34.487545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902884c4-132a-4c7e-a82b-72013bd08167 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:34.487827 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902884c4-132a-4c7e-a82b-72013bd08167 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:34.488107 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902884c4-132a-4c7e-a82b-72013bd08167 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:34.488760 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902884c4-132a-4c7e-a82b-72013bd08167 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:34.490822 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902884c4-132a-4c7e-a82b-72013bd08167 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:34.524091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1038/2073] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:34 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:51:34.526026 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622145d-95bc-46fd-9a2a-87f3386afa40 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:34.540566 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622145d-95bc-46fd-9a2a-87f3386afa40 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:34.547152 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade4c1c-a708-4523-a4b2-a7add08226c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:34.547930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade4c1c-a708-4523-a4b2-a7add08226c0 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:34.548264 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade4c1c-a708-4523-a4b2-a7add08226c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:34.548547 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade4c1c-a708-4523-a4b2-a7add08226c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:34.549218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade4c1c-a708-4523-a4b2-a7add08226c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:34.551065 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade4c1c-a708-4523-a4b2-a7add08226c0 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:34.565589 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1036/2074] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:34.570398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902884c4-132a-4c7e-a82b-72013bd08167 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:34.585812 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902884c4-132a-4c7e-a82b-72013bd08167 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:34.592512 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad5011-c949-49a5-ad0a-56c65a1fe111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:34.593436 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad5011-c949-49a5-ad0a-56c65a1fe111 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:34.593817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad5011-c949-49a5-ad0a-56c65a1fe111 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:34.594117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad5011-c949-49a5-ad0a-56c65a1fe111 admin admin] PATH_INFO: `/v3/projects/47b758acec7c413c812a7bc0e1456bae/users/def1bff7bb564d8cb28dbdd92cbab7ec/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:34.613132 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad5011-c949-49a5-ad0a-56c65a1fe111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47b758acec7c413c812a7bc0e1456bae, user_id=def1bff7bb564d8cb28dbdd92cbab7ec, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:34.616959 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad5011-c949-49a5-ad0a-56c65a1fe111 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:34.646093 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1039/2075] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:34 2022] PUT /identity/v3/projects/47b758acec7c413c812a7bc0e1456bae/users/def1bff7bb564d8cb28dbdd92cbab7ec/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:34.653296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade4c1c-a708-4523-a4b2-a7add08226c0 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:34.666783 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade4c1c-a708-4523-a4b2-a7add08226c0 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:34.784499 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf4e0c-33bb-401d-ba3a-844ba8cf53c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:34.785345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf4e0c-33bb-401d-ba3a-844ba8cf53c6 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:34.785632 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf4e0c-33bb-401d-ba3a-844ba8cf53c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:34.785912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf4e0c-33bb-401d-ba3a-844ba8cf53c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:34.786632 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf4e0c-33bb-401d-ba3a-844ba8cf53c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:34.788349 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf4e0c-33bb-401d-ba3a-844ba8cf53c6 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:34.805444 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1037/2076] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:34.808595 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad5011-c949-49a5-ad0a-56c65a1fe111 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:34.823650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad5011-c949-49a5-ad0a-56c65a1fe111 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:34.830311 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3eccbe-c5ca-4243-8e00-2c3edcf2692a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:34.831229 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3eccbe-c5ca-4243-8e00-2c3edcf2692a admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:34.831660 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3eccbe-c5ca-4243-8e00-2c3edcf2692a admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:34.832067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3eccbe-c5ca-4243-8e00-2c3edcf2692a admin admin] PATH_INFO: `/v3/projects/47b758acec7c413c812a7bc0e1456bae/users/def1bff7bb564d8cb28dbdd92cbab7ec/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:34.843926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3eccbe-c5ca-4243-8e00-2c3edcf2692a admin admin] RBAC: Authorizing `identity:create_grant(project_id=47b758acec7c413c812a7bc0e1456bae, user_id=def1bff7bb564d8cb28dbdd92cbab7ec, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:34.849928 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3eccbe-c5ca-4243-8e00-2c3edcf2692a admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:34.871121 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1040/2077] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:34 2022] PUT /identity/v3/projects/47b758acec7c413c812a7bc0e1456bae/users/def1bff7bb564d8cb28dbdd92cbab7ec/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:34.885104 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbec5c4-0f85-43af-a67a-070230f4ba85 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:34.890010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbec5c4-0f85-43af-a67a-070230f4ba85 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:34.890671 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbec5c4-0f85-43af-a67a-070230f4ba85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:34.946083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-4dbec5c4-0f85-43af-a67a-070230f4ba85 None None] MFA Rules not processed for user `def1bff7bb564d8cb28dbdd92cbab7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:34.947981 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-4dbec5c4-0f85-43af-a67a-070230f4ba85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:34.959757 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:35.052344 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1038/2078] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:35.066957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3eccbe-c5ca-4243-8e00-2c3edcf2692a admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:35.068796 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-5b3eccbe-c5ca-4243-8e00-2c3edcf2692a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:35.182575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3eccbe-c5ca-4243-8e00-2c3edcf2692a admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:35.191865 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc223a-4175-47c0-9994-d624a974c94f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:35.192933 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc223a-4175-47c0-9994-d624a974c94f service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:35.193388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc223a-4175-47c0-9994-d624a974c94f service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:35.193940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc223a-4175-47c0-9994-d624a974c94f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:35.323581 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc223a-4175-47c0-9994-d624a974c94f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:35.325311 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc223a-4175-47c0-9994-d624a974c94f service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:35.339483 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1041/2079] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:51:37.025490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbec5c4-0f85-43af-a67a-070230f4ba85 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:37.049603 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbec5c4-0f85-43af-a67a-070230f4ba85 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:37.056859 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b2f8f-bcd5-4ff7-bfa3-0b2e746c4144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:37.058423 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b2f8f-bcd5-4ff7-bfa3-0b2e746c4144 service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:37.059338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b2f8f-bcd5-4ff7-bfa3-0b2e746c4144 service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:37.059957 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b2f8f-bcd5-4ff7-bfa3-0b2e746c4144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:37.063341 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-5f5b2f8f-bcd5-4ff7-bfa3-0b2e746c4144 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:37.173972 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b2f8f-bcd5-4ff7-bfa3-0b2e746c4144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:37.175961 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b2f8f-bcd5-4ff7-bfa3-0b2e746c4144 service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:37.189777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1039/2080] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:39.659253 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc223a-4175-47c0-9994-d624a974c94f service cinder] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:39.704466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:39.748772 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc223a-4175-47c0-9994-d624a974c94f service cinder] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:39.753843 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b7c4c-1875-4143-9704-4f06e79138e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:39.754504 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b7c4c-1875-4143-9704-4f06e79138e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:39.754785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b7c4c-1875-4143-9704-4f06e79138e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:39.755064 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b7c4c-1875-4143-9704-4f06e79138e1 admin admin] PATH_INFO: `/v3/users/2747256757d849d5a98e88525fb9c568` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:39.756259 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b7c4c-1875-4143-9704-4f06e79138e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2747256757d849d5a98e88525fb9c568)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:39.758271 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b7c4c-1875-4143-9704-4f06e79138e1 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:39.830561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b2f8f-bcd5-4ff7-bfa3-0b2e746c4144 service cinder] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:39.832683 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-5f5b2f8f-bcd5-4ff7-bfa3-0b2e746c4144 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:39.842010 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-697b7c4c-1875-4143-9704-4f06e79138e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2747256757d849d5a98e88525fb9c568'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:39.858527 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-697b7c4c-1875-4143-9704-4f06e79138e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2747256757d849d5a98e88525fb9c568'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:39.863848 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b2f8f-bcd5-4ff7-bfa3-0b2e746c4144 service cinder] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:39.872717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123ee6e-5634-4543-9665-1f0eca09397d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:39.872988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-697b7c4c-1875-4143-9704-4f06e79138e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2747256757d849d5a98e88525fb9c568'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:39.874079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-697b7c4c-1875-4143-9704-4f06e79138e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2747256757d849d5a98e88525fb9c568'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:39.874570 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123ee6e-5634-4543-9665-1f0eca09397d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:39.875287 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123ee6e-5634-4543-9665-1f0eca09397d admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:39.875997 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123ee6e-5634-4543-9665-1f0eca09397d admin admin] PATH_INFO: `/v3/users/1ac0f185952f49b9a46990b07953ce71` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:39.879618 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123ee6e-5634-4543-9665-1f0eca09397d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ac0f185952f49b9a46990b07953ce71)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:39.892721 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123ee6e-5634-4543-9665-1f0eca09397d admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:39.892996 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-697b7c4c-1875-4143-9704-4f06e79138e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2747256757d849d5a98e88525fb9c568'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:39.900666 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1042/2081] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:39 2022] DELETE /identity/v3/users/2747256757d849d5a98e88525fb9c568 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:39.907574 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d115bf8-aa60-4129-a6b9-b0f2aafc4ace None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:39.907993 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d115bf8-aa60-4129-a6b9-b0f2aafc4ace None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:39.908285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d115bf8-aa60-4129-a6b9-b0f2aafc4ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:39.949978 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-7d115bf8-aa60-4129-a6b9-b0f2aafc4ace None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:39.951411 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-7d115bf8-aa60-4129-a6b9-b0f2aafc4ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:40.010957 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2123ee6e-5634-4543-9665-1f0eca09397d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ac0f185952f49b9a46990b07953ce71'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:40.014744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2123ee6e-5634-4543-9665-1f0eca09397d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ac0f185952f49b9a46990b07953ce71'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:40.047427 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2123ee6e-5634-4543-9665-1f0eca09397d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ac0f185952f49b9a46990b07953ce71'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:40.073344 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2123ee6e-5634-4543-9665-1f0eca09397d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ac0f185952f49b9a46990b07953ce71'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:40.095315 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2123ee6e-5634-4543-9665-1f0eca09397d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ac0f185952f49b9a46990b07953ce71'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:40.104179 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1040/2082] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:39 2022] DELETE /identity/v3/users/1ac0f185952f49b9a46990b07953ce71 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:40.111151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703a8c0-3b63-4ec0-86cf-175155b1ba63 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:40.111596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703a8c0-3b63-4ec0-86cf-175155b1ba63 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:40.111945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703a8c0-3b63-4ec0-86cf-175155b1ba63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:40.119562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1043/2083] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:40.134406 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:40.145742 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-f703a8c0-3b63-4ec0-86cf-175155b1ba63 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:40.146327 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d115bf8-aa60-4129-a6b9-b0f2aafc4ace None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:40.147990 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-7d115bf8-aa60-4129-a6b9-b0f2aafc4ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:40.162922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-f703a8c0-3b63-4ec0-86cf-175155b1ba63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:40.290042 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d115bf8-aa60-4129-a6b9-b0f2aafc4ace None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:40.303418 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:40.349053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1041/2084] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:40.372404 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703a8c0-3b63-4ec0-86cf-175155b1ba63 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:40.431261 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84709d33-d9ac-438f-81e8-7757dcf0bb01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:40.432252 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84709d33-d9ac-438f-81e8-7757dcf0bb01 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:40.432690 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84709d33-d9ac-438f-81e8-7757dcf0bb01 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:40.433995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84709d33-d9ac-438f-81e8-7757dcf0bb01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:40.455662 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84709d33-d9ac-438f-81e8-7757dcf0bb01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:40.459192 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84709d33-d9ac-438f-81e8-7757dcf0bb01 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:40.483614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1044/2085] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:40.543524 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703a8c0-3b63-4ec0-86cf-175155b1ba63 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:40.558533 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f1556-2350-4dc6-b4d5-3cdf86652b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:40.559588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f1556-2350-4dc6-b4d5-3cdf86652b89 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:40.560999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f1556-2350-4dc6-b4d5-3cdf86652b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:40.561517 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f1556-2350-4dc6-b4d5-3cdf86652b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:40.611961 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f1556-2350-4dc6-b4d5-3cdf86652b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:40.615513 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f1556-2350-4dc6-b4d5-3cdf86652b89 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:40.661041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1042/2086] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:51:41.119635 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84709d33-d9ac-438f-81e8-7757dcf0bb01 service neutron] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:41.122853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-84709d33-d9ac-438f-81e8-7757dcf0bb01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:41.147848 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84709d33-d9ac-438f-81e8-7757dcf0bb01 service neutron] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:41.156789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a152a44-303b-48e6-912a-0b6e396f5faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:41.158567 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a152a44-303b-48e6-912a-0b6e396f5faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:41.158567 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a152a44-303b-48e6-912a-0b6e396f5faa admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:41.158913 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a152a44-303b-48e6-912a-0b6e396f5faa admin admin] PATH_INFO: `/v3/projects/fe0b524c031b4e7497d137792cd99512` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:41.160983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a152a44-303b-48e6-912a-0b6e396f5faa admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe0b524c031b4e7497d137792cd99512)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:41.164607 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a152a44-303b-48e6-912a-0b6e396f5faa admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:41.236746 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f1556-2350-4dc6-b4d5-3cdf86652b89 service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:41.239331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-ca8f1556-2350-4dc6-b4d5-3cdf86652b89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:41.270529 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-2a152a44-303b-48e6-912a-0b6e396f5faa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe0b524c031b4e7497d137792cd99512', 'request_id': 'req-2a152a44-303b-48e6-912a-0b6e396f5faa'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:41.273454 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f1556-2350-4dc6-b4d5-3cdf86652b89 service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:41.284783 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-2a152a44-303b-48e6-912a-0b6e396f5faa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe0b524c031b4e7497d137792cd99512', 'request_id': 'req-2a152a44-303b-48e6-912a-0b6e396f5faa'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:41.302454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-2a152a44-303b-48e6-912a-0b6e396f5faa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe0b524c031b4e7497d137792cd99512', 'request_id': 'req-2a152a44-303b-48e6-912a-0b6e396f5faa'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:41.324858 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-2a152a44-303b-48e6-912a-0b6e396f5faa admin admin] The token cache is being invalidate because project fe0b524c031b4e7497d137792cd99512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:41.325356 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-2a152a44-303b-48e6-912a-0b6e396f5faa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:41.326590 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-2a152a44-303b-48e6-912a-0b6e396f5faa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:41.329549 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1045/2087] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:41 2022] DELETE /identity/v3/projects/fe0b524c031b4e7497d137792cd99512 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:41.335584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a152a44-303b-48e6-912a-0b6e396f5faa admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:41.338840 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-2a152a44-303b-48e6-912a-0b6e396f5faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:41.381871 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cf311-cfc5-4da6-89f5-b49411619d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:41.382941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cf311-cfc5-4da6-89f5-b49411619d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:41.383447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cf311-cfc5-4da6-89f5-b49411619d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:41.383924 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cf311-cfc5-4da6-89f5-b49411619d0e admin admin] PATH_INFO: `/v3/projects/d1d55bb98df042c5a39a66deb163d249` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:41.386009 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cf311-cfc5-4da6-89f5-b49411619d0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1d55bb98df042c5a39a66deb163d249)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:41.390681 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cf311-cfc5-4da6-89f5-b49411619d0e admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:41.467848 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a152a44-303b-48e6-912a-0b6e396f5faa admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:41.471596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-b87cf311-cfc5-4da6-89f5-b49411619d0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1d55bb98df042c5a39a66deb163d249', 'request_id': 'req-b87cf311-cfc5-4da6-89f5-b49411619d0e'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:41.474584 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:41.482973 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-b87cf311-cfc5-4da6-89f5-b49411619d0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1d55bb98df042c5a39a66deb163d249', 'request_id': 'req-b87cf311-cfc5-4da6-89f5-b49411619d0e'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:41.493577 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-b87cf311-cfc5-4da6-89f5-b49411619d0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1d55bb98df042c5a39a66deb163d249', 'request_id': 'req-b87cf311-cfc5-4da6-89f5-b49411619d0e'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:41.515234 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-b87cf311-cfc5-4da6-89f5-b49411619d0e admin admin] The token cache is being invalidate because project d1d55bb98df042c5a39a66deb163d249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:41.515758 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-b87cf311-cfc5-4da6-89f5-b49411619d0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:41.516946 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-b87cf311-cfc5-4da6-89f5-b49411619d0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:41.519667 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1043/2088] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:41 2022] DELETE /identity/v3/projects/d1d55bb98df042c5a39a66deb163d249 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:41.527484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d422db-3714-40d6-a1d1-ad1aef24b211 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:41.527950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d422db-3714-40d6-a1d1-ad1aef24b211 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:41.528431 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d422db-3714-40d6-a1d1-ad1aef24b211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:41.532146 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:41.560528 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2dcf6-1fe6-4b2c-ab4d-daeeb34cc6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:41.561201 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2dcf6-1fe6-4b2c-ab4d-daeeb34cc6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:41.561775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2dcf6-1fe6-4b2c-ab4d-daeeb34cc6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:41.561970 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2dcf6-1fe6-4b2c-ab4d-daeeb34cc6c6 admin admin] PATH_INFO: `/v3/users/def1bff7bb564d8cb28dbdd92cbab7ec` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:41.563603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2dcf6-1fe6-4b2c-ab4d-daeeb34cc6c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=def1bff7bb564d8cb28dbdd92cbab7ec)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:41.564454 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-58d422db-3714-40d6-a1d1-ad1aef24b211 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:41.566078 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2dcf6-1fe6-4b2c-ab4d-daeeb34cc6c6 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:41.566390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-58d422db-3714-40d6-a1d1-ad1aef24b211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:41.580290 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1044/2089] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:41.594632 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01205d-a3f6-488d-9a6d-b360e87dab50 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:41.595163 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01205d-a3f6-488d-9a6d-b360e87dab50 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:41.595719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01205d-a3f6-488d-9a6d-b360e87dab50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:41.631142 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-3b01205d-a3f6-488d-9a6d-b360e87dab50 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:41.632681 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-3b01205d-a3f6-488d-9a6d-b360e87dab50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:41.643706 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b6b2dcf6-1fe6-4b2c-ab4d-daeeb34cc6c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'def1bff7bb564d8cb28dbdd92cbab7ec'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:41.644929 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1045/2090] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:41.653167 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01205d-a3f6-488d-9a6d-b360e87dab50 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:41.666406 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b6b2dcf6-1fe6-4b2c-ab4d-daeeb34cc6c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'def1bff7bb564d8cb28dbdd92cbab7ec'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:41.670947 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01205d-a3f6-488d-9a6d-b360e87dab50 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:41.682079 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a72a5-3f1e-46ec-a5aa-d154aa693bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:41.682997 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a72a5-3f1e-46ec-a5aa-d154aa693bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:41.684043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a72a5-3f1e-46ec-a5aa-d154aa693bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:41.684521 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a72a5-3f1e-46ec-a5aa-d154aa693bb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:41.685921 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a72a5-3f1e-46ec-a5aa-d154aa693bb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:51:41.686463 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a72a5-3f1e-46ec-a5aa-d154aa693bb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:41.688420 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b6b2dcf6-1fe6-4b2c-ab4d-daeeb34cc6c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'def1bff7bb564d8cb28dbdd92cbab7ec'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:41.689731 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a72a5-3f1e-46ec-a5aa-d154aa693bb0 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:41.690705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b6b2dcf6-1fe6-4b2c-ab4d-daeeb34cc6c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'def1bff7bb564d8cb28dbdd92cbab7ec'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:41.721235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1046/2091] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:51:41.722921 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a72a5-3f1e-46ec-a5aa-d154aa693bb0 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:41.727357 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-d65a72a5-3f1e-46ec-a5aa-d154aa693bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:41.727548 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b6b2dcf6-1fe6-4b2c-ab4d-daeeb34cc6c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'def1bff7bb564d8cb28dbdd92cbab7ec'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:41.749348 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a72a5-3f1e-46ec-a5aa-d154aa693bb0 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:41.753796 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1046/2092] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:41 2022] DELETE /identity/v3/users/def1bff7bb564d8cb28dbdd92cbab7ec => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:41.890486 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1ae42-5e80-4a26-a12d-b02ca0ac0e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:41.891205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1ae42-5e80-4a26-a12d-b02ca0ac0e34 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:41.891502 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1ae42-5e80-4a26-a12d-b02ca0ac0e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:41.891779 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1ae42-5e80-4a26-a12d-b02ca0ac0e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:41.892633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1ae42-5e80-4a26-a12d-b02ca0ac0e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:41.897236 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1ae42-5e80-4a26-a12d-b02ca0ac0e34 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:41.956628 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1047/2093] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:41 2022] POST /identity/v3/projects => generated 361 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:41.966248 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2dcf6-1fe6-4b2c-ab4d-daeeb34cc6c6 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:41.983960 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2dcf6-1fe6-4b2c-ab4d-daeeb34cc6c6 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:42.140787 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e0158-fbee-4af5-9200-2abfcc7da2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:42.141568 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e0158-fbee-4af5-9200-2abfcc7da2d8 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:42.142255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e0158-fbee-4af5-9200-2abfcc7da2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:42.143058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e0158-fbee-4af5-9200-2abfcc7da2d8 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:42.144528 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e0158-fbee-4af5-9200-2abfcc7da2d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:42.150307 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e0158-fbee-4af5-9200-2abfcc7da2d8 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:42.214455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1047/2094] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:41 2022] POST /identity/v3/users => generated 281 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:42.220107 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1ae42-5e80-4a26-a12d-b02ca0ac0e34 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:42.256308 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1ae42-5e80-4a26-a12d-b02ca0ac0e34 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:42.266807 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47707e66-d732-4105-b494-aa9ec3801948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:42.267627 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47707e66-d732-4105-b494-aa9ec3801948 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:42.268709 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47707e66-d732-4105-b494-aa9ec3801948 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:42.269125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47707e66-d732-4105-b494-aa9ec3801948 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:42.269997 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47707e66-d732-4105-b494-aa9ec3801948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:42.273101 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47707e66-d732-4105-b494-aa9ec3801948 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:42.304648 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1048/2095] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:51:42.307118 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e0158-fbee-4af5-9200-2abfcc7da2d8 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:42.330280 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e0158-fbee-4af5-9200-2abfcc7da2d8 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:42.338218 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e61ddd-d6f4-4491-a5e5-04a8086b54aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:42.338903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e61ddd-d6f4-4491-a5e5-04a8086b54aa admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:42.339257 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e61ddd-d6f4-4491-a5e5-04a8086b54aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:42.341094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e61ddd-d6f4-4491-a5e5-04a8086b54aa admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:42.342429 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e61ddd-d6f4-4491-a5e5-04a8086b54aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:42.346451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e61ddd-d6f4-4491-a5e5-04a8086b54aa admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:42.369018 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1048/2096] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:51:42.374951 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47707e66-d732-4105-b494-aa9ec3801948 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:42.393540 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47707e66-d732-4105-b494-aa9ec3801948 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:42.405535 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e516c8-4f9d-402f-9508-e6d57fc13e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:42.405865 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e61ddd-d6f4-4491-a5e5-04a8086b54aa admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:42.407858 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-c4e61ddd-d6f4-4491-a5e5-04a8086b54aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:42.409304 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e516c8-4f9d-402f-9508-e6d57fc13e3b admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:42.411308 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e516c8-4f9d-402f-9508-e6d57fc13e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:42.412201 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e516c8-4f9d-402f-9508-e6d57fc13e3b admin admin] PATH_INFO: `/v3/projects/9009afb70f3946aa82dfafeb4ba91cb3/users/b29eb912fee04c998efff2245ed60348/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:42.449473 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e61ddd-d6f4-4491-a5e5-04a8086b54aa admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:42.457127 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42f3d4-7072-42fa-828d-06d8bc141357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:42.459358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42f3d4-7072-42fa-828d-06d8bc141357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:42.459705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42f3d4-7072-42fa-828d-06d8bc141357 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:42.459994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42f3d4-7072-42fa-828d-06d8bc141357 admin admin] PATH_INFO: `/v3/projects/47b758acec7c413c812a7bc0e1456bae` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:42.462889 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42f3d4-7072-42fa-828d-06d8bc141357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47b758acec7c413c812a7bc0e1456bae)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:42.467584 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e516c8-4f9d-402f-9508-e6d57fc13e3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9009afb70f3946aa82dfafeb4ba91cb3, user_id=b29eb912fee04c998efff2245ed60348, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:42.472052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42f3d4-7072-42fa-828d-06d8bc141357 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:42.476324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e516c8-4f9d-402f-9508-e6d57fc13e3b admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:42.529444 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1049/2097] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:42 2022] PUT /identity/v3/projects/9009afb70f3946aa82dfafeb4ba91cb3/users/b29eb912fee04c998efff2245ed60348/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:42.549852 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aed59a-19f3-4579-81cd-036a4c0bf6a2 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:42.550367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aed59a-19f3-4579-81cd-036a4c0bf6a2 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:42.551439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aed59a-19f3-4579-81cd-036a4c0bf6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:42.579901 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:42.611447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6f42f3d4-7072-42fa-828d-06d8bc141357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47b758acec7c413c812a7bc0e1456bae', 'request_id': 'req-6f42f3d4-7072-42fa-828d-06d8bc141357'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:42.626386 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-84aed59a-19f3-4579-81cd-036a4c0bf6a2 None None] MFA Rules not processed for user `b29eb912fee04c998efff2245ed60348`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:42.628941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-84aed59a-19f3-4579-81cd-036a4c0bf6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:42.634488 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6f42f3d4-7072-42fa-828d-06d8bc141357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47b758acec7c413c812a7bc0e1456bae', 'request_id': 'req-6f42f3d4-7072-42fa-828d-06d8bc141357'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:42.651365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6f42f3d4-7072-42fa-828d-06d8bc141357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47b758acec7c413c812a7bc0e1456bae', 'request_id': 'req-6f42f3d4-7072-42fa-828d-06d8bc141357'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:42.683978 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6f42f3d4-7072-42fa-828d-06d8bc141357 admin admin] The token cache is being invalidate because project 47b758acec7c413c812a7bc0e1456bae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:42.684830 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6f42f3d4-7072-42fa-828d-06d8bc141357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:42.693481 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6f42f3d4-7072-42fa-828d-06d8bc141357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:42.693481 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1049/2098] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:42 2022] DELETE /identity/v3/projects/47b758acec7c413c812a7bc0e1456bae => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:42.701705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d512b3d-9493-40b8-af32-e404431ae2e3 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:42.702056 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d512b3d-9493-40b8-af32-e404431ae2e3 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:42.702569 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d512b3d-9493-40b8-af32-e404431ae2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:42.742996 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-4d512b3d-9493-40b8-af32-e404431ae2e3 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:42.745912 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-4d512b3d-9493-40b8-af32-e404431ae2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:42.775161 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:42.809506 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1050/2099] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:42.857768 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aed59a-19f3-4579-81cd-036a4c0bf6a2 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:42.861160 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-84aed59a-19f3-4579-81cd-036a4c0bf6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:42.889469 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1050/2100] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:42.900346 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18febf-99f7-41b4-b5bd-6c04b0069fd2 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:42.900618 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18febf-99f7-41b4-b5bd-6c04b0069fd2 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:42.900936 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18febf-99f7-41b4-b5bd-6c04b0069fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:42.927155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-7b18febf-99f7-41b4-b5bd-6c04b0069fd2 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:42.928536 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-7b18febf-99f7-41b4-b5bd-6c04b0069fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:42.942592 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1051/2101] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:42.943593 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18febf-99f7-41b4-b5bd-6c04b0069fd2 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:42.955701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18febf-99f7-41b4-b5bd-6c04b0069fd2 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:42.961804 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93078b-bf70-474b-9737-cf492c5ac5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:42.962576 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93078b-bf70-474b-9737-cf492c5ac5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:42.962864 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93078b-bf70-474b-9737-cf492c5ac5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:42.963255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93078b-bf70-474b-9737-cf492c5ac5d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:42.964558 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93078b-bf70-474b-9737-cf492c5ac5d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:51:42.965140 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93078b-bf70-474b-9737-cf492c5ac5d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:42.967250 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93078b-bf70-474b-9737-cf492c5ac5d7 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:42.985333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1052/2102] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:51:42.991998 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93078b-bf70-474b-9737-cf492c5ac5d7 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:43.008664 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93078b-bf70-474b-9737-cf492c5ac5d7 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:43.012386 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aed59a-19f3-4579-81cd-036a4c0bf6a2 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:43.016260 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef3f73-3a84-4d3a-94cb-e2264c1c9fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:43.016926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef3f73-3a84-4d3a-94cb-e2264c1c9fcb admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:43.017206 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef3f73-3a84-4d3a-94cb-e2264c1c9fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:43.017516 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef3f73-3a84-4d3a-94cb-e2264c1c9fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:43.018205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef3f73-3a84-4d3a-94cb-e2264c1c9fcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:43.020298 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef3f73-3a84-4d3a-94cb-e2264c1c9fcb admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:43.020691 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310c67e-ebc9-4a94-a206-5e93e2e36fd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:43.021915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310c67e-ebc9-4a94-a206-5e93e2e36fd5 service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:43.022538 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310c67e-ebc9-4a94-a206-5e93e2e36fd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:43.023249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310c67e-ebc9-4a94-a206-5e93e2e36fd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:43.043641 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310c67e-ebc9-4a94-a206-5e93e2e36fd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:43.046713 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310c67e-ebc9-4a94-a206-5e93e2e36fd5 service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:43.070628 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1053/2103] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:42 2022] POST /identity/v3/projects => generated 369 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:51:43.070838 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1051/2104] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:43.076621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef3f73-3a84-4d3a-94cb-e2264c1c9fcb admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:43.095865 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310c67e-ebc9-4a94-a206-5e93e2e36fd5 service cinder] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:43.097874 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-9310c67e-ebc9-4a94-a206-5e93e2e36fd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:43.121576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310c67e-ebc9-4a94-a206-5e93e2e36fd5 service cinder] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:43.257688 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4628a-72df-450a-b0d1-eb5ed893497e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:43.258827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4628a-72df-450a-b0d1-eb5ed893497e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:43.259192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4628a-72df-450a-b0d1-eb5ed893497e admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:43.259682 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4628a-72df-450a-b0d1-eb5ed893497e admin admin] PATH_INFO: `/v3/users/b29eb912fee04c998efff2245ed60348` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:43.262426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4628a-72df-450a-b0d1-eb5ed893497e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b29eb912fee04c998efff2245ed60348)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:43.266184 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef3f73-3a84-4d3a-94cb-e2264c1c9fcb admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:43.267134 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4628a-72df-450a-b0d1-eb5ed893497e admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:43.275902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31120317-c85b-453a-9209-c6fbda55e07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:43.277308 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31120317-c85b-453a-9209-c6fbda55e07c admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:43.278143 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31120317-c85b-453a-9209-c6fbda55e07c admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:43.278790 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31120317-c85b-453a-9209-c6fbda55e07c admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:43.280277 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31120317-c85b-453a-9209-c6fbda55e07c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:43.284007 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31120317-c85b-453a-9209-c6fbda55e07c admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:43.338100 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1054/2105] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:43 2022] POST /identity/v3/users => generated 285 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:43.346311 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31120317-c85b-453a-9209-c6fbda55e07c admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:43.376460 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31120317-c85b-453a-9209-c6fbda55e07c admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:43.391164 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98fa1b-c3d3-4dbd-a11b-01066128a27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:43.391980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-04d4628a-72df-450a-b0d1-eb5ed893497e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b29eb912fee04c998efff2245ed60348'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:43.393176 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-04d4628a-72df-450a-b0d1-eb5ed893497e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b29eb912fee04c998efff2245ed60348'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:43.394598 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98fa1b-c3d3-4dbd-a11b-01066128a27d admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:43.398512 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98fa1b-c3d3-4dbd-a11b-01066128a27d admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:43.399127 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98fa1b-c3d3-4dbd-a11b-01066128a27d admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:43.403672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98fa1b-c3d3-4dbd-a11b-01066128a27d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:43.421200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98fa1b-c3d3-4dbd-a11b-01066128a27d admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:43.436487 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-04d4628a-72df-450a-b0d1-eb5ed893497e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b29eb912fee04c998efff2245ed60348'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:43.444273 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:43.462783 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1055/2106] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:43.467201 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98fa1b-c3d3-4dbd-a11b-01066128a27d admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:43.471799 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-8f98fa1b-c3d3-4dbd-a11b-01066128a27d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:43.480457 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-04d4628a-72df-450a-b0d1-eb5ed893497e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b29eb912fee04c998efff2245ed60348'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:43.496636 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-04d4628a-72df-450a-b0d1-eb5ed893497e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b29eb912fee04c998efff2245ed60348'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:43.507244 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98fa1b-c3d3-4dbd-a11b-01066128a27d admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:43.516868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf4c95-daa1-4d35-9582-1f5022532bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:43.517932 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf4c95-daa1-4d35-9582-1f5022532bec admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:43.518404 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf4c95-daa1-4d35-9582-1f5022532bec admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:43.518862 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf4c95-daa1-4d35-9582-1f5022532bec admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:43.520897 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf4c95-daa1-4d35-9582-1f5022532bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:43.524067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf4c95-daa1-4d35-9582-1f5022532bec admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:43.525649 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1052/2107] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:43 2022] DELETE /identity/v3/users/b29eb912fee04c998efff2245ed60348 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:43.527980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e9495-5eaa-4f41-b04b-943c0b64c1bb None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:43.528541 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e9495-5eaa-4f41-b04b-943c0b64c1bb None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:43.528671 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e9495-5eaa-4f41-b04b-943c0b64c1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:43.548066 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1056/2108] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:43.552477 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf4c95-daa1-4d35-9582-1f5022532bec admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:43.554450 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-e21e9495-5eaa-4f41-b04b-943c0b64c1bb None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:43.556853 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e21e9495-5eaa-4f41-b04b-943c0b64c1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:43.567998 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf4c95-daa1-4d35-9582-1f5022532bec admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:43.578959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:43.673717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd5508-5044-48e7-8c4d-3fc69c4360e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:43.674431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd5508-5044-48e7-8c4d-3fc69c4360e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:43.674718 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd5508-5044-48e7-8c4d-3fc69c4360e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:43.675097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd5508-5044-48e7-8c4d-3fc69c4360e1 admin admin] PATH_INFO: `/v3/projects/c7960904a5c24ef1bee95120085dbc91/users/a325ab88da244e999ce96846be8c4c8a/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:43.682488 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1053/2109] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:43.700230 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e9495-5eaa-4f41-b04b-943c0b64c1bb None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:43.702909 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e21e9495-5eaa-4f41-b04b-943c0b64c1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:43.707402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd5508-5044-48e7-8c4d-3fc69c4360e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7960904a5c24ef1bee95120085dbc91, user_id=a325ab88da244e999ce96846be8c4c8a, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:43.715082 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd5508-5044-48e7-8c4d-3fc69c4360e1 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:43.738961 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1057/2110] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:43 2022] PUT /identity/v3/projects/c7960904a5c24ef1bee95120085dbc91/users/a325ab88da244e999ce96846be8c4c8a/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:43.759189 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748d507-51ed-4446-bccd-e85ba1015508 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:43.759683 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748d507-51ed-4446-bccd-e85ba1015508 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:43.760391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748d507-51ed-4446-bccd-e85ba1015508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:43.820485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e9495-5eaa-4f41-b04b-943c0b64c1bb None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:43.835189 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-7748d507-51ed-4446-bccd-e85ba1015508 None None] MFA Rules not processed for user `a325ab88da244e999ce96846be8c4c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:43.838035 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-7748d507-51ed-4446-bccd-e85ba1015508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:43.946244 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff3830-a04c-4503-8016-4718ac8da595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:43.947732 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff3830-a04c-4503-8016-4718ac8da595 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:43.950143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff3830-a04c-4503-8016-4718ac8da595 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:43.951158 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff3830-a04c-4503-8016-4718ac8da595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:44.056433 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1058/2111] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:44.067525 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748d507-51ed-4446-bccd-e85ba1015508 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:44.071825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-7748d507-51ed-4446-bccd-e85ba1015508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:44.100541 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff3830-a04c-4503-8016-4718ac8da595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:44.102534 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff3830-a04c-4503-8016-4718ac8da595 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:44.122184 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1054/2112] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:51:44.238989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748d507-51ed-4446-bccd-e85ba1015508 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:44.247310 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66875cf8-0740-4dc2-ad91-38b5ac848e0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:44.248075 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66875cf8-0740-4dc2-ad91-38b5ac848e0b service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:44.248484 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66875cf8-0740-4dc2-ad91-38b5ac848e0b service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:44.248772 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66875cf8-0740-4dc2-ad91-38b5ac848e0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:44.263320 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66875cf8-0740-4dc2-ad91-38b5ac848e0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:44.264404 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66875cf8-0740-4dc2-ad91-38b5ac848e0b service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:44.280357 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1059/2113] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:44.322348 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff3830-a04c-4503-8016-4718ac8da595 service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:44.336697 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff3830-a04c-4503-8016-4718ac8da595 service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:44.343157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01342f68-faef-4e54-9c42-e08acfb2813e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:44.344063 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01342f68-faef-4e54-9c42-e08acfb2813e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:44.344455 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01342f68-faef-4e54-9c42-e08acfb2813e admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:44.344811 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01342f68-faef-4e54-9c42-e08acfb2813e admin admin] PATH_INFO: `/v3/users/a325ab88da244e999ce96846be8c4c8a` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:44.346976 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01342f68-faef-4e54-9c42-e08acfb2813e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a325ab88da244e999ce96846be8c4c8a)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:44.349157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01342f68-faef-4e54-9c42-e08acfb2813e admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:44.362941 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66875cf8-0740-4dc2-ad91-38b5ac848e0b service cinder] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:44.365598 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-66875cf8-0740-4dc2-ad91-38b5ac848e0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:44.373952 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:44.386178 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:44.392330 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66875cf8-0740-4dc2-ad91-38b5ac848e0b service cinder] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:44.400639 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2cc181-60d5-40ee-a2b5-2b52f59af894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:44.405085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2cc181-60d5-40ee-a2b5-2b52f59af894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:44.405085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2cc181-60d5-40ee-a2b5-2b52f59af894 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:44.405085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2cc181-60d5-40ee-a2b5-2b52f59af894 admin admin] PATH_INFO: `/v3/users/d57ab7ae3e804ecb87482d1033f924c5` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:44.405085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2cc181-60d5-40ee-a2b5-2b52f59af894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d57ab7ae3e804ecb87482d1033f924c5)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:44.408878 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2cc181-60d5-40ee-a2b5-2b52f59af894 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:44.436038 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-01342f68-faef-4e54-9c42-e08acfb2813e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a325ab88da244e999ce96846be8c4c8a'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:44.438434 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-01342f68-faef-4e54-9c42-e08acfb2813e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a325ab88da244e999ce96846be8c4c8a'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:44.460216 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-01342f68-faef-4e54-9c42-e08acfb2813e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a325ab88da244e999ce96846be8c4c8a'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:44.509572 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-01342f68-faef-4e54-9c42-e08acfb2813e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a325ab88da244e999ce96846be8c4c8a'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:44.547235 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-1b2cc181-60d5-40ee-a2b5-2b52f59af894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd57ab7ae3e804ecb87482d1033f924c5'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:44.560962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-01342f68-faef-4e54-9c42-e08acfb2813e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a325ab88da244e999ce96846be8c4c8a'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:44.564174 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-1b2cc181-60d5-40ee-a2b5-2b52f59af894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd57ab7ae3e804ecb87482d1033f924c5'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:44.588952 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1055/2114] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:44 2022] DELETE /identity/v3/users/a325ab88da244e999ce96846be8c4c8a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:44.591103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-1b2cc181-60d5-40ee-a2b5-2b52f59af894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd57ab7ae3e804ecb87482d1033f924c5'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:44.592842 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-1b2cc181-60d5-40ee-a2b5-2b52f59af894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd57ab7ae3e804ecb87482d1033f924c5'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:44.599885 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01342f68-faef-4e54-9c42-e08acfb2813e admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:44.604879 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-01342f68-faef-4e54-9c42-e08acfb2813e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:44.659933 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-1b2cc181-60d5-40ee-a2b5-2b52f59af894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd57ab7ae3e804ecb87482d1033f924c5'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:44.694287 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1060/2115] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:44 2022] DELETE /identity/v3/users/d57ab7ae3e804ecb87482d1033f924c5 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:44.696761 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3193db-dbcb-4e53-9173-ef9994dda01b None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:44.697658 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3193db-dbcb-4e53-9173-ef9994dda01b None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:44.698240 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3193db-dbcb-4e53-9173-ef9994dda01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:44.746182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-af3193db-dbcb-4e53-9173-ef9994dda01b None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:44.748582 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-af3193db-dbcb-4e53-9173-ef9994dda01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:44.833064 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01342f68-faef-4e54-9c42-e08acfb2813e admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:44.919427 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1061/2116] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:44.922321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c4005-2e68-4161-8586-18930d0263ab None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:44.923232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c4005-2e68-4161-8586-18930d0263ab None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:44.923940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c4005-2e68-4161-8586-18930d0263ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:44.980485 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-879c4005-2e68-4161-8586-18930d0263ab None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:44.986124 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-879c4005-2e68-4161-8586-18930d0263ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:44.992255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63a0b7-75c2-4199-b934-68eefca1cd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:44.995950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63a0b7-75c2-4199-b934-68eefca1cd17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:44.997575 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63a0b7-75c2-4199-b934-68eefca1cd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:44.998248 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63a0b7-75c2-4199-b934-68eefca1cd17 admin admin] PATH_INFO: `/v3/users/0671b4b4647c4061b92b871400f0b1df` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:45.000478 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63a0b7-75c2-4199-b934-68eefca1cd17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0671b4b4647c4061b92b871400f0b1df)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:45.003566 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63a0b7-75c2-4199-b934-68eefca1cd17 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:45.009436 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1062/2117] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:45.011468 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c4005-2e68-4161-8586-18930d0263ab None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:45.013733 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-879c4005-2e68-4161-8586-18930d0263ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:45.039194 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c4005-2e68-4161-8586-18930d0263ab None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:45.049029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6a5ae-7528-450e-86c7-a69fb05dc938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:45.050175 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6a5ae-7528-450e-86c7-a69fb05dc938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:45.050830 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6a5ae-7528-450e-86c7-a69fb05dc938 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:45.052071 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6a5ae-7528-450e-86c7-a69fb05dc938 admin admin] PATH_INFO: `/v3/projects/9009afb70f3946aa82dfafeb4ba91cb3` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:45.054114 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6a5ae-7528-450e-86c7-a69fb05dc938 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9009afb70f3946aa82dfafeb4ba91cb3)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:45.056713 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6a5ae-7528-450e-86c7-a69fb05dc938 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:45.087197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:45.090567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-5e63a0b7-75c2-4199-b934-68eefca1cd17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0671b4b4647c4061b92b871400f0b1df'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:45.092859 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-5e63a0b7-75c2-4199-b934-68eefca1cd17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0671b4b4647c4061b92b871400f0b1df'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:45.129463 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-5e63a0b7-75c2-4199-b934-68eefca1cd17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0671b4b4647c4061b92b871400f0b1df'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:45.157186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-36e6a5ae-7528-450e-86c7-a69fb05dc938 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9009afb70f3946aa82dfafeb4ba91cb3', 'request_id': 'req-36e6a5ae-7528-450e-86c7-a69fb05dc938'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:45.166207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-36e6a5ae-7528-450e-86c7-a69fb05dc938 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9009afb70f3946aa82dfafeb4ba91cb3', 'request_id': 'req-36e6a5ae-7528-450e-86c7-a69fb05dc938'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:45.167780 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-5e63a0b7-75c2-4199-b934-68eefca1cd17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0671b4b4647c4061b92b871400f0b1df'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:45.178177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-36e6a5ae-7528-450e-86c7-a69fb05dc938 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9009afb70f3946aa82dfafeb4ba91cb3', 'request_id': 'req-36e6a5ae-7528-450e-86c7-a69fb05dc938'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:45.195697 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:45.205683 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-5e63a0b7-75c2-4199-b934-68eefca1cd17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0671b4b4647c4061b92b871400f0b1df'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:45.221010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1056/2118] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:44 2022] DELETE /identity/v3/users/0671b4b4647c4061b92b871400f0b1df => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:45.221709 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63a0b7-75c2-4199-b934-68eefca1cd17 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:45.223347 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-5e63a0b7-75c2-4199-b934-68eefca1cd17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:45.228085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-36e6a5ae-7528-450e-86c7-a69fb05dc938 admin admin] The token cache is being invalidate because project 9009afb70f3946aa82dfafeb4ba91cb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:45.228649 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-36e6a5ae-7528-450e-86c7-a69fb05dc938 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:45.232665 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-36e6a5ae-7528-450e-86c7-a69fb05dc938 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:45.236764 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1063/2119] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:45 2022] DELETE /identity/v3/projects/9009afb70f3946aa82dfafeb4ba91cb3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:45.240343 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6a5ae-7528-450e-86c7-a69fb05dc938 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:45.246300 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-36e6a5ae-7528-450e-86c7-a69fb05dc938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:45.321997 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63a0b7-75c2-4199-b934-68eefca1cd17 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:45.329636 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f0593-f5d3-4fec-bcff-dc5988101de0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:45.330664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f0593-f5d3-4fec-bcff-dc5988101de0 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:45.330822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f0593-f5d3-4fec-bcff-dc5988101de0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:45.331628 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f0593-f5d3-4fec-bcff-dc5988101de0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:45.333918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-780f0593-f5d3-4fec-bcff-dc5988101de0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:45.434745 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6a5ae-7528-450e-86c7-a69fb05dc938 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:45.435572 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f0593-f5d3-4fec-bcff-dc5988101de0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:45.436807 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f0593-f5d3-4fec-bcff-dc5988101de0 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:45.446354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a30ae-b2c2-483d-9091-ffa18c349e09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:45.449024 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a30ae-b2c2-483d-9091-ffa18c349e09 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:45.451586 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a30ae-b2c2-483d-9091-ffa18c349e09 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:45.452116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a30ae-b2c2-483d-9091-ffa18c349e09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:45.456043 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-200a30ae-b2c2-483d-9091-ffa18c349e09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:45.456649 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1057/2120] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:45.458365 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914790a-7146-47c6-a3c3-bb7dff1e506e None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:45.458771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914790a-7146-47c6-a3c3-bb7dff1e506e None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:45.459564 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914790a-7146-47c6-a3c3-bb7dff1e506e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:45.487986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a30ae-b2c2-483d-9091-ffa18c349e09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:45.488716 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-e914790a-7146-47c6-a3c3-bb7dff1e506e None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:45.490741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e914790a-7146-47c6-a3c3-bb7dff1e506e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:45.491577 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a30ae-b2c2-483d-9091-ffa18c349e09 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:45.504806 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1058/2121] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:45.507418 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7d784-5a40-4338-b8a7-0f03fbe7211c None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:45.507852 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7d784-5a40-4338-b8a7-0f03fbe7211c None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:45.508228 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7d784-5a40-4338-b8a7-0f03fbe7211c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:45.532033 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1064/2122] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:45.537432 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a30ae-b2c2-483d-9091-ffa18c349e09 service neutron] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:45.539051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-6fe7d784-5a40-4338-b8a7-0f03fbe7211c None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:45.540633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-6fe7d784-5a40-4338-b8a7-0f03fbe7211c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:45.574518 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1059/2123] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:45.574760 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a30ae-b2c2-483d-9091-ffa18c349e09 service neutron] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:45.577684 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91514984-6688-4c34-862b-0317892faf83 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:45.578735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91514984-6688-4c34-862b-0317892faf83 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:45.579237 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91514984-6688-4c34-862b-0317892faf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:45.599066 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728955c-a5f3-4d27-a41b-03577e90dfcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:45.600621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728955c-a5f3-4d27-a41b-03577e90dfcb service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:45.600907 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728955c-a5f3-4d27-a41b-03577e90dfcb service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:45.602333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728955c-a5f3-4d27-a41b-03577e90dfcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:45.623329 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e728955c-a5f3-4d27-a41b-03577e90dfcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:45.625030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e728955c-a5f3-4d27-a41b-03577e90dfcb service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:45.642336 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-91514984-6688-4c34-862b-0317892faf83 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:45.642614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1065/2124] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:45.644477 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-91514984-6688-4c34-862b-0317892faf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:45.682309 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1060/2125] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:45.688435 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728955c-a5f3-4d27-a41b-03577e90dfcb service neutron] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:45.724040 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728955c-a5f3-4d27-a41b-03577e90dfcb service neutron] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:45.752824 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e123951-65fe-4fa2-be02-5ddc0db77751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:45.755335 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e123951-65fe-4fa2-be02-5ddc0db77751 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:45.756117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e123951-65fe-4fa2-be02-5ddc0db77751 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:45.757977 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e123951-65fe-4fa2-be02-5ddc0db77751 admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:45.763301 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e123951-65fe-4fa2-be02-5ddc0db77751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:51:45.764456 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e123951-65fe-4fa2-be02-5ddc0db77751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:45.767746 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e123951-65fe-4fa2-be02-5ddc0db77751 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:45.800088 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1066/2126] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:51:45.807573 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91514984-6688-4c34-862b-0317892faf83 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:45.840103 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91514984-6688-4c34-862b-0317892faf83 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:45.856483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc409d8-fe2c-49d8-9f5c-200ccc4c0b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:45.858597 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc409d8-fe2c-49d8-9f5c-200ccc4c0b05 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:45.859220 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc409d8-fe2c-49d8-9f5c-200ccc4c0b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:45.859873 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc409d8-fe2c-49d8-9f5c-200ccc4c0b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:45.863592 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc409d8-fe2c-49d8-9f5c-200ccc4c0b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:45.873160 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc409d8-fe2c-49d8-9f5c-200ccc4c0b05 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:45.960702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1061/2127] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:45 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:45.962374 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e123951-65fe-4fa2-be02-5ddc0db77751 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:45.979019 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e123951-65fe-4fa2-be02-5ddc0db77751 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:46.130155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b7988-c51a-4583-9ee8-09ec7d8d0b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:46.133763 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b7988-c51a-4583-9ee8-09ec7d8d0b9c admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:46.134117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b7988-c51a-4583-9ee8-09ec7d8d0b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:46.134332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b7988-c51a-4583-9ee8-09ec7d8d0b9c admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:46.135075 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b7988-c51a-4583-9ee8-09ec7d8d0b9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:46.142571 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b7988-c51a-4583-9ee8-09ec7d8d0b9c admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:46.204100 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1067/2128] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:45 2022] POST /identity/v3/users => generated 292 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:51:46.205726 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc409d8-fe2c-49d8-9f5c-200ccc4c0b05 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:46.248561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc409d8-fe2c-49d8-9f5c-200ccc4c0b05 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:46.254087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e709c-c3a7-46a9-84ef-c2995b349571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:46.254983 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e709c-c3a7-46a9-84ef-c2995b349571 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:46.255468 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e709c-c3a7-46a9-84ef-c2995b349571 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:46.256387 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e709c-c3a7-46a9-84ef-c2995b349571 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:46.257026 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e709c-c3a7-46a9-84ef-c2995b349571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:46.259208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e709c-c3a7-46a9-84ef-c2995b349571 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:46.278181 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1062/2129] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:46.279757 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b7988-c51a-4583-9ee8-09ec7d8d0b9c admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:46.311885 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b7988-c51a-4583-9ee8-09ec7d8d0b9c admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:46.351517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9685c5-bfd4-4b88-a712-d282db843e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:46.352786 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9685c5-bfd4-4b88-a712-d282db843e19 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:46.353263 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9685c5-bfd4-4b88-a712-d282db843e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:46.353778 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9685c5-bfd4-4b88-a712-d282db843e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:46.358548 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9685c5-bfd4-4b88-a712-d282db843e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:46.361785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9685c5-bfd4-4b88-a712-d282db843e19 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:46.410429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e709c-c3a7-46a9-84ef-c2995b349571 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:46.412473 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-d42e709c-c3a7-46a9-84ef-c2995b349571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:46.426684 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1068/2130] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:46.432539 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9685c5-bfd4-4b88-a712-d282db843e19 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:46.437262 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e709c-c3a7-46a9-84ef-c2995b349571 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:46.442954 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8be51-289d-49da-ba61-9b86c8b9de4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:46.443620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8be51-289d-49da-ba61-9b86c8b9de4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:46.443945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8be51-289d-49da-ba61-9b86c8b9de4a admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:46.444222 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8be51-289d-49da-ba61-9b86c8b9de4a admin admin] PATH_INFO: `/v3/projects/c7960904a5c24ef1bee95120085dbc91` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:46.445751 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8be51-289d-49da-ba61-9b86c8b9de4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7960904a5c24ef1bee95120085dbc91)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:46.447931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8be51-289d-49da-ba61-9b86c8b9de4a admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:46.469445 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:46.478387 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9685c5-bfd4-4b88-a712-d282db843e19 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:46.504120 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efddf3d-80f3-462c-821e-33ef2a07abc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:46.505667 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efddf3d-80f3-462c-821e-33ef2a07abc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:46.505983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efddf3d-80f3-462c-821e-33ef2a07abc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:46.506357 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efddf3d-80f3-462c-821e-33ef2a07abc5 admin admin] PATH_INFO: `/v3/projects/01d015e2af0047cb8954b76003d76499/users/bad82708846d45e88f37fb5da86e77b7/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:46.560930 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efddf3d-80f3-462c-821e-33ef2a07abc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d015e2af0047cb8954b76003d76499, user_id=bad82708846d45e88f37fb5da86e77b7, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:46.565215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efddf3d-80f3-462c-821e-33ef2a07abc5 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:46.568031 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-62e8be51-289d-49da-ba61-9b86c8b9de4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7960904a5c24ef1bee95120085dbc91', 'request_id': 'req-62e8be51-289d-49da-ba61-9b86c8b9de4a'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:46.581214 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-62e8be51-289d-49da-ba61-9b86c8b9de4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7960904a5c24ef1bee95120085dbc91', 'request_id': 'req-62e8be51-289d-49da-ba61-9b86c8b9de4a'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:46.602298 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1069/2131] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:46 2022] PUT /identity/v3/projects/01d015e2af0047cb8954b76003d76499/users/bad82708846d45e88f37fb5da86e77b7/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:46.603972 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-62e8be51-289d-49da-ba61-9b86c8b9de4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7960904a5c24ef1bee95120085dbc91', 'request_id': 'req-62e8be51-289d-49da-ba61-9b86c8b9de4a'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:46.624679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f922e1b-f6c9-46af-9b95-a32908993bf5 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:46.625048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f922e1b-f6c9-46af-9b95-a32908993bf5 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:46.625468 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f922e1b-f6c9-46af-9b95-a32908993bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:46.643627 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-62e8be51-289d-49da-ba61-9b86c8b9de4a admin admin] The token cache is being invalidate because project c7960904a5c24ef1bee95120085dbc91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:46.643880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-62e8be51-289d-49da-ba61-9b86c8b9de4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:46.644565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-62e8be51-289d-49da-ba61-9b86c8b9de4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:46.649473 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1063/2132] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:46 2022] DELETE /identity/v3/projects/c7960904a5c24ef1bee95120085dbc91 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:46.697577 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-9f922e1b-f6c9-46af-9b95-a32908993bf5 None None] MFA Rules not processed for user `bad82708846d45e88f37fb5da86e77b7`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:46.700196 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-9f922e1b-f6c9-46af-9b95-a32908993bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:46.727041 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:46.784154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8be51-289d-49da-ba61-9b86c8b9de4a admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:46.786664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-62e8be51-289d-49da-ba61-9b86c8b9de4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:46.979138 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1070/2133] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:46.979138 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f922e1b-f6c9-46af-9b95-a32908993bf5 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:46.983892 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-9f922e1b-f6c9-46af-9b95-a32908993bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:47.043087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8be51-289d-49da-ba61-9b86c8b9de4a admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:47.133161 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb8fd7-a867-4c50-b17c-cd57a428fdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:47.134337 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb8fd7-a867-4c50-b17c-cd57a428fdc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:47.134842 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb8fd7-a867-4c50-b17c-cd57a428fdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:47.135317 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb8fd7-a867-4c50-b17c-cd57a428fdc4 admin admin] PATH_INFO: `/v3/projects/b5c3d37cef2f41d6b63a28661c3b1e95` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:47.137979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb8fd7-a867-4c50-b17c-cd57a428fdc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5c3d37cef2f41d6b63a28661c3b1e95)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:47.141753 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb8fd7-a867-4c50-b17c-cd57a428fdc4 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:47.143470 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f922e1b-f6c9-46af-9b95-a32908993bf5 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:47.149722 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a8742-c2bc-4389-96fc-f31a284abf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:47.150554 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a8742-c2bc-4389-96fc-f31a284abf10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:47.150941 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a8742-c2bc-4389-96fc-f31a284abf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:47.151905 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a8742-c2bc-4389-96fc-f31a284abf10 admin admin] PATH_INFO: `/v3/projects/a23937d2b9be417aa48212bce08bcb54` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:47.153517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a8742-c2bc-4389-96fc-f31a284abf10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a23937d2b9be417aa48212bce08bcb54)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:47.155772 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a8742-c2bc-4389-96fc-f31a284abf10 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:47.236535 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ec8a8742-c2bc-4389-96fc-f31a284abf10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a23937d2b9be417aa48212bce08bcb54', 'request_id': 'req-ec8a8742-c2bc-4389-96fc-f31a284abf10'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:47.247495 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-c9fb8fd7-a867-4c50-b17c-cd57a428fdc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5c3d37cef2f41d6b63a28661c3b1e95', 'request_id': 'req-c9fb8fd7-a867-4c50-b17c-cd57a428fdc4'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:47.248976 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:47.251300 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ec8a8742-c2bc-4389-96fc-f31a284abf10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a23937d2b9be417aa48212bce08bcb54', 'request_id': 'req-ec8a8742-c2bc-4389-96fc-f31a284abf10'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:47.257803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-c9fb8fd7-a867-4c50-b17c-cd57a428fdc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5c3d37cef2f41d6b63a28661c3b1e95', 'request_id': 'req-c9fb8fd7-a867-4c50-b17c-cd57a428fdc4'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:47.270019 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ec8a8742-c2bc-4389-96fc-f31a284abf10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a23937d2b9be417aa48212bce08bcb54', 'request_id': 'req-ec8a8742-c2bc-4389-96fc-f31a284abf10'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:47.271777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-c9fb8fd7-a867-4c50-b17c-cd57a428fdc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5c3d37cef2f41d6b63a28661c3b1e95', 'request_id': 'req-c9fb8fd7-a867-4c50-b17c-cd57a428fdc4'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:47.287790 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-c9fb8fd7-a867-4c50-b17c-cd57a428fdc4 admin admin] The token cache is being invalidate because project b5c3d37cef2f41d6b63a28661c3b1e95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:47.288190 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-c9fb8fd7-a867-4c50-b17c-cd57a428fdc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:47.288953 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-c9fb8fd7-a867-4c50-b17c-cd57a428fdc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:47.290880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1064/2134] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:46 2022] DELETE /identity/v3/projects/b5c3d37cef2f41d6b63a28661c3b1e95 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:47.295590 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb8fd7-a867-4c50-b17c-cd57a428fdc4 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:47.296364 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ec8a8742-c2bc-4389-96fc-f31a284abf10 admin admin] The token cache is being invalidate because project a23937d2b9be417aa48212bce08bcb54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:47.296876 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ec8a8742-c2bc-4389-96fc-f31a284abf10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:47.298309 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-c9fb8fd7-a867-4c50-b17c-cd57a428fdc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:47.298565 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ec8a8742-c2bc-4389-96fc-f31a284abf10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:47.301877 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1071/2135] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:46 2022] DELETE /identity/v3/projects/a23937d2b9be417aa48212bce08bcb54 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:47.306635 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a8742-c2bc-4389-96fc-f31a284abf10 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:47.308971 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ec8a8742-c2bc-4389-96fc-f31a284abf10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:47.379935 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:47.397440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb8fd7-a867-4c50-b17c-cd57a428fdc4 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:47.410723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa3052-5b18-462a-b3d0-d0027b15770d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:47.412032 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa3052-5b18-462a-b3d0-d0027b15770d service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:47.412526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa3052-5b18-462a-b3d0-d0027b15770d service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:47.413473 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa3052-5b18-462a-b3d0-d0027b15770d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:47.418150 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-94aa3052-5b18-462a-b3d0-d0027b15770d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:47.426103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a8742-c2bc-4389-96fc-f31a284abf10 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:47.566275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0f7a8-5d00-4bc6-be59-ad0dc6cdbacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:47.568173 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0f7a8-5d00-4bc6-be59-ad0dc6cdbacb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:47.568858 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0f7a8-5d00-4bc6-be59-ad0dc6cdbacb admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:47.569282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0f7a8-5d00-4bc6-be59-ad0dc6cdbacb admin admin] PATH_INFO: `/v3/users/028d321dcf964fbebdbb6484940ec4e9` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:47.570862 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0f7a8-5d00-4bc6-be59-ad0dc6cdbacb admin admin] RBAC: Authorizing `identity:delete_user(user_id=028d321dcf964fbebdbb6484940ec4e9)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:47.573611 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0f7a8-5d00-4bc6-be59-ad0dc6cdbacb admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:47.590835 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa3052-5b18-462a-b3d0-d0027b15770d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:47.592601 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa3052-5b18-462a-b3d0-d0027b15770d service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:47.626714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1065/2136] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:47.630750 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa3052-5b18-462a-b3d0-d0027b15770d service cinder] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:47.637789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-94aa3052-5b18-462a-b3d0-d0027b15770d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:47.724362 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa3052-5b18-462a-b3d0-d0027b15770d service cinder] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:47.738276 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e1e0f7a8-5d00-4bc6-be59-ad0dc6cdbacb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '028d321dcf964fbebdbb6484940ec4e9'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:47.752054 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fccecc-69ae-4a63-a1ed-7caae9fb26ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:47.753197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fccecc-69ae-4a63-a1ed-7caae9fb26ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:47.753679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fccecc-69ae-4a63-a1ed-7caae9fb26ea admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:47.754287 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fccecc-69ae-4a63-a1ed-7caae9fb26ea admin admin] PATH_INFO: `/v3/users/eadeb07b57614438a7428833f9b48405` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:47.763620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fccecc-69ae-4a63-a1ed-7caae9fb26ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=eadeb07b57614438a7428833f9b48405)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:47.767385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fccecc-69ae-4a63-a1ed-7caae9fb26ea admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:47.770177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e1e0f7a8-5d00-4bc6-be59-ad0dc6cdbacb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '028d321dcf964fbebdbb6484940ec4e9'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:47.814112 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e1e0f7a8-5d00-4bc6-be59-ad0dc6cdbacb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '028d321dcf964fbebdbb6484940ec4e9'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:47.816170 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e1e0f7a8-5d00-4bc6-be59-ad0dc6cdbacb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '028d321dcf964fbebdbb6484940ec4e9'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:47.887585 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e1e0f7a8-5d00-4bc6-be59-ad0dc6cdbacb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '028d321dcf964fbebdbb6484940ec4e9'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:47.932311 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1072/2137] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:47 2022] DELETE /identity/v3/users/028d321dcf964fbebdbb6484940ec4e9 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:47.955398 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-01fccecc-69ae-4a63-a1ed-7caae9fb26ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eadeb07b57614438a7428833f9b48405'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:47.956874 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-01fccecc-69ae-4a63-a1ed-7caae9fb26ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eadeb07b57614438a7428833f9b48405'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:47.976059 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-01fccecc-69ae-4a63-a1ed-7caae9fb26ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eadeb07b57614438a7428833f9b48405'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:48.034946 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-01fccecc-69ae-4a63-a1ed-7caae9fb26ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eadeb07b57614438a7428833f9b48405'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:48.056142 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-01fccecc-69ae-4a63-a1ed-7caae9fb26ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eadeb07b57614438a7428833f9b48405'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:48.080768 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1066/2138] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:47 2022] DELETE /identity/v3/users/eadeb07b57614438a7428833f9b48405 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:48.790705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0f7a8-5d00-4bc6-be59-ad0dc6cdbacb admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:48.793083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-e1e0f7a8-5d00-4bc6-be59-ad0dc6cdbacb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:48.900671 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0f7a8-5d00-4bc6-be59-ad0dc6cdbacb admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:48.922186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:49.010218 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1712a45-e004-4d63-a8c2-0579828e7bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:49.011852 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1712a45-e004-4d63-a8c2-0579828e7bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:49.012193 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1712a45-e004-4d63-a8c2-0579828e7bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:49.012588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1712a45-e004-4d63-a8c2-0579828e7bd7 admin admin] PATH_INFO: `/v3/projects/3fd10250a03e42dcbd09ea48157ec3e2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:49.014202 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1712a45-e004-4d63-a8c2-0579828e7bd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fd10250a03e42dcbd09ea48157ec3e2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:49.016435 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1712a45-e004-4d63-a8c2-0579828e7bd7 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:49.103538 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-c1712a45-e004-4d63-a8c2-0579828e7bd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fd10250a03e42dcbd09ea48157ec3e2', 'request_id': 'req-c1712a45-e004-4d63-a8c2-0579828e7bd7'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:49.112313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-c1712a45-e004-4d63-a8c2-0579828e7bd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fd10250a03e42dcbd09ea48157ec3e2', 'request_id': 'req-c1712a45-e004-4d63-a8c2-0579828e7bd7'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:49.122283 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fccecc-69ae-4a63-a1ed-7caae9fb26ea admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:49.126601 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-01fccecc-69ae-4a63-a1ed-7caae9fb26ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:49.131721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-c1712a45-e004-4d63-a8c2-0579828e7bd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fd10250a03e42dcbd09ea48157ec3e2', 'request_id': 'req-c1712a45-e004-4d63-a8c2-0579828e7bd7'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:49.156792 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:49.157779 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-c1712a45-e004-4d63-a8c2-0579828e7bd7 admin admin] The token cache is being invalidate because project 3fd10250a03e42dcbd09ea48157ec3e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:49.158398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-c1712a45-e004-4d63-a8c2-0579828e7bd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:49.159861 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-c1712a45-e004-4d63-a8c2-0579828e7bd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:49.165487 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1073/2139] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:48 2022] DELETE /identity/v3/projects/3fd10250a03e42dcbd09ea48157ec3e2 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:49.179939 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc57be5-26f7-428d-8e37-3b6580e2984b None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:49.180219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc57be5-26f7-428d-8e37-3b6580e2984b None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:49.180622 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc57be5-26f7-428d-8e37-3b6580e2984b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:49.203786 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fccecc-69ae-4a63-a1ed-7caae9fb26ea admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:49.232017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-5bc57be5-26f7-428d-8e37-3b6580e2984b None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:49.236878 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-5bc57be5-26f7-428d-8e37-3b6580e2984b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:49.368099 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1074/2140] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:49.373193 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122f235-5ea6-4dfa-a625-17e90b56cff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:49.374988 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122f235-5ea6-4dfa-a625-17e90b56cff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:49.374988 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122f235-5ea6-4dfa-a625-17e90b56cff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:49.375229 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122f235-5ea6-4dfa-a625-17e90b56cff9 admin admin] PATH_INFO: `/v3/projects/9405179c931c4ee2aa562dd0ef608c2a` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:49.377956 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122f235-5ea6-4dfa-a625-17e90b56cff9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9405179c931c4ee2aa562dd0ef608c2a)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:49.381469 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd899c8-2b6b-404c-8797-28f1c34729ae None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:49.381962 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd899c8-2b6b-404c-8797-28f1c34729ae None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:49.382401 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd899c8-2b6b-404c-8797-28f1c34729ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:49.383095 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122f235-5ea6-4dfa-a625-17e90b56cff9 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:49.414802 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-4dd899c8-2b6b-404c-8797-28f1c34729ae None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:49.416512 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-4dd899c8-2b6b-404c-8797-28f1c34729ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:49.432251 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1075/2141] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:49.440453 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd899c8-2b6b-404c-8797-28f1c34729ae None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:49.459985 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd899c8-2b6b-404c-8797-28f1c34729ae None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:49.481690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-4122f235-5ea6-4dfa-a625-17e90b56cff9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9405179c931c4ee2aa562dd0ef608c2a', 'request_id': 'req-4122f235-5ea6-4dfa-a625-17e90b56cff9'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:49.498866 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-4122f235-5ea6-4dfa-a625-17e90b56cff9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9405179c931c4ee2aa562dd0ef608c2a', 'request_id': 'req-4122f235-5ea6-4dfa-a625-17e90b56cff9'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:49.517551 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-4122f235-5ea6-4dfa-a625-17e90b56cff9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9405179c931c4ee2aa562dd0ef608c2a', 'request_id': 'req-4122f235-5ea6-4dfa-a625-17e90b56cff9'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:49.532807 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:49.541710 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-4122f235-5ea6-4dfa-a625-17e90b56cff9 admin admin] The token cache is being invalidate because project 9405179c931c4ee2aa562dd0ef608c2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:49.542053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-4122f235-5ea6-4dfa-a625-17e90b56cff9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:49.542677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-4122f235-5ea6-4dfa-a625-17e90b56cff9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:49.545220 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1067/2142] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:49 2022] DELETE /identity/v3/projects/9405179c931c4ee2aa562dd0ef608c2a => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:49.547120 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122f235-5ea6-4dfa-a625-17e90b56cff9 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:49.549589 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-4122f235-5ea6-4dfa-a625-17e90b56cff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:49.574192 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82462688-4992-4ce9-98da-9fe8377169a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:49.575442 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82462688-4992-4ce9-98da-9fe8377169a4 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:49.575907 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82462688-4992-4ce9-98da-9fe8377169a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:49.576370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82462688-4992-4ce9-98da-9fe8377169a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:49.577704 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82462688-4992-4ce9-98da-9fe8377169a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:51:49.583891 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82462688-4992-4ce9-98da-9fe8377169a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:49.583891 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82462688-4992-4ce9-98da-9fe8377169a4 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:49.602282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1076/2143] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:51:49.606077 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf57ad3-c2f4-47da-8646-f538f0241679 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:49.606863 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf57ad3-c2f4-47da-8646-f538f0241679 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:49.607340 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf57ad3-c2f4-47da-8646-f538f0241679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:49.644008 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-baf57ad3-c2f4-47da-8646-f538f0241679 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:49.645668 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-baf57ad3-c2f4-47da-8646-f538f0241679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:49.669023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1077/2144] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:49.673837 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf57ad3-c2f4-47da-8646-f538f0241679 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:49.673837 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-baf57ad3-c2f4-47da-8646-f538f0241679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:49.695519 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf57ad3-c2f4-47da-8646-f538f0241679 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:49.705491 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9d07f-1445-4ba3-b6d2-e634fc8cea37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:49.706876 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9d07f-1445-4ba3-b6d2-e634fc8cea37 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:49.707393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9d07f-1445-4ba3-b6d2-e634fc8cea37 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:49.707557 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122f235-5ea6-4dfa-a625-17e90b56cff9 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:49.707875 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9d07f-1445-4ba3-b6d2-e634fc8cea37 admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:49.708959 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9d07f-1445-4ba3-b6d2-e634fc8cea37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:49.712676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9d07f-1445-4ba3-b6d2-e634fc8cea37 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:49.718073 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f4617-59a5-4b14-97c6-bd81a1face6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:49.720339 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f4617-59a5-4b14-97c6-bd81a1face6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:49.720339 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f4617-59a5-4b14-97c6-bd81a1face6f admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:49.721563 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f4617-59a5-4b14-97c6-bd81a1face6f admin admin] PATH_INFO: `/v3/users/6891fc142bc84f0aa30062bc90f06b7d` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:49.724101 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f4617-59a5-4b14-97c6-bd81a1face6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6891fc142bc84f0aa30062bc90f06b7d)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:49.728359 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f4617-59a5-4b14-97c6-bd81a1face6f admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:49.783589 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1078/2145] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:49 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:49.784730 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b1cd8-f575-46e5-84bb-02ccc6ed7316 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:49.785095 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b1cd8-f575-46e5-84bb-02ccc6ed7316 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:49.785454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b1cd8-f575-46e5-84bb-02ccc6ed7316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:49.819603 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:49.825459 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-b59b1cd8-f575-46e5-84bb-02ccc6ed7316 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:49.827851 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-b59b1cd8-f575-46e5-84bb-02ccc6ed7316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:49.848217 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-b36f4617-59a5-4b14-97c6-bd81a1face6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6891fc142bc84f0aa30062bc90f06b7d'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:49.850711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-b36f4617-59a5-4b14-97c6-bd81a1face6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6891fc142bc84f0aa30062bc90f06b7d'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:49.867463 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-b36f4617-59a5-4b14-97c6-bd81a1face6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6891fc142bc84f0aa30062bc90f06b7d'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:49.915420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-b36f4617-59a5-4b14-97c6-bd81a1face6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6891fc142bc84f0aa30062bc90f06b7d'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:49.932139 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-b36f4617-59a5-4b14-97c6-bd81a1face6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6891fc142bc84f0aa30062bc90f06b7d'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:49.947191 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1068/2146] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:49 2022] DELETE /identity/v3/users/6891fc142bc84f0aa30062bc90f06b7d => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:49.949299 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f4617-59a5-4b14-97c6-bd81a1face6f admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:49.951898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-b36f4617-59a5-4b14-97c6-bd81a1face6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:50.005870 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1079/2147] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:50.013965 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b1cd8-f575-46e5-84bb-02ccc6ed7316 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:50.028431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b1cd8-f575-46e5-84bb-02ccc6ed7316 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:50.081018 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f4617-59a5-4b14-97c6-bd81a1face6f admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:50.091546 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846442d-91ca-4c59-b81e-d0b21563b2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:50.092230 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846442d-91ca-4c59-b81e-d0b21563b2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:50.092518 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846442d-91ca-4c59-b81e-d0b21563b2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:50.092922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846442d-91ca-4c59-b81e-d0b21563b2d7 admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:50.093686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846442d-91ca-4c59-b81e-d0b21563b2d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:50.097521 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846442d-91ca-4c59-b81e-d0b21563b2d7 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:50.150767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1069/2148] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:49 2022] POST /identity/v3/users => generated 289 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:50.158830 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846442d-91ca-4c59-b81e-d0b21563b2d7 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:50.178628 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846442d-91ca-4c59-b81e-d0b21563b2d7 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:50.187692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd933ff-3dcf-474c-9033-1c993d38218a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:50.188154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b81c90-f1b6-4d60-a607-90599ddeefe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:50.189153 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b81c90-f1b6-4d60-a607-90599ddeefe5 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:50.189292 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd933ff-3dcf-474c-9033-1c993d38218a admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:50.189695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b81c90-f1b6-4d60-a607-90599ddeefe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:50.189934 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd933ff-3dcf-474c-9033-1c993d38218a admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:50.190312 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b81c90-f1b6-4d60-a607-90599ddeefe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:50.190516 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd933ff-3dcf-474c-9033-1c993d38218a admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:50.191565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b81c90-f1b6-4d60-a607-90599ddeefe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:50.191697 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd933ff-3dcf-474c-9033-1c993d38218a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:51:50.192278 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd933ff-3dcf-474c-9033-1c993d38218a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:50.194430 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b81c90-f1b6-4d60-a607-90599ddeefe5 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:50.195253 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd933ff-3dcf-474c-9033-1c993d38218a admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:50.223379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1070/2149] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:50.225121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b81c90-f1b6-4d60-a607-90599ddeefe5 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:50.231102 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1080/2150] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:51:50.232855 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd933ff-3dcf-474c-9033-1c993d38218a admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:50.248589 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd933ff-3dcf-474c-9033-1c993d38218a admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:50.251060 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b81c90-f1b6-4d60-a607-90599ddeefe5 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:50.256291 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278c114-6be0-4cf8-83f9-ef3e34dbf50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:50.256944 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278c114-6be0-4cf8-83f9-ef3e34dbf50e admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:50.258365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278c114-6be0-4cf8-83f9-ef3e34dbf50e admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:50.258816 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278c114-6be0-4cf8-83f9-ef3e34dbf50e admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:50.259667 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278c114-6be0-4cf8-83f9-ef3e34dbf50e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:50.263254 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278c114-6be0-4cf8-83f9-ef3e34dbf50e admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:50.265730 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3284857-f0f0-46ba-8d3f-6a83c458e8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:50.266603 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3284857-f0f0-46ba-8d3f-6a83c458e8bb admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:50.267279 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3284857-f0f0-46ba-8d3f-6a83c458e8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:50.268012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3284857-f0f0-46ba-8d3f-6a83c458e8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:50.269222 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3284857-f0f0-46ba-8d3f-6a83c458e8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:50.271371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3284857-f0f0-46ba-8d3f-6a83c458e8bb admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:50.303252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1071/2151] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:50.305071 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3284857-f0f0-46ba-8d3f-6a83c458e8bb admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:50.332844 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3284857-f0f0-46ba-8d3f-6a83c458e8bb admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:50.341077 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5cf50e-75dc-4a19-a1eb-b95bd1601a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:50.342202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5cf50e-75dc-4a19-a1eb-b95bd1601a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:50.342788 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5cf50e-75dc-4a19-a1eb-b95bd1601a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:50.343234 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5cf50e-75dc-4a19-a1eb-b95bd1601a3b admin admin] PATH_INFO: `/v3/projects/f326a61157fe4f5a8460da2734481b84/users/6cb90fe1f7794578b8dabb9c646bd400/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:50.350887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1081/2152] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:50 2022] POST /identity/v3/projects => generated 393 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:50.352943 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278c114-6be0-4cf8-83f9-ef3e34dbf50e admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:50.357012 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-4278c114-6be0-4cf8-83f9-ef3e34dbf50e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:50.376673 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5cf50e-75dc-4a19-a1eb-b95bd1601a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f326a61157fe4f5a8460da2734481b84, user_id=6cb90fe1f7794578b8dabb9c646bd400, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:50.383099 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5cf50e-75dc-4a19-a1eb-b95bd1601a3b admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:50.411588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:50.425458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1072/2153] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:50 2022] PUT /identity/v3/projects/f326a61157fe4f5a8460da2734481b84/users/6cb90fe1f7794578b8dabb9c646bd400/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:50.425458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5cf50e-75dc-4a19-a1eb-b95bd1601a3b admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:50.486826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278c114-6be0-4cf8-83f9-ef3e34dbf50e admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:50.528593 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:50.538796 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5cf50e-75dc-4a19-a1eb-b95bd1601a3b admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:50.552711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afd34b-aa17-47ef-a09c-156724dfe141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:50.554189 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afd34b-aa17-47ef-a09c-156724dfe141 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:50.555152 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afd34b-aa17-47ef-a09c-156724dfe141 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:50.555902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afd34b-aa17-47ef-a09c-156724dfe141 admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:50.556967 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afd34b-aa17-47ef-a09c-156724dfe141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:50.560340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afd34b-aa17-47ef-a09c-156724dfe141 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:50.601129 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1073/2154] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:50 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:50.603708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29483625-9807-4622-8b98-6c9c19140a01 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:50.604569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29483625-9807-4622-8b98-6c9c19140a01 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:50.605144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29483625-9807-4622-8b98-6c9c19140a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:50.608987 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53005085-18c0-44d6-bcee-dfbbad07cc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:50.610653 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53005085-18c0-44d6-bcee-dfbbad07cc85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:50.611216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53005085-18c0-44d6-bcee-dfbbad07cc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:50.611715 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53005085-18c0-44d6-bcee-dfbbad07cc85 admin admin] PATH_INFO: `/v3/projects/3fb2586133ad455a87e944bc64026343` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:50.613988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53005085-18c0-44d6-bcee-dfbbad07cc85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fb2586133ad455a87e944bc64026343)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:50.618264 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53005085-18c0-44d6-bcee-dfbbad07cc85 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:50.654235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-29483625-9807-4622-8b98-6c9c19140a01 None None] MFA Rules not processed for user `6cb90fe1f7794578b8dabb9c646bd400`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:50.655907 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-29483625-9807-4622-8b98-6c9c19140a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:50.749344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-53005085-18c0-44d6-bcee-dfbbad07cc85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fb2586133ad455a87e944bc64026343', 'request_id': 'req-53005085-18c0-44d6-bcee-dfbbad07cc85'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:50.761806 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-53005085-18c0-44d6-bcee-dfbbad07cc85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fb2586133ad455a87e944bc64026343', 'request_id': 'req-53005085-18c0-44d6-bcee-dfbbad07cc85'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:50.776843 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-53005085-18c0-44d6-bcee-dfbbad07cc85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fb2586133ad455a87e944bc64026343', 'request_id': 'req-53005085-18c0-44d6-bcee-dfbbad07cc85'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:50.784628 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1074/2155] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:50.786709 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29483625-9807-4622-8b98-6c9c19140a01 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:50.802386 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-53005085-18c0-44d6-bcee-dfbbad07cc85 admin admin] The token cache is being invalidate because project 3fb2586133ad455a87e944bc64026343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:50.802967 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-53005085-18c0-44d6-bcee-dfbbad07cc85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:50.804279 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-53005085-18c0-44d6-bcee-dfbbad07cc85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:50.807198 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1082/2156] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:50 2022] DELETE /identity/v3/projects/3fb2586133ad455a87e944bc64026343 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:50.809047 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53005085-18c0-44d6-bcee-dfbbad07cc85 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:50.810528 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29483625-9807-4622-8b98-6c9c19140a01 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:50.811848 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-53005085-18c0-44d6-bcee-dfbbad07cc85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:50.919352 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4b744-58d8-434f-a135-6b15cc93a015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:50.920030 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4b744-58d8-434f-a135-6b15cc93a015 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:50.920931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4b744-58d8-434f-a135-6b15cc93a015 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:50.920931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4b744-58d8-434f-a135-6b15cc93a015 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:50.921206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4b744-58d8-434f-a135-6b15cc93a015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:50.922856 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4b744-58d8-434f-a135-6b15cc93a015 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:50.941107 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1075/2157] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:50.941599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53005085-18c0-44d6-bcee-dfbbad07cc85 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:50.942069 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25631c79-798d-4ab5-8021-25840fd97d28 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:50.942069 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25631c79-798d-4ab5-8021-25840fd97d28 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:50.942069 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25631c79-798d-4ab5-8021-25840fd97d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:50.947327 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3f8f6-d4e7-4a10-9c77-b1996f3fc2de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:50.948975 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3f8f6-d4e7-4a10-9c77-b1996f3fc2de service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:50.949501 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3f8f6-d4e7-4a10-9c77-b1996f3fc2de service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:50.950160 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3f8f6-d4e7-4a10-9c77-b1996f3fc2de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:50.952936 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-38c3f8f6-d4e7-4a10-9c77-b1996f3fc2de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:50.963327 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-25631c79-798d-4ab5-8021-25840fd97d28 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:50.967042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-25631c79-798d-4ab5-8021-25840fd97d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:50.973752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:50.986294 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1076/2158] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:50.988076 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25631c79-798d-4ab5-8021-25840fd97d28 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:50.994446 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-25631c79-798d-4ab5-8021-25840fd97d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:51.014809 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25631c79-798d-4ab5-8021-25840fd97d28 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:51.020892 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad7dc9-49fc-499b-ad0a-adaa0822662c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:51.021692 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad7dc9-49fc-499b-ad0a-adaa0822662c admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:51.021999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad7dc9-49fc-499b-ad0a-adaa0822662c admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:51.022330 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad7dc9-49fc-499b-ad0a-adaa0822662c admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:51.023476 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad7dc9-49fc-499b-ad0a-adaa0822662c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:51.027140 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad7dc9-49fc-499b-ad0a-adaa0822662c admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:51.046367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1077/2159] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:51.046367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797704ac-c34c-421e-b271-b2dc92d64d81 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:51.046367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797704ac-c34c-421e-b271-b2dc92d64d81 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:51.046367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797704ac-c34c-421e-b271-b2dc92d64d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:51.075166 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-797704ac-c34c-421e-b271-b2dc92d64d81 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:51.076794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-797704ac-c34c-421e-b271-b2dc92d64d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:51.081380 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3f8f6-d4e7-4a10-9c77-b1996f3fc2de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:51.084189 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3f8f6-d4e7-4a10-9c77-b1996f3fc2de service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:51.091469 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1078/2160] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:51.092774 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797704ac-c34c-421e-b271-b2dc92d64d81 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:51.107456 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1083/2161] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:51.109236 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3f8f6-d4e7-4a10-9c77-b1996f3fc2de service cinder] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:51.112798 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-38c3f8f6-d4e7-4a10-9c77-b1996f3fc2de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:51.116996 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797704ac-c34c-421e-b271-b2dc92d64d81 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:51.124736 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bb92b-2bf3-4080-95ba-170366c27721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:51.125831 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bb92b-2bf3-4080-95ba-170366c27721 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:51.126694 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bb92b-2bf3-4080-95ba-170366c27721 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:51.127173 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bb92b-2bf3-4080-95ba-170366c27721 admin admin] PATH_INFO: `/v3/projects/83649b9ce63a46739c04d68768b14ae4/users/da0f8f359e304475b65941ed18bddff7/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:51.148953 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97bb92b-2bf3-4080-95ba-170366c27721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83649b9ce63a46739c04d68768b14ae4, user_id=da0f8f359e304475b65941ed18bddff7, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:51.152482 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97bb92b-2bf3-4080-95ba-170366c27721 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:51.154554 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3f8f6-d4e7-4a10-9c77-b1996f3fc2de service cinder] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:51.161199 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5604e-af92-4026-a6a0-fa330eaf449d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:51.162659 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5604e-af92-4026-a6a0-fa330eaf449d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:51.163243 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5604e-af92-4026-a6a0-fa330eaf449d admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:51.163747 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5604e-af92-4026-a6a0-fa330eaf449d admin admin] PATH_INFO: `/v3/users/bad82708846d45e88f37fb5da86e77b7` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:51.167303 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5604e-af92-4026-a6a0-fa330eaf449d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bad82708846d45e88f37fb5da86e77b7)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:51.170292 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1079/2162] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:51 2022] PUT /identity/v3/projects/83649b9ce63a46739c04d68768b14ae4/users/da0f8f359e304475b65941ed18bddff7/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:51.178835 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bb92b-2bf3-4080-95ba-170366c27721 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:51.178958 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5604e-af92-4026-a6a0-fa330eaf449d admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:51.216467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:51.272381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bb92b-2bf3-4080-95ba-170366c27721 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:51.280060 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b776395-adf9-4f3d-9620-4c7733be3410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:51.280740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b776395-adf9-4f3d-9620-4c7733be3410 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:51.281024 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b776395-adf9-4f3d-9620-4c7733be3410 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:51.281292 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b776395-adf9-4f3d-9620-4c7733be3410 admin admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:51.282328 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b776395-adf9-4f3d-9620-4c7733be3410 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:51:51.282530 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-8db5604e-af92-4026-a6a0-fa330eaf449d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bad82708846d45e88f37fb5da86e77b7'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:51.282849 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b776395-adf9-4f3d-9620-4c7733be3410 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:51.284774 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b776395-adf9-4f3d-9620-4c7733be3410 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:51.297145 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-8db5604e-af92-4026-a6a0-fa330eaf449d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bad82708846d45e88f37fb5da86e77b7'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:51.306374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1080/2163] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:51:51.306374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992ac89-8142-41c7-861b-a0717ff1bbf9 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:51.306374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992ac89-8142-41c7-861b-a0717ff1bbf9 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:51.306374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992ac89-8142-41c7-861b-a0717ff1bbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:51.311620 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-8db5604e-af92-4026-a6a0-fa330eaf449d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bad82708846d45e88f37fb5da86e77b7'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:51.312814 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-8db5604e-af92-4026-a6a0-fa330eaf449d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bad82708846d45e88f37fb5da86e77b7'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:51.336293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-8db5604e-af92-4026-a6a0-fa330eaf449d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bad82708846d45e88f37fb5da86e77b7'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:51.346625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1084/2164] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:51 2022] DELETE /identity/v3/users/bad82708846d45e88f37fb5da86e77b7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:51.347751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5604e-af92-4026-a6a0-fa330eaf449d admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:51.353039 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-8db5604e-af92-4026-a6a0-fa330eaf449d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:51.359605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-4992ac89-8142-41c7-861b-a0717ff1bbf9 None None] MFA Rules not processed for user `da0f8f359e304475b65941ed18bddff7`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:51.361236 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-4992ac89-8142-41c7-861b-a0717ff1bbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:51.450542 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5604e-af92-4026-a6a0-fa330eaf449d admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:51.455991 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bae38-3613-4590-8867-17ff4a1d6b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:51.456810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bae38-3613-4590-8867-17ff4a1d6b13 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:51.457011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bae38-3613-4590-8867-17ff4a1d6b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:51.457270 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bae38-3613-4590-8867-17ff4a1d6b13 admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:51.457999 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bae38-3613-4590-8867-17ff4a1d6b13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:51.465634 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bae38-3613-4590-8867-17ff4a1d6b13 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:51.522346 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1081/2165] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:51.524146 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6dcb2-a8e3-4d0b-b3f5-b05cbb4e4071 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:51.524453 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6dcb2-a8e3-4d0b-b3f5-b05cbb4e4071 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:51.524779 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6dcb2-a8e3-4d0b-b3f5-b05cbb4e4071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:51.527761 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1085/2166] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:51 2022] POST /identity/v3/projects => generated 405 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:51.529728 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bae38-3613-4590-8867-17ff4a1d6b13 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:51.535421 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ed2bae38-3613-4590-8867-17ff4a1d6b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:51.556779 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-4cc6dcb2-a8e3-4d0b-b3f5-b05cbb4e4071 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:51.559119 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-4cc6dcb2-a8e3-4d0b-b3f5-b05cbb4e4071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:51.580843 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:51.663765 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1082/2167] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:51.664649 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6dcb2-a8e3-4d0b-b3f5-b05cbb4e4071 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:51.671777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bae38-3613-4590-8867-17ff4a1d6b13 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:51.676732 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6dcb2-a8e3-4d0b-b3f5-b05cbb4e4071 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:51.680917 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68c8f5-b1ce-4b27-9eaf-4c343bbba578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:51.681699 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68c8f5-b1ce-4b27-9eaf-4c343bbba578 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:51.681975 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68c8f5-b1ce-4b27-9eaf-4c343bbba578 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:51.682993 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68c8f5-b1ce-4b27-9eaf-4c343bbba578 admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:51.683721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68c8f5-b1ce-4b27-9eaf-4c343bbba578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:51.685975 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68c8f5-b1ce-4b27-9eaf-4c343bbba578 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:51.687317 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4a710-05f4-48f3-9973-966ed31cdd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:51.687957 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4a710-05f4-48f3-9973-966ed31cdd7d admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:51.688237 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4a710-05f4-48f3-9973-966ed31cdd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:51.688897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4a710-05f4-48f3-9973-966ed31cdd7d admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:51.690251 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4a710-05f4-48f3-9973-966ed31cdd7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:51.692793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4a710-05f4-48f3-9973-966ed31cdd7d admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:51.726802 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1086/2168] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:51 2022] POST /identity/v3/projects => generated 393 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:51.726802 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68c8f5-b1ce-4b27-9eaf-4c343bbba578 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:51.726802 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-3f68c8f5-b1ce-4b27-9eaf-4c343bbba578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:51.739572 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1083/2169] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:51 2022] POST /identity/v3/users => generated 303 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:51.745134 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4a710-05f4-48f3-9973-966ed31cdd7d admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:51.754007 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4a710-05f4-48f3-9973-966ed31cdd7d admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:51.805281 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:51.818397 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68c8f5-b1ce-4b27-9eaf-4c343bbba578 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:51.824356 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5a1c8-0cce-4e14-b057-78d77cfec768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:51.825011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5a1c8-0cce-4e14-b057-78d77cfec768 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:51.825305 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5a1c8-0cce-4e14-b057-78d77cfec768 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:51.825603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5a1c8-0cce-4e14-b057-78d77cfec768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:51.857382 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc78a40-89f3-40f2-92f5-459a86f9bcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:51.858049 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc78a40-89f3-40f2-92f5-459a86f9bcd0 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:51.858331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc78a40-89f3-40f2-92f5-459a86f9bcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:51.858692 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc78a40-89f3-40f2-92f5-459a86f9bcd0 admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:51.859451 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc78a40-89f3-40f2-92f5-459a86f9bcd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:51.861538 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc78a40-89f3-40f2-92f5-459a86f9bcd0 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:51.898269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1084/2170] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:51 2022] POST /identity/v3/users => generated 303 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:51.899156 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc78a40-89f3-40f2-92f5-459a86f9bcd0 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:51.913202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc78a40-89f3-40f2-92f5-459a86f9bcd0 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:51.928024 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba9735-9c81-47d2-aa58-f0ce865797cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:51.928756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba9735-9c81-47d2-aa58-f0ce865797cb admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:51.929050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba9735-9c81-47d2-aa58-f0ce865797cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:51.929326 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba9735-9c81-47d2-aa58-f0ce865797cb admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:51.930126 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba9735-9c81-47d2-aa58-f0ce865797cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:51.932593 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba9735-9c81-47d2-aa58-f0ce865797cb admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:51.938093 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5a1c8-0cce-4e14-b057-78d77cfec768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:51.939918 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5a1c8-0cce-4e14-b057-78d77cfec768 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:51.953210 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1087/2171] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:51.954644 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5a1c8-0cce-4e14-b057-78d77cfec768 service neutron] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:51.959792 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1085/2172] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:51.961814 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba9735-9c81-47d2-aa58-f0ce865797cb admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:51.970670 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5a1c8-0cce-4e14-b057-78d77cfec768 service neutron] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:51.979976 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049408e0-e85d-4988-a0f7-d5a8f050bc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:51.980973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049408e0-e85d-4988-a0f7-d5a8f050bc20 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:51.981202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba9735-9c81-47d2-aa58-f0ce865797cb admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:51.981457 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049408e0-e85d-4988-a0f7-d5a8f050bc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:51.981906 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049408e0-e85d-4988-a0f7-d5a8f050bc20 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:51.983059 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049408e0-e85d-4988-a0f7-d5a8f050bc20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:51.986358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049408e0-e85d-4988-a0f7-d5a8f050bc20 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:51.990688 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531f41d-e617-4d0f-a62f-91ed7ff7748b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:51.991246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531f41d-e617-4d0f-a62f-91ed7ff7748b admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:51.991577 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531f41d-e617-4d0f-a62f-91ed7ff7748b admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:51.991898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531f41d-e617-4d0f-a62f-91ed7ff7748b admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:51.992909 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531f41d-e617-4d0f-a62f-91ed7ff7748b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:51.996489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531f41d-e617-4d0f-a62f-91ed7ff7748b admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:52.003226 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1088/2173] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:52.010139 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049408e0-e85d-4988-a0f7-d5a8f050bc20 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:52.022568 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1086/2174] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:51:52.027697 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049408e0-e85d-4988-a0f7-d5a8f050bc20 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:52.028536 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531f41d-e617-4d0f-a62f-91ed7ff7748b admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:52.035003 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85990aef-c1a0-4cbe-a24e-1773e8913ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:52.036468 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85990aef-c1a0-4cbe-a24e-1773e8913ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:52.037061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85990aef-c1a0-4cbe-a24e-1773e8913ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:52.037301 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85990aef-c1a0-4cbe-a24e-1773e8913ae4 admin admin] PATH_INFO: `/v3/projects/0361648c07db42e6a0762dbe18380b3a/users/3c7c418414b94b67aa82ae15c1b06a3c/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:52.042674 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531f41d-e617-4d0f-a62f-91ed7ff7748b admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:52.054471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a206e-5013-4282-8eca-2a74f140bb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:52.055289 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a206e-5013-4282-8eca-2a74f140bb61 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:52.055568 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a206e-5013-4282-8eca-2a74f140bb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:52.055840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a206e-5013-4282-8eca-2a74f140bb61 admin admin] PATH_INFO: `/v3/projects/b80cba9fa10647e29220fe91c8a04145/users/1face706aedc45e6abbb5c40d81cbdb7/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:52.067475 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85990aef-c1a0-4cbe-a24e-1773e8913ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0361648c07db42e6a0762dbe18380b3a, user_id=3c7c418414b94b67aa82ae15c1b06a3c, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:52.079354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85990aef-c1a0-4cbe-a24e-1773e8913ae4 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:52.081115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a206e-5013-4282-8eca-2a74f140bb61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b80cba9fa10647e29220fe91c8a04145, user_id=1face706aedc45e6abbb5c40d81cbdb7, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:52.084269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a206e-5013-4282-8eca-2a74f140bb61 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:52.105452 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1087/2175] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:52 2022] PUT /identity/v3/projects/b80cba9fa10647e29220fe91c8a04145/users/1face706aedc45e6abbb5c40d81cbdb7/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:52.111469 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1089/2176] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:52 2022] PUT /identity/v3/projects/0361648c07db42e6a0762dbe18380b3a/users/3c7c418414b94b67aa82ae15c1b06a3c/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:52.116278 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a206e-5013-4282-8eca-2a74f140bb61 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:52.118428 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03420c5d-6316-43b4-be47-d7198442819f None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:52.118912 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03420c5d-6316-43b4-be47-d7198442819f None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:52.119471 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03420c5d-6316-43b4-be47-d7198442819f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:52.159070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:52.187457 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-03420c5d-6316-43b4-be47-d7198442819f None None] MFA Rules not processed for user `1face706aedc45e6abbb5c40d81cbdb7`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:52.192424 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-03420c5d-6316-43b4-be47-d7198442819f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:52.246314 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a206e-5013-4282-8eca-2a74f140bb61 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:52.254015 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c0e2a-2db2-48a7-a505-4df0788935e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:52.254663 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c0e2a-2db2-48a7-a505-4df0788935e7 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:52.254950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c0e2a-2db2-48a7-a505-4df0788935e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:52.255353 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c0e2a-2db2-48a7-a505-4df0788935e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:52.256168 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c0e2a-2db2-48a7-a505-4df0788935e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:52.257889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c0e2a-2db2-48a7-a505-4df0788935e7 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:52.274725 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1088/2177] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:52.276095 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c0e2a-2db2-48a7-a505-4df0788935e7 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:52.298252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c0e2a-2db2-48a7-a505-4df0788935e7 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:52.308218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d961c8-ab87-4ae2-9be1-6063149ed5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:52.309806 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d961c8-ab87-4ae2-9be1-6063149ed5f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:52.310693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d961c8-ab87-4ae2-9be1-6063149ed5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:52.311151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d961c8-ab87-4ae2-9be1-6063149ed5f9 admin admin] PATH_INFO: `/v3/projects/0361648c07db42e6a0762dbe18380b3a/users/3c7c418414b94b67aa82ae15c1b06a3c/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:52.315275 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d961c8-ab87-4ae2-9be1-6063149ed5f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0361648c07db42e6a0762dbe18380b3a, user_id=3c7c418414b94b67aa82ae15c1b06a3c, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:52.320541 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d961c8-ab87-4ae2-9be1-6063149ed5f9 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:52.327849 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1090/2178] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:52 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:52.332750 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03420c5d-6316-43b4-be47-d7198442819f None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:52.346126 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1089/2179] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:52 2022] PUT /identity/v3/projects/0361648c07db42e6a0762dbe18380b3a/users/3c7c418414b94b67aa82ae15c1b06a3c/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:52.348545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03420c5d-6316-43b4-be47-d7198442819f None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:52.364497 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad9037-5917-4200-9aba-7bb23544710c None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:52.364959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad9037-5917-4200-9aba-7bb23544710c None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:52.365113 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad9037-5917-4200-9aba-7bb23544710c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:52.404164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-6cad9037-5917-4200-9aba-7bb23544710c None None] MFA Rules not processed for user `3c7c418414b94b67aa82ae15c1b06a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:52.406419 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-6cad9037-5917-4200-9aba-7bb23544710c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:52.470965 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9a234-a905-4119-bc82-2e5d41f3114c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:52.471686 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9a234-a905-4119-bc82-2e5d41f3114c admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:52.471991 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9a234-a905-4119-bc82-2e5d41f3114c admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:52.472270 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9a234-a905-4119-bc82-2e5d41f3114c admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:52.473362 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9a234-a905-4119-bc82-2e5d41f3114c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:52.476274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9a234-a905-4119-bc82-2e5d41f3114c admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:52.517324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:52.529784 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1091/2180] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:52 2022] POST /identity/v3/projects => generated 405 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:51:52.536172 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9a234-a905-4119-bc82-2e5d41f3114c admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:52.539300 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-e9f9a234-a905-4119-bc82-2e5d41f3114c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:52.583222 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1090/2181] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:52 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:52.585695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad9037-5917-4200-9aba-7bb23544710c None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:52.601342 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad9037-5917-4200-9aba-7bb23544710c None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:52.672021 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9a234-a905-4119-bc82-2e5d41f3114c admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:52.681455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8bd62-3a93-4baa-b75b-c127745e9885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:52.681455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8bd62-3a93-4baa-b75b-c127745e9885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:52.681455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8bd62-3a93-4baa-b75b-c127745e9885 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:52.681455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8bd62-3a93-4baa-b75b-c127745e9885 admin admin] PATH_INFO: `/v3/projects/01d015e2af0047cb8954b76003d76499` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:52.685167 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8bd62-3a93-4baa-b75b-c127745e9885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01d015e2af0047cb8954b76003d76499)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:52.688323 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8bd62-3a93-4baa-b75b-c127745e9885 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:52.697725 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c399850-803d-4142-91fd-3a269beb8e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:52.698997 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c399850-803d-4142-91fd-3a269beb8e63 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:52.699288 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c399850-803d-4142-91fd-3a269beb8e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:52.699558 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c399850-803d-4142-91fd-3a269beb8e63 admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:52.700230 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c399850-803d-4142-91fd-3a269beb8e63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:52.702957 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c399850-803d-4142-91fd-3a269beb8e63 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:52.745564 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1091/2182] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:52 2022] POST /identity/v3/users => generated 309 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:52.745564 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c399850-803d-4142-91fd-3a269beb8e63 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:52.747546 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-4c399850-803d-4142-91fd-3a269beb8e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:52.753876 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:52.790784 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-1ee8bd62-3a93-4baa-b75b-c127745e9885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01d015e2af0047cb8954b76003d76499', 'request_id': 'req-1ee8bd62-3a93-4baa-b75b-c127745e9885'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:52.801458 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-1ee8bd62-3a93-4baa-b75b-c127745e9885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01d015e2af0047cb8954b76003d76499', 'request_id': 'req-1ee8bd62-3a93-4baa-b75b-c127745e9885'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:52.813928 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-1ee8bd62-3a93-4baa-b75b-c127745e9885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01d015e2af0047cb8954b76003d76499', 'request_id': 'req-1ee8bd62-3a93-4baa-b75b-c127745e9885'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:52.835069 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-1ee8bd62-3a93-4baa-b75b-c127745e9885 admin admin] The token cache is being invalidate because project 01d015e2af0047cb8954b76003d76499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:52.835353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-1ee8bd62-3a93-4baa-b75b-c127745e9885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:52.836191 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-1ee8bd62-3a93-4baa-b75b-c127745e9885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:52.843123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1092/2183] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:52 2022] DELETE /identity/v3/projects/01d015e2af0047cb8954b76003d76499 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:52.843123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8bd62-3a93-4baa-b75b-c127745e9885 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:52.848441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-1ee8bd62-3a93-4baa-b75b-c127745e9885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:52.858864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c399850-803d-4142-91fd-3a269beb8e63 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:52.957046 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b1423-67a8-4000-81a8-1a7a408267df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:52.958535 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b1423-67a8-4000-81a8-1a7a408267df service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:52.959093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b1423-67a8-4000-81a8-1a7a408267df service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:52.959637 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b1423-67a8-4000-81a8-1a7a408267df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:52.965702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-068b1423-67a8-4000-81a8-1a7a408267df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:53.025729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8bd62-3a93-4baa-b75b-c127745e9885 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:53.032583 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd738fb6-d291-4ca6-bd3e-c7afec851680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:53.033482 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd738fb6-d291-4ca6-bd3e-c7afec851680 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:53.033825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd738fb6-d291-4ca6-bd3e-c7afec851680 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:53.034105 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd738fb6-d291-4ca6-bd3e-c7afec851680 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:53.034782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd738fb6-d291-4ca6-bd3e-c7afec851680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:53.036587 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd738fb6-d291-4ca6-bd3e-c7afec851680 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:53.049473 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1093/2184] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:53.054234 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:53.054883 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc16a2-94ca-491a-9a79-42974ccce7d7 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:53.055231 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc16a2-94ca-491a-9a79-42974ccce7d7 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:53.055574 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc16a2-94ca-491a-9a79-42974ccce7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:53.083744 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-67fc16a2-94ca-491a-9a79-42974ccce7d7 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:53.085460 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-67fc16a2-94ca-491a-9a79-42974ccce7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:53.092432 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b1423-67a8-4000-81a8-1a7a408267df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:53.095021 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b1423-67a8-4000-81a8-1a7a408267df service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:53.097625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1094/2185] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:53.098951 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc16a2-94ca-491a-9a79-42974ccce7d7 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:53.117017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc16a2-94ca-491a-9a79-42974ccce7d7 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:53.117767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1092/2186] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:52 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:53.120647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c296fd9-a4b9-44c2-ac9c-c636147bbe12 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:53.121177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c296fd9-a4b9-44c2-ac9c-c636147bbe12 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:53.121703 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c296fd9-a4b9-44c2-ac9c-c636147bbe12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:53.124376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3448fc-8867-4b99-8c9c-4c770cc6f625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:53.125333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3448fc-8867-4b99-8c9c-4c770cc6f625 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:53.125946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3448fc-8867-4b99-8c9c-4c770cc6f625 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:53.126406 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3448fc-8867-4b99-8c9c-4c770cc6f625 admin admin] PATH_INFO: `/v3/projects/0738bf7f40ca49b3ae408f55417bc850/users/471ec8cca7c045c4b213b28d965307cf/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:53.157636 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3448fc-8867-4b99-8c9c-4c770cc6f625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0738bf7f40ca49b3ae408f55417bc850, user_id=471ec8cca7c045c4b213b28d965307cf, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:53.157954 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-4c296fd9-a4b9-44c2-ac9c-c636147bbe12 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:53.159505 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-4c296fd9-a4b9-44c2-ac9c-c636147bbe12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:53.164260 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3448fc-8867-4b99-8c9c-4c770cc6f625 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:53.181759 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1093/2187] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:53.185395 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c296fd9-a4b9-44c2-ac9c-c636147bbe12 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:53.191018 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1095/2188] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:53 2022] PUT /identity/v3/projects/0738bf7f40ca49b3ae408f55417bc850/users/471ec8cca7c045c4b213b28d965307cf/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:53.195488 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3448fc-8867-4b99-8c9c-4c770cc6f625 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:53.197687 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-7d3448fc-8867-4b99-8c9c-4c770cc6f625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:53.207039 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c296fd9-a4b9-44c2-ac9c-c636147bbe12 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:53.302107 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3448fc-8867-4b99-8c9c-4c770cc6f625 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:53.324948 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ddc99b-c8f1-49cf-9368-e7b5e63adfae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:53.325556 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddc99b-c8f1-49cf-9368-e7b5e63adfae service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:53.325873 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddc99b-c8f1-49cf-9368-e7b5e63adfae service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:53.326118 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddc99b-c8f1-49cf-9368-e7b5e63adfae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:53.328796 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-22ddc99b-c8f1-49cf-9368-e7b5e63adfae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:53.341668 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604eacc-89fe-401f-bad9-9ae20aaa0c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:53.342655 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604eacc-89fe-401f-bad9-9ae20aaa0c36 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:53.343217 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604eacc-89fe-401f-bad9-9ae20aaa0c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:53.343571 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604eacc-89fe-401f-bad9-9ae20aaa0c36 admin admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:53.344515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604eacc-89fe-401f-bad9-9ae20aaa0c36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:51:53.345022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604eacc-89fe-401f-bad9-9ae20aaa0c36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:53.347070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604eacc-89fe-401f-bad9-9ae20aaa0c36 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:53.371026 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1094/2189] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:51:53.371026 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604eacc-89fe-401f-bad9-9ae20aaa0c36 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:53.384819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:53.385988 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604eacc-89fe-401f-bad9-9ae20aaa0c36 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:53.398470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e049f-f85c-4e68-856b-389319cc849a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:53.399749 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e049f-f85c-4e68-856b-389319cc849a admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:53.400304 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e049f-f85c-4e68-856b-389319cc849a admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:53.401459 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e049f-f85c-4e68-856b-389319cc849a admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:53.402721 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e049f-f85c-4e68-856b-389319cc849a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:53.405813 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e049f-f85c-4e68-856b-389319cc849a admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:53.432192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1095/2190] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:53.433130 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e049f-f85c-4e68-856b-389319cc849a admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:53.451544 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e049f-f85c-4e68-856b-389319cc849a admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:53.454910 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ddc99b-c8f1-49cf-9368-e7b5e63adfae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:53.456670 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ddc99b-c8f1-49cf-9368-e7b5e63adfae service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:53.458218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bea91-543d-43b8-9360-ca4d6df9891a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:53.459106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bea91-543d-43b8-9360-ca4d6df9891a admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:53.459579 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bea91-543d-43b8-9360-ca4d6df9891a admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:53.460095 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bea91-543d-43b8-9360-ca4d6df9891a admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:53.461380 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bea91-543d-43b8-9360-ca4d6df9891a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:53.465660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bea91-543d-43b8-9360-ca4d6df9891a admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:53.470293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1096/2191] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:53 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:53.471236 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ddc99b-c8f1-49cf-9368-e7b5e63adfae service cinder] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:53.487262 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ddc99b-c8f1-49cf-9368-e7b5e63adfae service cinder] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:53.496915 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388e336-6ebc-4326-96c0-7f33dd873e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:53.498077 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388e336-6ebc-4326-96c0-7f33dd873e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:53.498533 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388e336-6ebc-4326-96c0-7f33dd873e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:53.498970 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388e336-6ebc-4326-96c0-7f33dd873e54 admin admin] PATH_INFO: `/v3/projects/0738bf7f40ca49b3ae408f55417bc850/users/471ec8cca7c045c4b213b28d965307cf/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:53.502635 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388e336-6ebc-4326-96c0-7f33dd873e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0738bf7f40ca49b3ae408f55417bc850, user_id=471ec8cca7c045c4b213b28d965307cf, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:53.507650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388e336-6ebc-4326-96c0-7f33dd873e54 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:53.525450 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1096/2192] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:53 2022] POST /identity/v3/projects => generated 363 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:53.532604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bea91-543d-43b8-9360-ca4d6df9891a admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:53.533344 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1097/2193] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:53 2022] PUT /identity/v3/projects/0738bf7f40ca49b3ae408f55417bc850/users/471ec8cca7c045c4b213b28d965307cf/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:53.547825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d897d7-0d2f-4e31-b6a4-48710ade0919 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:53.548601 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d897d7-0d2f-4e31-b6a4-48710ade0919 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:53.549073 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d897d7-0d2f-4e31-b6a4-48710ade0919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:53.616850 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-10d897d7-0d2f-4e31-b6a4-48710ade0919 None None] MFA Rules not processed for user `471ec8cca7c045c4b213b28d965307cf`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:53.620931 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-10d897d7-0d2f-4e31-b6a4-48710ade0919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:53.655783 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bea91-543d-43b8-9360-ca4d6df9891a admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:53.667282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7524fdb-dc3c-479a-9b93-6ec62b394561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:53.669276 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7524fdb-dc3c-479a-9b93-6ec62b394561 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:53.670040 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7524fdb-dc3c-479a-9b93-6ec62b394561 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:53.670745 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7524fdb-dc3c-479a-9b93-6ec62b394561 admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:53.673350 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7524fdb-dc3c-479a-9b93-6ec62b394561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:53.677024 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7524fdb-dc3c-479a-9b93-6ec62b394561 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:53.750476 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1097/2194] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:53 2022] POST /identity/v3/users => generated 282 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:53.761108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7524fdb-dc3c-479a-9b93-6ec62b394561 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:53.789317 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7524fdb-dc3c-479a-9b93-6ec62b394561 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:53.802035 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72604ed8-bb69-45ef-819c-9aee0d9ecdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:53.803092 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72604ed8-bb69-45ef-819c-9aee0d9ecdff admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:53.803619 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72604ed8-bb69-45ef-819c-9aee0d9ecdff admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:53.804088 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72604ed8-bb69-45ef-819c-9aee0d9ecdff admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:53.805987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72604ed8-bb69-45ef-819c-9aee0d9ecdff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:53.812497 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72604ed8-bb69-45ef-819c-9aee0d9ecdff admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:53.816514 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1098/2195] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:53 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:53.836731 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d897d7-0d2f-4e31-b6a4-48710ade0919 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:53.839937 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-10d897d7-0d2f-4e31-b6a4-48710ade0919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:53.851750 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1098/2196] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:53.855884 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72604ed8-bb69-45ef-819c-9aee0d9ecdff admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:53.899137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72604ed8-bb69-45ef-819c-9aee0d9ecdff admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:53.908641 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e38a55-1b15-4186-981a-ebf3f4f43183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:53.909922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e38a55-1b15-4186-981a-ebf3f4f43183 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:53.910511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e38a55-1b15-4186-981a-ebf3f4f43183 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:53.911235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e38a55-1b15-4186-981a-ebf3f4f43183 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:53.913452 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e38a55-1b15-4186-981a-ebf3f4f43183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:53.915634 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e38a55-1b15-4186-981a-ebf3f4f43183 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:53.927999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:53.948980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1099/2197] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:53.951503 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e38a55-1b15-4186-981a-ebf3f4f43183 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:53.963319 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d897d7-0d2f-4e31-b6a4-48710ade0919 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:53.983617 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e38a55-1b15-4186-981a-ebf3f4f43183 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:53.986200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d70ed-93f2-414b-abe0-b8299cb3e813 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:53.989259 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d70ed-93f2-414b-abe0-b8299cb3e813 service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:53.990199 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d70ed-93f2-414b-abe0-b8299cb3e813 service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:53.990995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d70ed-93f2-414b-abe0-b8299cb3e813 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:53.996002 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e0b6d-d6be-4f5e-aa93-72e72998ad3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:53.997160 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e0b6d-d6be-4f5e-aa93-72e72998ad3f admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:53.997592 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e0b6d-d6be-4f5e-aa93-72e72998ad3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:53.998018 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e0b6d-d6be-4f5e-aa93-72e72998ad3f admin admin] PATH_INFO: `/v3/projects/8fa230125d47431fa53b0a2c9154d8c8/users/9baa954a467c4bb4a297a2859b38700e/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:54.018224 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d70ed-93f2-414b-abe0-b8299cb3e813 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:54.022766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d70ed-93f2-414b-abe0-b8299cb3e813 service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:54.029909 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e0b6d-d6be-4f5e-aa93-72e72998ad3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa230125d47431fa53b0a2c9154d8c8, user_id=9baa954a467c4bb4a297a2859b38700e, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:54.034880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e0b6d-d6be-4f5e-aa93-72e72998ad3f admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:54.045490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1099/2198] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:53 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:54.078547 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1100/2199] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:53 2022] PUT /identity/v3/projects/8fa230125d47431fa53b0a2c9154d8c8/users/9baa954a467c4bb4a297a2859b38700e/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:54.082360 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efc89c-6cbf-4ccd-b893-a5cc9c34fcdd None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:54.082581 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efc89c-6cbf-4ccd-b893-a5cc9c34fcdd None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:54.082941 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efc89c-6cbf-4ccd-b893-a5cc9c34fcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:54.149991 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-e1efc89c-6cbf-4ccd-b893-a5cc9c34fcdd None None] MFA Rules not processed for user `9baa954a467c4bb4a297a2859b38700e`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:54.152831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-e1efc89c-6cbf-4ccd-b893-a5cc9c34fcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:54.243494 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:54.289509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1100/2200] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:54.326400 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e0b6d-d6be-4f5e-aa93-72e72998ad3f admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:54.333684 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efc89c-6cbf-4ccd-b893-a5cc9c34fcdd None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:54.437078 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e0b6d-d6be-4f5e-aa93-72e72998ad3f admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:54.437710 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efc89c-6cbf-4ccd-b893-a5cc9c34fcdd None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:54.443444 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8f334-2bb8-4c7a-83e0-48dcc3f56db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:54.444127 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8f334-2bb8-4c7a-83e0-48dcc3f56db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:54.444429 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8f334-2bb8-4c7a-83e0-48dcc3f56db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:54.444707 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8f334-2bb8-4c7a-83e0-48dcc3f56db4 admin admin] PATH_INFO: `/v3/users/1face706aedc45e6abbb5c40d81cbdb7` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:54.444811 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20698d0-2856-4e7c-b665-a4aee6434223 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:54.445548 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20698d0-2856-4e7c-b665-a4aee6434223 service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:54.446008 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20698d0-2856-4e7c-b665-a4aee6434223 service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:54.446441 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20698d0-2856-4e7c-b665-a4aee6434223 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:54.446568 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8f334-2bb8-4c7a-83e0-48dcc3f56db4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1face706aedc45e6abbb5c40d81cbdb7)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:54.450036 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8f334-2bb8-4c7a-83e0-48dcc3f56db4 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:54.458146 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20698d0-2856-4e7c-b665-a4aee6434223 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:54.460327 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20698d0-2856-4e7c-b665-a4aee6434223 service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:54.472880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1101/2201] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:51:54.511747 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-2cb8f334-2bb8-4c7a-83e0-48dcc3f56db4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1face706aedc45e6abbb5c40d81cbdb7'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:54.522825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-2cb8f334-2bb8-4c7a-83e0-48dcc3f56db4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1face706aedc45e6abbb5c40d81cbdb7'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:54.533973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-2cb8f334-2bb8-4c7a-83e0-48dcc3f56db4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1face706aedc45e6abbb5c40d81cbdb7'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:54.534924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-2cb8f334-2bb8-4c7a-83e0-48dcc3f56db4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1face706aedc45e6abbb5c40d81cbdb7'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:54.556706 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-2cb8f334-2bb8-4c7a-83e0-48dcc3f56db4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1face706aedc45e6abbb5c40d81cbdb7'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:54.568383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1101/2202] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:54 2022] DELETE /identity/v3/users/1face706aedc45e6abbb5c40d81cbdb7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:54.575045 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95d1ef-308e-409d-bb35-b1459efb7754 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:54.575481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95d1ef-308e-409d-bb35-b1459efb7754 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:54.575722 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95d1ef-308e-409d-bb35-b1459efb7754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:54.602898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-7e95d1ef-308e-409d-bb35-b1459efb7754 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:54.604465 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-7e95d1ef-308e-409d-bb35-b1459efb7754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:54.740316 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1102/2203] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:54.754125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8f334-2bb8-4c7a-83e0-48dcc3f56db4 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:54.756355 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-2cb8f334-2bb8-4c7a-83e0-48dcc3f56db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:54.856922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8f334-2bb8-4c7a-83e0-48dcc3f56db4 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:54.862687 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac063b-4a6a-4d2f-81b4-e201eac844f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:54.863474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac063b-4a6a-4d2f-81b4-e201eac844f3 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:54.863945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac063b-4a6a-4d2f-81b4-e201eac844f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:54.864386 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac063b-4a6a-4d2f-81b4-e201eac844f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:54.884408 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac063b-4a6a-4d2f-81b4-e201eac844f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:54.888255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac063b-4a6a-4d2f-81b4-e201eac844f3 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:54.897703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:54.910754 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1102/2204] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:55.333205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95d1ef-308e-409d-bb35-b1459efb7754 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:55.337431 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-7e95d1ef-308e-409d-bb35-b1459efb7754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:55.362587 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95d1ef-308e-409d-bb35-b1459efb7754 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:55.370612 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c65ed9-53b2-4591-bc47-21712059fc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:55.382819 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c65ed9-53b2-4591-bc47-21712059fc86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:55.383202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c65ed9-53b2-4591-bc47-21712059fc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:55.383736 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c65ed9-53b2-4591-bc47-21712059fc86 admin admin] PATH_INFO: `/v3/projects/b80cba9fa10647e29220fe91c8a04145` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:55.385328 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c65ed9-53b2-4591-bc47-21712059fc86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b80cba9fa10647e29220fe91c8a04145)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:55.388710 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c65ed9-53b2-4591-bc47-21712059fc86 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:55.458142 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-81c65ed9-53b2-4591-bc47-21712059fc86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b80cba9fa10647e29220fe91c8a04145', 'request_id': 'req-81c65ed9-53b2-4591-bc47-21712059fc86'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:55.469173 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-81c65ed9-53b2-4591-bc47-21712059fc86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b80cba9fa10647e29220fe91c8a04145', 'request_id': 'req-81c65ed9-53b2-4591-bc47-21712059fc86'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:55.482849 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-81c65ed9-53b2-4591-bc47-21712059fc86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b80cba9fa10647e29220fe91c8a04145', 'request_id': 'req-81c65ed9-53b2-4591-bc47-21712059fc86'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:55.509695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-81c65ed9-53b2-4591-bc47-21712059fc86 admin admin] The token cache is being invalidate because project b80cba9fa10647e29220fe91c8a04145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:55.511160 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-81c65ed9-53b2-4591-bc47-21712059fc86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:55.512395 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-81c65ed9-53b2-4591-bc47-21712059fc86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:55.514806 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1103/2205] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:55 2022] DELETE /identity/v3/projects/b80cba9fa10647e29220fe91c8a04145 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:55.518720 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac063b-4a6a-4d2f-81b4-e201eac844f3 service neutron] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:55.531174 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac063b-4a6a-4d2f-81b4-e201eac844f3 service neutron] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:55.644841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f137ddd-ba18-45cb-b20f-f59c989bc8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:55.646293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f137ddd-ba18-45cb-b20f-f59c989bc8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:55.646612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f137ddd-ba18-45cb-b20f-f59c989bc8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:55.647157 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f137ddd-ba18-45cb-b20f-f59c989bc8e7 admin admin] PATH_INFO: `/v3/users/471ec8cca7c045c4b213b28d965307cf` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:55.649390 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f137ddd-ba18-45cb-b20f-f59c989bc8e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=471ec8cca7c045c4b213b28d965307cf)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:55.653712 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f137ddd-ba18-45cb-b20f-f59c989bc8e7 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:55.776064 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-5f137ddd-ba18-45cb-b20f-f59c989bc8e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '471ec8cca7c045c4b213b28d965307cf'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:55.790420 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-5f137ddd-ba18-45cb-b20f-f59c989bc8e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '471ec8cca7c045c4b213b28d965307cf'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:55.802822 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-5f137ddd-ba18-45cb-b20f-f59c989bc8e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '471ec8cca7c045c4b213b28d965307cf'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:55.803708 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-5f137ddd-ba18-45cb-b20f-f59c989bc8e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '471ec8cca7c045c4b213b28d965307cf'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:55.821071 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-5f137ddd-ba18-45cb-b20f-f59c989bc8e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '471ec8cca7c045c4b213b28d965307cf'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:55.830630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1103/2206] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:55 2022] DELETE /identity/v3/users/471ec8cca7c045c4b213b28d965307cf => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:56.315957 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c65ed9-53b2-4591-bc47-21712059fc86 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:56.318316 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-81c65ed9-53b2-4591-bc47-21712059fc86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:56.346663 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:56.356989 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c65ed9-53b2-4591-bc47-21712059fc86 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:56.468773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29251f48-0e48-4c42-85d7-90fdedbb4546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:56.472259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29251f48-0e48-4c42-85d7-90fdedbb4546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:56.472259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29251f48-0e48-4c42-85d7-90fdedbb4546 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:56.472259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29251f48-0e48-4c42-85d7-90fdedbb4546 admin admin] PATH_INFO: `/v3/projects/0738bf7f40ca49b3ae408f55417bc850` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:56.472915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29251f48-0e48-4c42-85d7-90fdedbb4546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0738bf7f40ca49b3ae408f55417bc850)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:56.476634 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29251f48-0e48-4c42-85d7-90fdedbb4546 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:56.576334 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-29251f48-0e48-4c42-85d7-90fdedbb4546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0738bf7f40ca49b3ae408f55417bc850', 'request_id': 'req-29251f48-0e48-4c42-85d7-90fdedbb4546'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:56.588845 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-29251f48-0e48-4c42-85d7-90fdedbb4546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0738bf7f40ca49b3ae408f55417bc850', 'request_id': 'req-29251f48-0e48-4c42-85d7-90fdedbb4546'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:56.609772 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-29251f48-0e48-4c42-85d7-90fdedbb4546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0738bf7f40ca49b3ae408f55417bc850', 'request_id': 'req-29251f48-0e48-4c42-85d7-90fdedbb4546'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:56.653181 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-29251f48-0e48-4c42-85d7-90fdedbb4546 admin admin] The token cache is being invalidate because project 0738bf7f40ca49b3ae408f55417bc850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:56.653752 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-29251f48-0e48-4c42-85d7-90fdedbb4546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:56.655749 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-29251f48-0e48-4c42-85d7-90fdedbb4546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:56.664472 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1104/2207] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:56 2022] DELETE /identity/v3/projects/0738bf7f40ca49b3ae408f55417bc850 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:56.670371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32c373-4396-4886-a21a-d7db7f74141a None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:56.672388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32c373-4396-4886-a21a-d7db7f74141a None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:56.673175 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32c373-4396-4886-a21a-d7db7f74141a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:56.734305 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-3e32c373-4396-4886-a21a-d7db7f74141a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:56.735822 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-3e32c373-4396-4886-a21a-d7db7f74141a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:56.847160 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1104/2208] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:56.860625 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32cade-5c44-4cb6-b331-afe46008e8e6 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:56.860948 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32cade-5c44-4cb6-b331-afe46008e8e6 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:56.861252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32cade-5c44-4cb6-b331-afe46008e8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:56.894984 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-ac32cade-5c44-4cb6-b331-afe46008e8e6 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:56.897159 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-ac32cade-5c44-4cb6-b331-afe46008e8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:56.912158 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1105/2209] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:56.919464 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32c373-4396-4886-a21a-d7db7f74141a None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:56.932630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32c373-4396-4886-a21a-d7db7f74141a None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:56.939502 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8818a83-8645-49c3-bac4-3e4b3ee38987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:56.940439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8818a83-8645-49c3-bac4-3e4b3ee38987 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:56.940724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8818a83-8645-49c3-bac4-3e4b3ee38987 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:56.941003 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8818a83-8645-49c3-bac4-3e4b3ee38987 admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:56.941726 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8818a83-8645-49c3-bac4-3e4b3ee38987 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:51:56.942030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8818a83-8645-49c3-bac4-3e4b3ee38987 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:56.943764 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8818a83-8645-49c3-bac4-3e4b3ee38987 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:56.958288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1105/2210] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:51:56.966050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32cade-5c44-4cb6-b331-afe46008e8e6 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:56.980645 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32cade-5c44-4cb6-b331-afe46008e8e6 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:56.987016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ec0d2-7a0c-4350-8329-e29ec77eadea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:56.987654 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ec0d2-7a0c-4350-8329-e29ec77eadea admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:56.987932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ec0d2-7a0c-4350-8329-e29ec77eadea admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:56.988205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ec0d2-7a0c-4350-8329-e29ec77eadea admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:56.988859 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ec0d2-7a0c-4350-8329-e29ec77eadea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:56.990843 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ec0d2-7a0c-4350-8329-e29ec77eadea admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:57.043228 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1106/2211] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:56 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:57.051223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8818a83-8645-49c3-bac4-3e4b3ee38987 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:57.070773 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8818a83-8645-49c3-bac4-3e4b3ee38987 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:57.080960 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:57.162828 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81670826-8006-4b28-b511-b7dc9375e83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:57.163470 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81670826-8006-4b28-b511-b7dc9375e83a admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:57.163752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81670826-8006-4b28-b511-b7dc9375e83a admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:57.164026 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81670826-8006-4b28-b511-b7dc9375e83a admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:57.164687 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81670826-8006-4b28-b511-b7dc9375e83a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:57.167792 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81670826-8006-4b28-b511-b7dc9375e83a admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:57.193603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1106/2212] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:57 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:57.199271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ec0d2-7a0c-4350-8329-e29ec77eadea admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:57.217767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ec0d2-7a0c-4350-8329-e29ec77eadea admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:57.225241 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbad9f-45d4-464d-b44b-36f31ee45cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:57.226143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbad9f-45d4-464d-b44b-36f31ee45cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:57.226451 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbad9f-45d4-464d-b44b-36f31ee45cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:57.226923 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbad9f-45d4-464d-b44b-36f31ee45cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:57.227793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdbad9f-45d4-464d-b44b-36f31ee45cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:57.230438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdbad9f-45d4-464d-b44b-36f31ee45cb5 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:57.245618 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1107/2213] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:57.251492 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81670826-8006-4b28-b511-b7dc9375e83a admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:57.263672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81670826-8006-4b28-b511-b7dc9375e83a admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:57.268669 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a5314-da23-46e8-8d1d-95d170562a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:57.269337 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a5314-da23-46e8-8d1d-95d170562a7c admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:57.269868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a5314-da23-46e8-8d1d-95d170562a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:57.270190 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a5314-da23-46e8-8d1d-95d170562a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:57.270921 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a5314-da23-46e8-8d1d-95d170562a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:57.272745 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a5314-da23-46e8-8d1d-95d170562a7c admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:57.285300 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1107/2214] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:51:57.290195 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbad9f-45d4-464d-b44b-36f31ee45cb5 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:57.301911 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbad9f-45d4-464d-b44b-36f31ee45cb5 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:57.307930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5655da6-13fc-40a2-b15e-846438e890c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:57.308784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5655da6-13fc-40a2-b15e-846438e890c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:57.309067 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5655da6-13fc-40a2-b15e-846438e890c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:57.309347 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5655da6-13fc-40a2-b15e-846438e890c4 admin admin] PATH_INFO: `/v3/projects/45307d81da464b6ab2285b70d6fb2b09/users/cf0ee9e2232e48a991277f65335382cf/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:57.330899 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5655da6-13fc-40a2-b15e-846438e890c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45307d81da464b6ab2285b70d6fb2b09, user_id=cf0ee9e2232e48a991277f65335382cf, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:57.336600 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5655da6-13fc-40a2-b15e-846438e890c4 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:57.361327 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1108/2215] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:57 2022] PUT /identity/v3/projects/45307d81da464b6ab2285b70d6fb2b09/users/cf0ee9e2232e48a991277f65335382cf/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:57.380463 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d5f76-4b8d-49d7-b423-eff99ef6ca8e None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:57.380822 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d5f76-4b8d-49d7-b423-eff99ef6ca8e None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:57.381157 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d5f76-4b8d-49d7-b423-eff99ef6ca8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:57.429637 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-1f2d5f76-4b8d-49d7-b423-eff99ef6ca8e None None] MFA Rules not processed for user `cf0ee9e2232e48a991277f65335382cf`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:57.430988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-1f2d5f76-4b8d-49d7-b423-eff99ef6ca8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:57.538442 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1108/2216] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:57.544757 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5655da6-13fc-40a2-b15e-846438e890c4 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:57.607030 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:57.655684 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5655da6-13fc-40a2-b15e-846438e890c4 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:57.661203 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97612fdb-72da-4794-a40b-db05f39172e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:57.661879 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97612fdb-72da-4794-a40b-db05f39172e9 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:57.662162 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97612fdb-72da-4794-a40b-db05f39172e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:57.662437 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97612fdb-72da-4794-a40b-db05f39172e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:57.663115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97612fdb-72da-4794-a40b-db05f39172e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:57.665076 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97612fdb-72da-4794-a40b-db05f39172e9 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:57.708690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1109/2217] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:57 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:57.713715 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d5f76-4b8d-49d7-b423-eff99ef6ca8e None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:57.730654 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d5f76-4b8d-49d7-b423-eff99ef6ca8e None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:57.849791 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2888f3-5e3b-47ce-8c6c-fc7019772140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:57.850721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2888f3-5e3b-47ce-8c6c-fc7019772140 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:57.851198 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2888f3-5e3b-47ce-8c6c-fc7019772140 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:57.851632 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2888f3-5e3b-47ce-8c6c-fc7019772140 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:57.852718 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2888f3-5e3b-47ce-8c6c-fc7019772140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:57.856360 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2888f3-5e3b-47ce-8c6c-fc7019772140 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:57.903543 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1109/2218] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:57 2022] POST /identity/v3/users => generated 298 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:57.906343 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97612fdb-72da-4794-a40b-db05f39172e9 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:57.927844 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97612fdb-72da-4794-a40b-db05f39172e9 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:57.937653 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04475f08-4a2d-4152-99b6-64a82d27c39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:57.939559 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04475f08-4a2d-4152-99b6-64a82d27c39c admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:57.943783 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04475f08-4a2d-4152-99b6-64a82d27c39c admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:57.946914 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04475f08-4a2d-4152-99b6-64a82d27c39c admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:57.949974 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04475f08-4a2d-4152-99b6-64a82d27c39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:57.954376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04475f08-4a2d-4152-99b6-64a82d27c39c admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:57.980130 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1110/2219] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:57.984731 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2888f3-5e3b-47ce-8c6c-fc7019772140 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:57.992745 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:58.000192 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2888f3-5e3b-47ce-8c6c-fc7019772140 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:58.017305 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dddf85-1091-4263-afbe-1a556aa30484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:58.018555 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dddf85-1091-4263-afbe-1a556aa30484 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:58.019254 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dddf85-1091-4263-afbe-1a556aa30484 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:58.019711 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dddf85-1091-4263-afbe-1a556aa30484 admin admin] PATH_INFO: `/v3/projects/243dc41723384b8db2fcd9079c924cd6/users/a235a4a09ba64722b1f8c25101aee3d3/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:58.074851 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dddf85-1091-4263-afbe-1a556aa30484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=243dc41723384b8db2fcd9079c924cd6, user_id=a235a4a09ba64722b1f8c25101aee3d3, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:58.079921 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dddf85-1091-4263-afbe-1a556aa30484 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:58.087252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04475f08-4a2d-4152-99b6-64a82d27c39c admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:58.089974 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-04475f08-4a2d-4152-99b6-64a82d27c39c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:58.113055 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1110/2220] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:57 2022] PUT /identity/v3/projects/243dc41723384b8db2fcd9079c924cd6/users/a235a4a09ba64722b1f8c25101aee3d3/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:58.114045 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04475f08-4a2d-4152-99b6-64a82d27c39c admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:58.117123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dddf85-1091-4263-afbe-1a556aa30484 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:58.209555 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dddf85-1091-4263-afbe-1a556aa30484 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:58.220339 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b209c-d2d2-4c76-9e7c-12590b2f2f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:58.221764 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b209c-d2d2-4c76-9e7c-12590b2f2f79 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:58.222361 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b209c-d2d2-4c76-9e7c-12590b2f2f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:58.222940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b209c-d2d2-4c76-9e7c-12590b2f2f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:58.224279 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b209c-d2d2-4c76-9e7c-12590b2f2f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:58.228105 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b209c-d2d2-4c76-9e7c-12590b2f2f79 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:58.250032 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de073ae2-37f8-483c-b038-db78d6fd52af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:58.251125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de073ae2-37f8-483c-b038-db78d6fd52af admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:58.251654 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1111/2221] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:58.252066 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de073ae2-37f8-483c-b038-db78d6fd52af admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:58.252546 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de073ae2-37f8-483c-b038-db78d6fd52af admin admin] PATH_INFO: `/v3/users/da0f8f359e304475b65941ed18bddff7` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:58.255263 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de073ae2-37f8-483c-b038-db78d6fd52af admin admin] RBAC: Authorizing `identity:delete_user(user_id=da0f8f359e304475b65941ed18bddff7)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:58.258953 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b209c-d2d2-4c76-9e7c-12590b2f2f79 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:58.259263 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de073ae2-37f8-483c-b038-db78d6fd52af admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:58.283127 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b209c-d2d2-4c76-9e7c-12590b2f2f79 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:58.293622 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680cc31-1b96-4126-82e9-bcd4b5c93377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:58.294771 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680cc31-1b96-4126-82e9-bcd4b5c93377 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:58.295288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680cc31-1b96-4126-82e9-bcd4b5c93377 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:58.295805 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680cc31-1b96-4126-82e9-bcd4b5c93377 admin admin] PATH_INFO: `/v3/projects/243dc41723384b8db2fcd9079c924cd6/users/a235a4a09ba64722b1f8c25101aee3d3/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:58.299702 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680cc31-1b96-4126-82e9-bcd4b5c93377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=243dc41723384b8db2fcd9079c924cd6, user_id=a235a4a09ba64722b1f8c25101aee3d3, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:58.303735 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680cc31-1b96-4126-82e9-bcd4b5c93377 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:58.328222 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1112/2222] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:58 2022] PUT /identity/v3/projects/243dc41723384b8db2fcd9079c924cd6/users/a235a4a09ba64722b1f8c25101aee3d3/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:58.351981 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acfaac-8378-4d7c-ba36-7211d35ec1fa None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:58.352402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acfaac-8378-4d7c-ba36-7211d35ec1fa None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:58.353037 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acfaac-8378-4d7c-ba36-7211d35ec1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:58.356929 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-de073ae2-37f8-483c-b038-db78d6fd52af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da0f8f359e304475b65941ed18bddff7'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:58.358041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-de073ae2-37f8-483c-b038-db78d6fd52af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da0f8f359e304475b65941ed18bddff7'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:58.377529 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-de073ae2-37f8-483c-b038-db78d6fd52af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da0f8f359e304475b65941ed18bddff7'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:58.404848 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-75acfaac-8378-4d7c-ba36-7211d35ec1fa None None] MFA Rules not processed for user `a235a4a09ba64722b1f8c25101aee3d3`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:58.406733 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-75acfaac-8378-4d7c-ba36-7211d35ec1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:58.410496 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-de073ae2-37f8-483c-b038-db78d6fd52af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da0f8f359e304475b65941ed18bddff7'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:58.426642 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-de073ae2-37f8-483c-b038-db78d6fd52af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da0f8f359e304475b65941ed18bddff7'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:58.439803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1111/2223] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:58 2022] DELETE /identity/v3/users/da0f8f359e304475b65941ed18bddff7 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:58.446489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae530e9-e2ed-44c9-901b-0b705c0ce7e4 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:58.446966 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae530e9-e2ed-44c9-901b-0b705c0ce7e4 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:58.447870 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae530e9-e2ed-44c9-901b-0b705c0ce7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:58.508835 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-fae530e9-e2ed-44c9-901b-0b705c0ce7e4 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:58.511438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-fae530e9-e2ed-44c9-901b-0b705c0ce7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:58.545261 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1113/2224] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:58.548467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:58.562401 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75acfaac-8378-4d7c-ba36-7211d35ec1fa None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:58.565824 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-75acfaac-8378-4d7c-ba36-7211d35ec1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:58.681591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1112/2225] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:58.700923 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae530e9-e2ed-44c9-901b-0b705c0ce7e4 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:58.704904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-fae530e9-e2ed-44c9-901b-0b705c0ce7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:58.731693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:58.740200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75acfaac-8378-4d7c-ba36-7211d35ec1fa None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:58.818309 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae530e9-e2ed-44c9-901b-0b705c0ce7e4 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:58.827943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90a134-536f-4b66-ab0b-fcace5c0c291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:58.829258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90a134-536f-4b66-ab0b-fcace5c0c291 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:58.829801 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90a134-536f-4b66-ab0b-fcace5c0c291 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:58.830287 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90a134-536f-4b66-ab0b-fcace5c0c291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:58.833261 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2d403-9445-4da4-9eb7-7008c2de878f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:58.834458 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2d403-9445-4da4-9eb7-7008c2de878f service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:58.834906 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2d403-9445-4da4-9eb7-7008c2de878f service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:58.835352 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2d403-9445-4da4-9eb7-7008c2de878f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:58.849604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90a134-536f-4b66-ab0b-fcace5c0c291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:58.852553 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90a134-536f-4b66-ab0b-fcace5c0c291 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:58.874414 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1113/2226] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:58.936159 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2d403-9445-4da4-9eb7-7008c2de878f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:58.937726 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2d403-9445-4da4-9eb7-7008c2de878f service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:58.957397 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1114/2227] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:59.169227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90a134-536f-4b66-ab0b-fcace5c0c291 service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:59.190831 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90a134-536f-4b66-ab0b-fcace5c0c291 service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:59.198874 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8b24e-49a1-449c-a0aa-064e513f5e55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:59.199767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8b24e-49a1-449c-a0aa-064e513f5e55 service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:59.200335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8b24e-49a1-449c-a0aa-064e513f5e55 service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:59.201668 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8b24e-49a1-449c-a0aa-064e513f5e55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:59.204258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-daa8b24e-49a1-449c-a0aa-064e513f5e55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:59.321651 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8b24e-49a1-449c-a0aa-064e513f5e55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:59.321651 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8b24e-49a1-449c-a0aa-064e513f5e55 service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:59.341001 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1114/2228] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:59.380443 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2d403-9445-4da4-9eb7-7008c2de878f service cinder] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:59.382580 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-0ca2d403-9445-4da4-9eb7-7008c2de878f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:59.407737 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2d403-9445-4da4-9eb7-7008c2de878f service cinder] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:59.415744 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82d3f2-09f2-4ede-89cd-1c83b7743846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:59.417459 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82d3f2-09f2-4ede-89cd-1c83b7743846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:59.418053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82d3f2-09f2-4ede-89cd-1c83b7743846 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:59.418513 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82d3f2-09f2-4ede-89cd-1c83b7743846 admin admin] PATH_INFO: `/v3/projects/83649b9ce63a46739c04d68768b14ae4` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:59.420700 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82d3f2-09f2-4ede-89cd-1c83b7743846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83649b9ce63a46739c04d68768b14ae4)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:59.425682 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82d3f2-09f2-4ede-89cd-1c83b7743846 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:59.502215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-bf82d3f2-09f2-4ede-89cd-1c83b7743846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83649b9ce63a46739c04d68768b14ae4', 'request_id': 'req-bf82d3f2-09f2-4ede-89cd-1c83b7743846'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:59.518182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-bf82d3f2-09f2-4ede-89cd-1c83b7743846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83649b9ce63a46739c04d68768b14ae4', 'request_id': 'req-bf82d3f2-09f2-4ede-89cd-1c83b7743846'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:59.532465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-bf82d3f2-09f2-4ede-89cd-1c83b7743846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83649b9ce63a46739c04d68768b14ae4', 'request_id': 'req-bf82d3f2-09f2-4ede-89cd-1c83b7743846'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:59.556096 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-bf82d3f2-09f2-4ede-89cd-1c83b7743846 admin admin] The token cache is being invalidate because project 83649b9ce63a46739c04d68768b14ae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:59.556683 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-bf82d3f2-09f2-4ede-89cd-1c83b7743846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:59.558422 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-bf82d3f2-09f2-4ede-89cd-1c83b7743846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:59.561395 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1115/2229] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:59 2022] DELETE /identity/v3/projects/83649b9ce63a46739c04d68768b14ae4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:59.568654 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8b24e-49a1-449c-a0aa-064e513f5e55 service cinder] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:59.591981 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8b24e-49a1-449c-a0aa-064e513f5e55 service cinder] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:59.712092 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0285400-6178-4735-8210-ce626f999d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:59.712849 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0285400-6178-4735-8210-ce626f999d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:59.713175 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0285400-6178-4735-8210-ce626f999d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:59.713715 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0285400-6178-4735-8210-ce626f999d60 admin admin] PATH_INFO: `/v3/users/3c7c418414b94b67aa82ae15c1b06a3c` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:59.719329 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0285400-6178-4735-8210-ce626f999d60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c7c418414b94b67aa82ae15c1b06a3c)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:59.723652 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0285400-6178-4735-8210-ce626f999d60 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:59.734399 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:59.834725 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-b0285400-6178-4735-8210-ce626f999d60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c7c418414b94b67aa82ae15c1b06a3c'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:59.836280 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-b0285400-6178-4735-8210-ce626f999d60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c7c418414b94b67aa82ae15c1b06a3c'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:59.851777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-b0285400-6178-4735-8210-ce626f999d60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c7c418414b94b67aa82ae15c1b06a3c'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:59.883534 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-b0285400-6178-4735-8210-ce626f999d60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c7c418414b94b67aa82ae15c1b06a3c'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:59.898479 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-b0285400-6178-4735-8210-ce626f999d60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c7c418414b94b67aa82ae15c1b06a3c'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:59.918361 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1115/2230] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:59 2022] DELETE /identity/v3/users/3c7c418414b94b67aa82ae15c1b06a3c => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:00.496770 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82d3f2-09f2-4ede-89cd-1c83b7743846 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:00.498593 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-bf82d3f2-09f2-4ede-89cd-1c83b7743846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:00.515348 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82d3f2-09f2-4ede-89cd-1c83b7743846 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:00.592351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:00.633719 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a933e7-833b-4d7e-83cb-7cdb2bad8ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:00.634414 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a933e7-833b-4d7e-83cb-7cdb2bad8ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:00.635299 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a933e7-833b-4d7e-83cb-7cdb2bad8ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:00.636210 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a933e7-833b-4d7e-83cb-7cdb2bad8ffb admin admin] PATH_INFO: `/v3/projects/0361648c07db42e6a0762dbe18380b3a` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:00.637216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a933e7-833b-4d7e-83cb-7cdb2bad8ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0361648c07db42e6a0762dbe18380b3a)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:00.639246 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a933e7-833b-4d7e-83cb-7cdb2bad8ffb admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:00.709536 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-14a933e7-833b-4d7e-83cb-7cdb2bad8ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0361648c07db42e6a0762dbe18380b3a', 'request_id': 'req-14a933e7-833b-4d7e-83cb-7cdb2bad8ffb'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:00.726472 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-14a933e7-833b-4d7e-83cb-7cdb2bad8ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0361648c07db42e6a0762dbe18380b3a', 'request_id': 'req-14a933e7-833b-4d7e-83cb-7cdb2bad8ffb'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:00.752234 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-14a933e7-833b-4d7e-83cb-7cdb2bad8ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0361648c07db42e6a0762dbe18380b3a', 'request_id': 'req-14a933e7-833b-4d7e-83cb-7cdb2bad8ffb'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:00.772304 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-14a933e7-833b-4d7e-83cb-7cdb2bad8ffb admin admin] The token cache is being invalidate because project 0361648c07db42e6a0762dbe18380b3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:52:00.772785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-14a933e7-833b-4d7e-83cb-7cdb2bad8ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:00.773821 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-14a933e7-833b-4d7e-83cb-7cdb2bad8ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:00.776974 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1116/2231] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:52:00 2022] DELETE /identity/v3/projects/0361648c07db42e6a0762dbe18380b3a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:52:00.786271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a5e8b-005d-446e-bae2-0be343bb51ca None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:00.787119 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a5e8b-005d-446e-bae2-0be343bb51ca None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:00.787269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a5e8b-005d-446e-bae2-0be343bb51ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:00.820139 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-f45a5e8b-005d-446e-bae2-0be343bb51ca None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:00.822541 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-f45a5e8b-005d-446e-bae2-0be343bb51ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:00.909435 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1116/2232] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:00.918768 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc7109-15c1-40a2-8685-fdd57e85d093 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:00.919204 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc7109-15c1-40a2-8685-fdd57e85d093 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:00.919590 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc7109-15c1-40a2-8685-fdd57e85d093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:00.943169 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-eecc7109-15c1-40a2-8685-fdd57e85d093 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:00.944584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-eecc7109-15c1-40a2-8685-fdd57e85d093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:00.954353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1117/2233] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:52:00.959292 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a5e8b-005d-446e-bae2-0be343bb51ca None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:00.972902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a5e8b-005d-446e-bae2-0be343bb51ca None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:00.981026 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58510e-c4ab-45dd-81b3-b28a422bc0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:00.982214 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58510e-c4ab-45dd-81b3-b28a422bc0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:00.982726 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58510e-c4ab-45dd-81b3-b28a422bc0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:00.983231 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58510e-c4ab-45dd-81b3-b28a422bc0d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:00.984487 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58510e-c4ab-45dd-81b3-b28a422bc0d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:52:00.985051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58510e-c4ab-45dd-81b3-b28a422bc0d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:00.988430 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58510e-c4ab-45dd-81b3-b28a422bc0d4 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:01.019527 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc7109-15c1-40a2-8685-fdd57e85d093 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:01.021923 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1117/2234] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:52:01.034201 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc7109-15c1-40a2-8685-fdd57e85d093 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:01.042082 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af68503-15fa-480c-baf4-ef2c82ec94de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:01.042718 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af68503-15fa-480c-baf4-ef2c82ec94de admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:01.042993 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af68503-15fa-480c-baf4-ef2c82ec94de admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:01.043295 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af68503-15fa-480c-baf4-ef2c82ec94de admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:01.043965 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af68503-15fa-480c-baf4-ef2c82ec94de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:01.047646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af68503-15fa-480c-baf4-ef2c82ec94de admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:01.109667 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1118/2235] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:52:01 2022] POST /identity/v3/projects => generated 361 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:52:01.117968 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58510e-c4ab-45dd-81b3-b28a422bc0d4 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:01.139993 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58510e-c4ab-45dd-81b3-b28a422bc0d4 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:01.301648 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3219070-1aa0-46e2-9706-c77cdaa12430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:01.302339 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3219070-1aa0-46e2-9706-c77cdaa12430 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:01.302617 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3219070-1aa0-46e2-9706-c77cdaa12430 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:01.303169 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3219070-1aa0-46e2-9706-c77cdaa12430 admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:01.304040 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3219070-1aa0-46e2-9706-c77cdaa12430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:01.306098 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3219070-1aa0-46e2-9706-c77cdaa12430 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:01.332608 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:01.342869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1118/2236] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:52:01 2022] POST /identity/v3/users => generated 281 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:52:01.348665 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af68503-15fa-480c-baf4-ef2c82ec94de admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:01.363113 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af68503-15fa-480c-baf4-ef2c82ec94de admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:01.369856 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd3664-a7bc-48a9-9ed3-258ec71fec5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:01.370578 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd3664-a7bc-48a9-9ed3-258ec71fec5e admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:01.370860 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd3664-a7bc-48a9-9ed3-258ec71fec5e admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:01.371133 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd3664-a7bc-48a9-9ed3-258ec71fec5e admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:01.371790 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd3664-a7bc-48a9-9ed3-258ec71fec5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:01.373959 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd3664-a7bc-48a9-9ed3-258ec71fec5e admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:01.388576 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1119/2237] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:52:01.394638 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3219070-1aa0-46e2-9706-c77cdaa12430 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:01.419318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3219070-1aa0-46e2-9706-c77cdaa12430 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:01.427064 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cd9e8-7f52-4d26-9d29-12bda33ebceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:01.428120 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cd9e8-7f52-4d26-9d29-12bda33ebceb admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:01.428629 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cd9e8-7f52-4d26-9d29-12bda33ebceb admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:01.429131 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cd9e8-7f52-4d26-9d29-12bda33ebceb admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:01.430494 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297cd9e8-7f52-4d26-9d29-12bda33ebceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:01.433519 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297cd9e8-7f52-4d26-9d29-12bda33ebceb admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:01.453271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1119/2238] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:52:01.458554 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd3664-a7bc-48a9-9ed3-258ec71fec5e admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:01.473998 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd3664-a7bc-48a9-9ed3-258ec71fec5e admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:01.481370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25670e4-35de-45a7-a5e1-dba162bfb17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:01.482526 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25670e4-35de-45a7-a5e1-dba162bfb17e admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:01.482777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25670e4-35de-45a7-a5e1-dba162bfb17e admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:01.483207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25670e4-35de-45a7-a5e1-dba162bfb17e admin admin] PATH_INFO: `/v3/projects/83cc8952a4a5438f9829f67877ee5a9e/users/3900c1834dec41b0848ab076d1957ece/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:01.506260 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25670e4-35de-45a7-a5e1-dba162bfb17e admin admin] RBAC: Authorizing `identity:create_grant(project_id=83cc8952a4a5438f9829f67877ee5a9e, user_id=3900c1834dec41b0848ab076d1957ece, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:01.511886 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25670e4-35de-45a7-a5e1-dba162bfb17e admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:01.535694 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1120/2239] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:52:01 2022] PUT /identity/v3/projects/83cc8952a4a5438f9829f67877ee5a9e/users/3900c1834dec41b0848ab076d1957ece/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:52:01.556289 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570fee0-0eb0-4e48-a11f-d713a2f6ecac None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:01.557237 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570fee0-0eb0-4e48-a11f-d713a2f6ecac None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:01.557747 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570fee0-0eb0-4e48-a11f-d713a2f6ecac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:01.607923 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-d570fee0-0eb0-4e48-a11f-d713a2f6ecac None None] MFA Rules not processed for user `3900c1834dec41b0848ab076d1957ece`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:01.610049 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-d570fee0-0eb0-4e48-a11f-d713a2f6ecac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:01.726942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1120/2240] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:01.732943 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25670e4-35de-45a7-a5e1-dba162bfb17e admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:01.883061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25670e4-35de-45a7-a5e1-dba162bfb17e admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:01.899292 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac9e83-2588-439d-b1a6-c5c20c93a7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:01.900840 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac9e83-2588-439d-b1a6-c5c20c93a7dd admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:01.901296 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac9e83-2588-439d-b1a6-c5c20c93a7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:01.902158 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac9e83-2588-439d-b1a6-c5c20c93a7dd admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:01.903792 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac9e83-2588-439d-b1a6-c5c20c93a7dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:01.907887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac9e83-2588-439d-b1a6-c5c20c93a7dd admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:01.927693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:01.958029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1121/2241] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:52:01 2022] POST /identity/v3/projects => generated 365 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:52:01.963434 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570fee0-0eb0-4e48-a11f-d713a2f6ecac None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:01.982781 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570fee0-0eb0-4e48-a11f-d713a2f6ecac None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:02.071031 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd776c47-97d0-42f4-856b-fa004a24356f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:02.072828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd776c47-97d0-42f4-856b-fa004a24356f admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:02.073109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd776c47-97d0-42f4-856b-fa004a24356f admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:02.073369 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd776c47-97d0-42f4-856b-fa004a24356f admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:02.074398 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd776c47-97d0-42f4-856b-fa004a24356f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:02.076626 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd776c47-97d0-42f4-856b-fa004a24356f admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:02.124092 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1121/2242] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:52:01 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:52:02.128687 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac9e83-2588-439d-b1a6-c5c20c93a7dd admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:02.140867 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac9e83-2588-439d-b1a6-c5c20c93a7dd admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:02.146220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47790ded-4156-4a01-997f-4438ab2301ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:02.146842 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47790ded-4156-4a01-997f-4438ab2301ec admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:02.147126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47790ded-4156-4a01-997f-4438ab2301ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:02.147401 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47790ded-4156-4a01-997f-4438ab2301ec admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:02.148055 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47790ded-4156-4a01-997f-4438ab2301ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:02.150177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47790ded-4156-4a01-997f-4438ab2301ec admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:02.161384 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1122/2243] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:52:02.166311 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd776c47-97d0-42f4-856b-fa004a24356f admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:02.178351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd776c47-97d0-42f4-856b-fa004a24356f admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:02.184220 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144673f1-3025-4db0-b360-5c2c4d00a985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:02.184903 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144673f1-3025-4db0-b360-5c2c4d00a985 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:02.185184 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144673f1-3025-4db0-b360-5c2c4d00a985 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:02.185499 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144673f1-3025-4db0-b360-5c2c4d00a985 admin admin] PATH_INFO: `/v3/projects/c04be41ffbd54e468f6a9049e30e11a2/users/2200ad4e48f94367aa6013876bba7ac9/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:02.205466 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144673f1-3025-4db0-b360-5c2c4d00a985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c04be41ffbd54e468f6a9049e30e11a2, user_id=2200ad4e48f94367aa6013876bba7ac9, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:02.208127 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144673f1-3025-4db0-b360-5c2c4d00a985 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:02.224638 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1122/2244] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:52:02 2022] PUT /identity/v3/projects/c04be41ffbd54e468f6a9049e30e11a2/users/2200ad4e48f94367aa6013876bba7ac9/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:02.229046 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47790ded-4156-4a01-997f-4438ab2301ec admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:02.240088 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47790ded-4156-4a01-997f-4438ab2301ec admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:02.311030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c6f2e-75d4-45b4-ac92-69209a5d835b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:02.311655 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c6f2e-75d4-45b4-ac92-69209a5d835b admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:02.311946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c6f2e-75d4-45b4-ac92-69209a5d835b admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:02.312224 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c6f2e-75d4-45b4-ac92-69209a5d835b admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:02.312881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c6f2e-75d4-45b4-ac92-69209a5d835b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:02.315673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c6f2e-75d4-45b4-ac92-69209a5d835b admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:02.337637 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1123/2245] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:52:02.338971 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144673f1-3025-4db0-b360-5c2c4d00a985 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:02.350245 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144673f1-3025-4db0-b360-5c2c4d00a985 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:02.355684 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257b7c2-b72e-4985-9f85-948c4abc0122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:02.356367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257b7c2-b72e-4985-9f85-948c4abc0122 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:02.356703 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257b7c2-b72e-4985-9f85-948c4abc0122 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:02.356979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257b7c2-b72e-4985-9f85-948c4abc0122 admin admin] PATH_INFO: `/v3/projects/c04be41ffbd54e468f6a9049e30e11a2/users/2200ad4e48f94367aa6013876bba7ac9/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:02.359050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257b7c2-b72e-4985-9f85-948c4abc0122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c04be41ffbd54e468f6a9049e30e11a2, user_id=2200ad4e48f94367aa6013876bba7ac9, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:02.361807 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257b7c2-b72e-4985-9f85-948c4abc0122 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:02.375195 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1123/2246] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:52:02 2022] PUT /identity/v3/projects/c04be41ffbd54e468f6a9049e30e11a2/users/2200ad4e48f94367aa6013876bba7ac9/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:52:02.386659 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc8aa8-11d5-473e-8c06-25900c381f61 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:02.386954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc8aa8-11d5-473e-8c06-25900c381f61 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:02.387233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc8aa8-11d5-473e-8c06-25900c381f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:02.421370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-78fc8aa8-11d5-473e-8c06-25900c381f61 None None] MFA Rules not processed for user `2200ad4e48f94367aa6013876bba7ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:02.422603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-78fc8aa8-11d5-473e-8c06-25900c381f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:02.471877 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257b7c2-b72e-4985-9f85-948c4abc0122 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:02.474383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-f257b7c2-b72e-4985-9f85-948c4abc0122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:02.533989 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:02.554654 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1124/2247] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:02.574944 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc8aa8-11d5-473e-8c06-25900c381f61 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:02.578072 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-78fc8aa8-11d5-473e-8c06-25900c381f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:02.597765 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257b7c2-b72e-4985-9f85-948c4abc0122 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:02.603334 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e6987-5138-464c-ab71-66ebf73b7e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:02.603993 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e6987-5138-464c-ab71-66ebf73b7e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:02.604290 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e6987-5138-464c-ab71-66ebf73b7e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:02.604621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e6987-5138-464c-ab71-66ebf73b7e7a admin admin] PATH_INFO: `/v3/users/cf0ee9e2232e48a991277f65335382cf` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:02.605892 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e6987-5138-464c-ab71-66ebf73b7e7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf0ee9e2232e48a991277f65335382cf)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:02.608344 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e6987-5138-464c-ab71-66ebf73b7e7a admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:02.671321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc8aa8-11d5-473e-8c06-25900c381f61 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:02.675657 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93085e32-30ed-43da-8e6a-aa3149c89223 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:02.676444 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93085e32-30ed-43da-8e6a-aa3149c89223 service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:02.676826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93085e32-30ed-43da-8e6a-aa3149c89223 service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:02.677300 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93085e32-30ed-43da-8e6a-aa3149c89223 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:02.703154 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93085e32-30ed-43da-8e6a-aa3149c89223 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:02.703548 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2d0e6987-5138-464c-ab71-66ebf73b7e7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf0ee9e2232e48a991277f65335382cf'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:02.704284 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2d0e6987-5138-464c-ab71-66ebf73b7e7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf0ee9e2232e48a991277f65335382cf'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:02.706388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93085e32-30ed-43da-8e6a-aa3149c89223 service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:02.722612 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2d0e6987-5138-464c-ab71-66ebf73b7e7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf0ee9e2232e48a991277f65335382cf'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:02.740420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2d0e6987-5138-464c-ab71-66ebf73b7e7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf0ee9e2232e48a991277f65335382cf'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:02.741756 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1125/2248] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:52:02 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:52:02.750014 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2d0e6987-5138-464c-ab71-66ebf73b7e7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf0ee9e2232e48a991277f65335382cf'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:02.762804 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1124/2249] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:52:02 2022] DELETE /identity/v3/users/cf0ee9e2232e48a991277f65335382cf => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:02.767812 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7f785-89de-47ad-ae29-217a82045d1a None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:02.768152 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7f785-89de-47ad-ae29-217a82045d1a None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:02.768408 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7f785-89de-47ad-ae29-217a82045d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:02.783942 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:02.807880 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-f5d7f785-89de-47ad-ae29-217a82045d1a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:02.809968 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-f5d7f785-89de-47ad-ae29-217a82045d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:02.889948 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e6987-5138-464c-ab71-66ebf73b7e7a admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:02.892337 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-2d0e6987-5138-464c-ab71-66ebf73b7e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:02.910949 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1126/2250] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:02.928558 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7f785-89de-47ad-ae29-217a82045d1a None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:02.930123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-f5d7f785-89de-47ad-ae29-217a82045d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:03.034183 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7f785-89de-47ad-ae29-217a82045d1a None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:03.038885 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabf04d-009e-415d-acc0-ceda2825c3a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:03.039655 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabf04d-009e-415d-acc0-ceda2825c3a1 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:03.040016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabf04d-009e-415d-acc0-ceda2825c3a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:03.040379 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabf04d-009e-415d-acc0-ceda2825c3a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:03.043042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e6987-5138-464c-ab71-66ebf73b7e7a admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:03.050576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4db21-f734-4c2f-b6e8-ea03d4510b39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:03.051584 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4db21-f734-4c2f-b6e8-ea03d4510b39 service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:03.052025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4db21-f734-4c2f-b6e8-ea03d4510b39 service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:03.052508 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4db21-f734-4c2f-b6e8-ea03d4510b39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:03.053733 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eabf04d-009e-415d-acc0-ceda2825c3a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:03.055299 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eabf04d-009e-415d-acc0-ceda2825c3a1 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:03.055438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-7ad4db21-f734-4c2f-b6e8-ea03d4510b39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:03.078105 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1127/2251] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:52:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:52:03.165455 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4db21-f734-4c2f-b6e8-ea03d4510b39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:03.168282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4db21-f734-4c2f-b6e8-ea03d4510b39 service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:03.180481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1125/2252] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:52:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:52:03.543218 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabf04d-009e-415d-acc0-ceda2825c3a1 service neutron] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:03.546170 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-8eabf04d-009e-415d-acc0-ceda2825c3a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:03.569564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabf04d-009e-415d-acc0-ceda2825c3a1 service neutron] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:03.575881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a29c8-830b-4ea6-be96-618fa25b99c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:03.576649 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a29c8-830b-4ea6-be96-618fa25b99c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:03.576943 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a29c8-830b-4ea6-be96-618fa25b99c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:03.577248 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a29c8-830b-4ea6-be96-618fa25b99c7 admin admin] PATH_INFO: `/v3/projects/45307d81da464b6ab2285b70d6fb2b09` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:03.578985 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a29c8-830b-4ea6-be96-618fa25b99c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45307d81da464b6ab2285b70d6fb2b09)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:03.581969 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a29c8-830b-4ea6-be96-618fa25b99c7 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:03.658425 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6a4a29c8-830b-4ea6-be96-618fa25b99c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45307d81da464b6ab2285b70d6fb2b09', 'request_id': 'req-6a4a29c8-830b-4ea6-be96-618fa25b99c7'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:03.667759 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6a4a29c8-830b-4ea6-be96-618fa25b99c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45307d81da464b6ab2285b70d6fb2b09', 'request_id': 'req-6a4a29c8-830b-4ea6-be96-618fa25b99c7'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:03.677594 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6a4a29c8-830b-4ea6-be96-618fa25b99c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45307d81da464b6ab2285b70d6fb2b09', 'request_id': 'req-6a4a29c8-830b-4ea6-be96-618fa25b99c7'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:03.693904 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6a4a29c8-830b-4ea6-be96-618fa25b99c7 admin admin] The token cache is being invalidate because project 45307d81da464b6ab2285b70d6fb2b09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:52:03.694257 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6a4a29c8-830b-4ea6-be96-618fa25b99c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:03.695549 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6a4a29c8-830b-4ea6-be96-618fa25b99c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:03.698752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1128/2253] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:52:03 2022] DELETE /identity/v3/projects/45307d81da464b6ab2285b70d6fb2b09 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:03.703073 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4db21-f734-4c2f-b6e8-ea03d4510b39 service cinder] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:03.710356 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:03.715132 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4db21-f734-4c2f-b6e8-ea03d4510b39 service cinder] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:03.782760 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf9e47-5b87-4b3a-93a5-9a41ffdf2fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:03.783417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf9e47-5b87-4b3a-93a5-9a41ffdf2fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:03.783698 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf9e47-5b87-4b3a-93a5-9a41ffdf2fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:03.783999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf9e47-5b87-4b3a-93a5-9a41ffdf2fd2 admin admin] PATH_INFO: `/v3/users/a235a4a09ba64722b1f8c25101aee3d3` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:03.785224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf9e47-5b87-4b3a-93a5-9a41ffdf2fd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a235a4a09ba64722b1f8c25101aee3d3)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:03.787216 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf9e47-5b87-4b3a-93a5-9a41ffdf2fd2 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:03.860191 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-5edf9e47-5b87-4b3a-93a5-9a41ffdf2fd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a235a4a09ba64722b1f8c25101aee3d3'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:03.871852 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-5edf9e47-5b87-4b3a-93a5-9a41ffdf2fd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a235a4a09ba64722b1f8c25101aee3d3'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:03.895071 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-5edf9e47-5b87-4b3a-93a5-9a41ffdf2fd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a235a4a09ba64722b1f8c25101aee3d3'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:03.915490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-5edf9e47-5b87-4b3a-93a5-9a41ffdf2fd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a235a4a09ba64722b1f8c25101aee3d3'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:03.926034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-5edf9e47-5b87-4b3a-93a5-9a41ffdf2fd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a235a4a09ba64722b1f8c25101aee3d3'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:03.938606 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1126/2254] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:52:03 2022] DELETE /identity/v3/users/a235a4a09ba64722b1f8c25101aee3d3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:04.382048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a29c8-830b-4ea6-be96-618fa25b99c7 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:04.384191 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-6a4a29c8-830b-4ea6-be96-618fa25b99c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:04.418810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a29c8-830b-4ea6-be96-618fa25b99c7 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:04.492592 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:04.566473 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb4673-1c51-455f-845b-f0bdd3e4cc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:04.567545 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb4673-1c51-455f-845b-f0bdd3e4cc3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:04.568260 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb4673-1c51-455f-845b-f0bdd3e4cc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:04.568757 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb4673-1c51-455f-845b-f0bdd3e4cc3f admin admin] PATH_INFO: `/v3/projects/243dc41723384b8db2fcd9079c924cd6` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:04.571245 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb4673-1c51-455f-845b-f0bdd3e4cc3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=243dc41723384b8db2fcd9079c924cd6)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:04.575861 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb4673-1c51-455f-845b-f0bdd3e4cc3f admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:04.664519 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-37eb4673-1c51-455f-845b-f0bdd3e4cc3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '243dc41723384b8db2fcd9079c924cd6', 'request_id': 'req-37eb4673-1c51-455f-845b-f0bdd3e4cc3f'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:04.673483 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-37eb4673-1c51-455f-845b-f0bdd3e4cc3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '243dc41723384b8db2fcd9079c924cd6', 'request_id': 'req-37eb4673-1c51-455f-845b-f0bdd3e4cc3f'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:04.685059 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-37eb4673-1c51-455f-845b-f0bdd3e4cc3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '243dc41723384b8db2fcd9079c924cd6', 'request_id': 'req-37eb4673-1c51-455f-845b-f0bdd3e4cc3f'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:04.736681 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-37eb4673-1c51-455f-845b-f0bdd3e4cc3f admin admin] The token cache is being invalidate because project 243dc41723384b8db2fcd9079c924cd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:52:04.736681 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-37eb4673-1c51-455f-845b-f0bdd3e4cc3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:04.737808 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-37eb4673-1c51-455f-845b-f0bdd3e4cc3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:04.741693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1129/2255] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:52:04 2022] DELETE /identity/v3/projects/243dc41723384b8db2fcd9079c924cd6 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:04.751005 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb313cd-db06-452e-b069-09dc2d75c896 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:04.751556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb313cd-db06-452e-b069-09dc2d75c896 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:04.752348 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb313cd-db06-452e-b069-09dc2d75c896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:04.790653 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-bfb313cd-db06-452e-b069-09dc2d75c896 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:04.792766 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-bfb313cd-db06-452e-b069-09dc2d75c896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:04.891997 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1127/2256] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:04.904864 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e62fc6-abc0-4fc1-a868-10ac445c9c12 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:04.905209 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e62fc6-abc0-4fc1-a868-10ac445c9c12 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:04.905533 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e62fc6-abc0-4fc1-a868-10ac445c9c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:04.928131 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-21e62fc6-abc0-4fc1-a868-10ac445c9c12 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:04.929472 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-21e62fc6-abc0-4fc1-a868-10ac445c9c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:04.947705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1130/2257] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:52:04.953659 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb313cd-db06-452e-b069-09dc2d75c896 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:04.968385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb313cd-db06-452e-b069-09dc2d75c896 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:04.974596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3a21d-1d06-47fb-bda2-a340d251739e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:04.974919 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3a21d-1d06-47fb-bda2-a340d251739e admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:04.975329 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3a21d-1d06-47fb-bda2-a340d251739e admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:04.976318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3a21d-1d06-47fb-bda2-a340d251739e admin admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:04.977098 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3a21d-1d06-47fb-bda2-a340d251739e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:52:04.977456 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3a21d-1d06-47fb-bda2-a340d251739e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:04.980732 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3a21d-1d06-47fb-bda2-a340d251739e admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:04.996849 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1128/2258] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:52:05.001970 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e62fc6-abc0-4fc1-a868-10ac445c9c12 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:05.015071 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e62fc6-abc0-4fc1-a868-10ac445c9c12 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:05.032827 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a08662-17c8-42fd-acc8-bbeef022f599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:05.034134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a08662-17c8-42fd-acc8-bbeef022f599 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:05.034612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a08662-17c8-42fd-acc8-bbeef022f599 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:05.035101 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a08662-17c8-42fd-acc8-bbeef022f599 admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:05.036266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a08662-17c8-42fd-acc8-bbeef022f599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:05.040480 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a08662-17c8-42fd-acc8-bbeef022f599 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:05.090073 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1131/2259] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:52:05 2022] POST /identity/v3/projects => generated 381 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:52:05.095141 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3a21d-1d06-47fb-bda2-a340d251739e admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:05.108379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3a21d-1d06-47fb-bda2-a340d251739e admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:05.126252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:05.195840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e08fdf-1892-4e77-811e-8eb95e05d16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:05.196466 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e08fdf-1892-4e77-811e-8eb95e05d16b admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:05.196775 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e08fdf-1892-4e77-811e-8eb95e05d16b admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:05.197345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e08fdf-1892-4e77-811e-8eb95e05d16b admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:05.197900 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e08fdf-1892-4e77-811e-8eb95e05d16b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:05.200409 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e08fdf-1892-4e77-811e-8eb95e05d16b admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:05.235588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1129/2260] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:52:05 2022] POST /identity/v3/users => generated 291 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:52:05.237856 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a08662-17c8-42fd-acc8-bbeef022f599 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:05.256074 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a08662-17c8-42fd-acc8-bbeef022f599 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:05.263292 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07079d-52e4-48be-b655-8830998dbd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:05.264032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07079d-52e4-48be-b655-8830998dbd8d admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:05.264371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07079d-52e4-48be-b655-8830998dbd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:05.264703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07079d-52e4-48be-b655-8830998dbd8d admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:05.265467 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07079d-52e4-48be-b655-8830998dbd8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:05.267259 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07079d-52e4-48be-b655-8830998dbd8d admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:05.281636 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1132/2261] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:52:05.288907 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e08fdf-1892-4e77-811e-8eb95e05d16b admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:05.308057 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e08fdf-1892-4e77-811e-8eb95e05d16b admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:05.313727 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9803720-5c43-4454-b8d2-48f45e2e7cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:05.314360 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9803720-5c43-4454-b8d2-48f45e2e7cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:05.314643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9803720-5c43-4454-b8d2-48f45e2e7cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:05.314919 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9803720-5c43-4454-b8d2-48f45e2e7cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:05.315578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9803720-5c43-4454-b8d2-48f45e2e7cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:05.317251 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9803720-5c43-4454-b8d2-48f45e2e7cf7 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:05.330260 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1130/2262] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:52:05.335554 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07079d-52e4-48be-b655-8830998dbd8d admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:05.349868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07079d-52e4-48be-b655-8830998dbd8d admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:05.358211 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9bebf-c552-49af-8fb5-b18108544744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:05.359042 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9bebf-c552-49af-8fb5-b18108544744 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:05.359442 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9bebf-c552-49af-8fb5-b18108544744 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:05.359788 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9bebf-c552-49af-8fb5-b18108544744 admin admin] PATH_INFO: `/v3/projects/2520fd21e0674880a3b5440ca288f3c4/users/b553158de62d44f5905bccf66df714c9/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:05.390838 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9bebf-c552-49af-8fb5-b18108544744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2520fd21e0674880a3b5440ca288f3c4, user_id=b553158de62d44f5905bccf66df714c9, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:05.396368 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9bebf-c552-49af-8fb5-b18108544744 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:05.423237 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1133/2263] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:52:05 2022] PUT /identity/v3/projects/2520fd21e0674880a3b5440ca288f3c4/users/b553158de62d44f5905bccf66df714c9/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:05.430900 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0514cc-e120-4e8e-a87e-39add5ea5de8 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:05.431289 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0514cc-e120-4e8e-a87e-39add5ea5de8 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:05.431569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0514cc-e120-4e8e-a87e-39add5ea5de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:05.467794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-2c0514cc-e120-4e8e-a87e-39add5ea5de8 None None] MFA Rules not processed for user `b553158de62d44f5905bccf66df714c9`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:05.469276 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-2c0514cc-e120-4e8e-a87e-39add5ea5de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:05.587539 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1131/2264] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:05.594031 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9bebf-c552-49af-8fb5-b18108544744 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:05.679493 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:05.687282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9bebf-c552-49af-8fb5-b18108544744 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:05.698878 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1af098-dade-4c10-b2c2-40eac109fe3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:05.699909 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1af098-dade-4c10-b2c2-40eac109fe3a admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:05.700480 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1af098-dade-4c10-b2c2-40eac109fe3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:05.700897 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1af098-dade-4c10-b2c2-40eac109fe3a admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:05.701926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1af098-dade-4c10-b2c2-40eac109fe3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:05.704161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1af098-dade-4c10-b2c2-40eac109fe3a admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:05.758158 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1134/2265] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:52:05 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:52:05.759796 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0514cc-e120-4e8e-a87e-39add5ea5de8 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:05.776186 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0514cc-e120-4e8e-a87e-39add5ea5de8 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:05.878508 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33387027-ed3e-4364-a766-dacde8253516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:05.879512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33387027-ed3e-4364-a766-dacde8253516 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:05.879943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33387027-ed3e-4364-a766-dacde8253516 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:05.880550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33387027-ed3e-4364-a766-dacde8253516 admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:05.881387 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33387027-ed3e-4364-a766-dacde8253516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:05.885699 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33387027-ed3e-4364-a766-dacde8253516 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:05.918782 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1132/2266] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:52:05 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:52:05.922981 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1af098-dade-4c10-b2c2-40eac109fe3a admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:05.939318 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1af098-dade-4c10-b2c2-40eac109fe3a admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:05.945359 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68aad7-346f-4939-a32e-a5fcb6b5c2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:05.945910 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68aad7-346f-4939-a32e-a5fcb6b5c2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:05.946270 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68aad7-346f-4939-a32e-a5fcb6b5c2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:05.946548 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68aad7-346f-4939-a32e-a5fcb6b5c2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:05.947274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68aad7-346f-4939-a32e-a5fcb6b5c2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:05.948991 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68aad7-346f-4939-a32e-a5fcb6b5c2e2 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:05.963537 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1135/2267] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:52:05.968542 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33387027-ed3e-4364-a766-dacde8253516 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:05.987195 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33387027-ed3e-4364-a766-dacde8253516 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:05.993232 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41696009-3e45-45dd-bc2e-b2d01b62fe7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:05.994866 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41696009-3e45-45dd-bc2e-b2d01b62fe7a admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:05.995194 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41696009-3e45-45dd-bc2e-b2d01b62fe7a admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:05.995432 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41696009-3e45-45dd-bc2e-b2d01b62fe7a admin admin] PATH_INFO: `/v3/projects/549000aa5407484388897bf0fdbfa52b/users/d87e5c57ea9a45309a58864e80f2f808/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:06.000105 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:06.027310 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41696009-3e45-45dd-bc2e-b2d01b62fe7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=549000aa5407484388897bf0fdbfa52b, user_id=d87e5c57ea9a45309a58864e80f2f808, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:06.030299 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41696009-3e45-45dd-bc2e-b2d01b62fe7a admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:06.054027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1133/2268] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:52:05 2022] PUT /identity/v3/projects/549000aa5407484388897bf0fdbfa52b/users/d87e5c57ea9a45309a58864e80f2f808/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:06.056166 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68aad7-346f-4939-a32e-a5fcb6b5c2e2 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:06.069776 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68aad7-346f-4939-a32e-a5fcb6b5c2e2 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:06.170959 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238ccd4-8c9e-4249-871a-cd36ac8e2b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:06.171709 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238ccd4-8c9e-4249-871a-cd36ac8e2b47 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:06.172131 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238ccd4-8c9e-4249-871a-cd36ac8e2b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:06.172508 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238ccd4-8c9e-4249-871a-cd36ac8e2b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:06.173563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238ccd4-8c9e-4249-871a-cd36ac8e2b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:06.175727 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238ccd4-8c9e-4249-871a-cd36ac8e2b47 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:06.190215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1136/2269] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:52:06.196200 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41696009-3e45-45dd-bc2e-b2d01b62fe7a admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:06.222096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41696009-3e45-45dd-bc2e-b2d01b62fe7a admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:06.249199 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092ff69-b7ae-43a4-9084-7fe1edf65957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:06.250530 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092ff69-b7ae-43a4-9084-7fe1edf65957 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:06.251038 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092ff69-b7ae-43a4-9084-7fe1edf65957 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:06.251529 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092ff69-b7ae-43a4-9084-7fe1edf65957 admin admin] PATH_INFO: `/v3/projects/549000aa5407484388897bf0fdbfa52b/users/d87e5c57ea9a45309a58864e80f2f808/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:06.254462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092ff69-b7ae-43a4-9084-7fe1edf65957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=549000aa5407484388897bf0fdbfa52b, user_id=d87e5c57ea9a45309a58864e80f2f808, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:06.257201 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092ff69-b7ae-43a4-9084-7fe1edf65957 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:06.271257 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1134/2270] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:52:06 2022] PUT /identity/v3/projects/549000aa5407484388897bf0fdbfa52b/users/d87e5c57ea9a45309a58864e80f2f808/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:06.283911 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bc8e1-4376-4bf4-9908-c3df393374b4 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:06.284370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bc8e1-4376-4bf4-9908-c3df393374b4 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:06.284715 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bc8e1-4376-4bf4-9908-c3df393374b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:06.327698 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-6f1bc8e1-4376-4bf4-9908-c3df393374b4 None None] MFA Rules not processed for user `d87e5c57ea9a45309a58864e80f2f808`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:06.329064 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-6f1bc8e1-4376-4bf4-9908-c3df393374b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:06.426437 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1137/2271] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:52:06.441308 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092ff69-b7ae-43a4-9084-7fe1edf65957 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:06.443499 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-5092ff69-b7ae-43a4-9084-7fe1edf65957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:06.538022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092ff69-b7ae-43a4-9084-7fe1edf65957 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:06.545414 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f376e-3261-41af-98d8-32872360aa14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:06.546088 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f376e-3261-41af-98d8-32872360aa14 service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:06.546373 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f376e-3261-41af-98d8-32872360aa14 service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:06.546650 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f376e-3261-41af-98d8-32872360aa14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:06.558704 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f376e-3261-41af-98d8-32872360aa14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:06.560229 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f376e-3261-41af-98d8-32872360aa14 service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:06.576064 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1135/2272] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:52:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:52:06.699571 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1bc8e1-4376-4bf4-9908-c3df393374b4 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:06.712568 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1bc8e1-4376-4bf4-9908-c3df393374b4 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:06.717209 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a5b29-aeda-4e93-8888-8912e32e8595 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:06.718215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a5b29-aeda-4e93-8888-8912e32e8595 service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:06.718508 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a5b29-aeda-4e93-8888-8912e32e8595 service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:06.718788 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a5b29-aeda-4e93-8888-8912e32e8595 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:06.810102 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:06.825326 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a5b29-aeda-4e93-8888-8912e32e8595 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:06.827297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a5b29-aeda-4e93-8888-8912e32e8595 service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:06.843278 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1138/2273] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:52:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:52:07.371032 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f376e-3261-41af-98d8-32872360aa14 service cinder] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:07.484193 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f376e-3261-41af-98d8-32872360aa14 service cinder] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:07.492007 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49b703-0545-403d-95ac-eb98ed7a164d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:07.493100 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49b703-0545-403d-95ac-eb98ed7a164d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:07.495049 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49b703-0545-403d-95ac-eb98ed7a164d admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:07.495514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49b703-0545-403d-95ac-eb98ed7a164d admin admin] PATH_INFO: `/v3/users/b553158de62d44f5905bccf66df714c9` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:07.497828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d49b703-0545-403d-95ac-eb98ed7a164d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b553158de62d44f5905bccf66df714c9)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:07.501636 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d49b703-0545-403d-95ac-eb98ed7a164d admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:07.613554 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2d49b703-0545-403d-95ac-eb98ed7a164d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b553158de62d44f5905bccf66df714c9'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:07.614347 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2d49b703-0545-403d-95ac-eb98ed7a164d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b553158de62d44f5905bccf66df714c9'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:07.625809 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2d49b703-0545-403d-95ac-eb98ed7a164d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b553158de62d44f5905bccf66df714c9'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:07.657376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2d49b703-0545-403d-95ac-eb98ed7a164d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b553158de62d44f5905bccf66df714c9'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:07.669933 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:07.681609 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2d49b703-0545-403d-95ac-eb98ed7a164d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b553158de62d44f5905bccf66df714c9'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:07.698514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1136/2274] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:52:07 2022] DELETE /identity/v3/users/b553158de62d44f5905bccf66df714c9 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:07.705480 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee435e86-6432-47ab-a2a0-2aa011aac9a4 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:07.706002 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee435e86-6432-47ab-a2a0-2aa011aac9a4 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:07.706553 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee435e86-6432-47ab-a2a0-2aa011aac9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:07.753005 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-ee435e86-6432-47ab-a2a0-2aa011aac9a4 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:07.755374 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ee435e86-6432-47ab-a2a0-2aa011aac9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:07.878718 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1139/2275] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:07.897565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49b703-0545-403d-95ac-eb98ed7a164d admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:07.901556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-2d49b703-0545-403d-95ac-eb98ed7a164d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:08.012752 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49b703-0545-403d-95ac-eb98ed7a164d admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:08.017532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3eac1-8d96-4641-acd2-97ee41064e9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:08.018184 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3eac1-8d96-4641-acd2-97ee41064e9b service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:08.018480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3eac1-8d96-4641-acd2-97ee41064e9b service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:08.018758 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3eac1-8d96-4641-acd2-97ee41064e9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:08.036029 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3eac1-8d96-4641-acd2-97ee41064e9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:08.037900 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3eac1-8d96-4641-acd2-97ee41064e9b service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:08.052033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1137/2276] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:52:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:52:08.565200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee435e86-6432-47ab-a2a0-2aa011aac9a4 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:08.567477 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ee435e86-6432-47ab-a2a0-2aa011aac9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:08.584547 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee435e86-6432-47ab-a2a0-2aa011aac9a4 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:08.591650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc33c8-1c82-45c1-80b1-6a4031901d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:08.592410 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc33c8-1c82-45c1-80b1-6a4031901d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:08.592617 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc33c8-1c82-45c1-80b1-6a4031901d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:08.592899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc33c8-1c82-45c1-80b1-6a4031901d8e admin admin] PATH_INFO: `/v3/projects/2520fd21e0674880a3b5440ca288f3c4` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:08.594373 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc33c8-1c82-45c1-80b1-6a4031901d8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2520fd21e0674880a3b5440ca288f3c4)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:08.597268 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc33c8-1c82-45c1-80b1-6a4031901d8e admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:08.678776 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-9bdc33c8-1c82-45c1-80b1-6a4031901d8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2520fd21e0674880a3b5440ca288f3c4', 'request_id': 'req-9bdc33c8-1c82-45c1-80b1-6a4031901d8e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:08.697737 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-9bdc33c8-1c82-45c1-80b1-6a4031901d8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2520fd21e0674880a3b5440ca288f3c4', 'request_id': 'req-9bdc33c8-1c82-45c1-80b1-6a4031901d8e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:08.708537 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-9bdc33c8-1c82-45c1-80b1-6a4031901d8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2520fd21e0674880a3b5440ca288f3c4', 'request_id': 'req-9bdc33c8-1c82-45c1-80b1-6a4031901d8e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:08.726203 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-9bdc33c8-1c82-45c1-80b1-6a4031901d8e admin admin] The token cache is being invalidate because project 2520fd21e0674880a3b5440ca288f3c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:52:08.726653 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-9bdc33c8-1c82-45c1-80b1-6a4031901d8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:08.727526 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-9bdc33c8-1c82-45c1-80b1-6a4031901d8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:08.729961 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1140/2277] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:52:08 2022] DELETE /identity/v3/projects/2520fd21e0674880a3b5440ca288f3c4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:08.736194 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3eac1-8d96-4641-acd2-97ee41064e9b service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:08.748992 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3eac1-8d96-4641-acd2-97ee41064e9b service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:08.849961 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bdb84-9a6d-44a6-ba6c-bf6ed4e9d37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:08.850704 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bdb84-9a6d-44a6-ba6c-bf6ed4e9d37b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:08.851135 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bdb84-9a6d-44a6-ba6c-bf6ed4e9d37b admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:08.851605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bdb84-9a6d-44a6-ba6c-bf6ed4e9d37b admin admin] PATH_INFO: `/v3/users/d87e5c57ea9a45309a58864e80f2f808` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:08.855149 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18bdb84-9a6d-44a6-ba6c-bf6ed4e9d37b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d87e5c57ea9a45309a58864e80f2f808)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:08.858651 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18bdb84-9a6d-44a6-ba6c-bf6ed4e9d37b admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:08.940090 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e18bdb84-9a6d-44a6-ba6c-bf6ed4e9d37b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd87e5c57ea9a45309a58864e80f2f808'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:08.941167 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e18bdb84-9a6d-44a6-ba6c-bf6ed4e9d37b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd87e5c57ea9a45309a58864e80f2f808'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:08.957353 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e18bdb84-9a6d-44a6-ba6c-bf6ed4e9d37b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd87e5c57ea9a45309a58864e80f2f808'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:08.988069 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e18bdb84-9a6d-44a6-ba6c-bf6ed4e9d37b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd87e5c57ea9a45309a58864e80f2f808'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:09.000440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e18bdb84-9a6d-44a6-ba6c-bf6ed4e9d37b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd87e5c57ea9a45309a58864e80f2f808'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:09.010458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1138/2278] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:52:08 2022] DELETE /identity/v3/users/d87e5c57ea9a45309a58864e80f2f808 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:52:09.301990 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc33c8-1c82-45c1-80b1-6a4031901d8e admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:09.305542 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-9bdc33c8-1c82-45c1-80b1-6a4031901d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:09.319622 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bdb84-9a6d-44a6-ba6c-bf6ed4e9d37b admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:09.321269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e18bdb84-9a6d-44a6-ba6c-bf6ed4e9d37b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:09.323690 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc33c8-1c82-45c1-80b1-6a4031901d8e admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:09.353755 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:09.424478 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2d4f9-96f7-4039-83a8-600dddeba605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:09.427233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2d4f9-96f7-4039-83a8-600dddeba605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:09.427819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2d4f9-96f7-4039-83a8-600dddeba605 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:09.428179 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2d4f9-96f7-4039-83a8-600dddeba605 admin admin] PATH_INFO: `/v3/users/3900c1834dec41b0848ab076d1957ece` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:09.429753 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2d4f9-96f7-4039-83a8-600dddeba605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3900c1834dec41b0848ab076d1957ece)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:09.433865 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2d4f9-96f7-4039-83a8-600dddeba605 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:09.443300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bdb84-9a6d-44a6-ba6c-bf6ed4e9d37b admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:09.455235 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:09.455600 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470544c-7d20-4782-98e1-6c3be3a7a330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:09.456494 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470544c-7d20-4782-98e1-6c3be3a7a330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:09.457536 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470544c-7d20-4782-98e1-6c3be3a7a330 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:09.458069 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470544c-7d20-4782-98e1-6c3be3a7a330 admin admin] PATH_INFO: `/v3/users/6cb90fe1f7794578b8dabb9c646bd400` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:09.460148 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470544c-7d20-4782-98e1-6c3be3a7a330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cb90fe1f7794578b8dabb9c646bd400)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:09.462835 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470544c-7d20-4782-98e1-6c3be3a7a330 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:09.518568 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-28a2d4f9-96f7-4039-83a8-600dddeba605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3900c1834dec41b0848ab076d1957ece'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:09.534913 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-28a2d4f9-96f7-4039-83a8-600dddeba605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3900c1834dec41b0848ab076d1957ece'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:09.545833 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-28a2d4f9-96f7-4039-83a8-600dddeba605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3900c1834dec41b0848ab076d1957ece'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:09.546786 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-28a2d4f9-96f7-4039-83a8-600dddeba605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3900c1834dec41b0848ab076d1957ece'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:09.558684 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-3470544c-7d20-4782-98e1-6c3be3a7a330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cb90fe1f7794578b8dabb9c646bd400'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:09.560480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-3470544c-7d20-4782-98e1-6c3be3a7a330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cb90fe1f7794578b8dabb9c646bd400'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:09.565345 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-28a2d4f9-96f7-4039-83a8-600dddeba605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3900c1834dec41b0848ab076d1957ece'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:09.574345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-3470544c-7d20-4782-98e1-6c3be3a7a330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cb90fe1f7794578b8dabb9c646bd400'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:09.575592 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1141/2279] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:52:09 2022] DELETE /identity/v3/users/3900c1834dec41b0848ab076d1957ece => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:09.576463 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2d4f9-96f7-4039-83a8-600dddeba605 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:09.578396 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-28a2d4f9-96f7-4039-83a8-600dddeba605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:09.601442 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-3470544c-7d20-4782-98e1-6c3be3a7a330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cb90fe1f7794578b8dabb9c646bd400'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:09.622737 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-3470544c-7d20-4782-98e1-6c3be3a7a330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cb90fe1f7794578b8dabb9c646bd400'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:09.637998 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1139/2280] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:52:09 2022] DELETE /identity/v3/users/6cb90fe1f7794578b8dabb9c646bd400 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:09.645362 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6e0c7-5807-4137-9d4a-e73020cfe41f None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:09.645953 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6e0c7-5807-4137-9d4a-e73020cfe41f None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:09.646360 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6e0c7-5807-4137-9d4a-e73020cfe41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:09.693031 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-6ab6e0c7-5807-4137-9d4a-e73020cfe41f None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:09.695768 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-6ab6e0c7-5807-4137-9d4a-e73020cfe41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:09.714990 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2d4f9-96f7-4039-83a8-600dddeba605 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:09.794122 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f108d-3178-4334-9f0f-c3f6dbccee55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:09.794786 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f108d-3178-4334-9f0f-c3f6dbccee55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:09.795249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f108d-3178-4334-9f0f-c3f6dbccee55 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:09.795685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f108d-3178-4334-9f0f-c3f6dbccee55 admin admin] PATH_INFO: `/v3/projects/549000aa5407484388897bf0fdbfa52b` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:09.797177 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f108d-3178-4334-9f0f-c3f6dbccee55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=549000aa5407484388897bf0fdbfa52b)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:09.799563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f108d-3178-4334-9f0f-c3f6dbccee55 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:09.843264 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1140/2281] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:09.845318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31826dfd-d010-471a-b37e-f316e6a61242 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:09.845747 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31826dfd-d010-471a-b37e-f316e6a61242 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:09.846129 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31826dfd-d010-471a-b37e-f316e6a61242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:09.869586 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:09.871971 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-31826dfd-d010-471a-b37e-f316e6a61242 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:09.873293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-31826dfd-d010-471a-b37e-f316e6a61242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:09.883630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-c16f108d-3178-4334-9f0f-c3f6dbccee55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '549000aa5407484388897bf0fdbfa52b', 'request_id': 'req-c16f108d-3178-4334-9f0f-c3f6dbccee55'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:09.900613 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-c16f108d-3178-4334-9f0f-c3f6dbccee55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '549000aa5407484388897bf0fdbfa52b', 'request_id': 'req-c16f108d-3178-4334-9f0f-c3f6dbccee55'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:09.914807 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-c16f108d-3178-4334-9f0f-c3f6dbccee55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '549000aa5407484388897bf0fdbfa52b', 'request_id': 'req-c16f108d-3178-4334-9f0f-c3f6dbccee55'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:09.924009 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:09.936579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-c16f108d-3178-4334-9f0f-c3f6dbccee55 admin admin] The token cache is being invalidate because project 549000aa5407484388897bf0fdbfa52b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:52:09.937214 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-c16f108d-3178-4334-9f0f-c3f6dbccee55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:09.938569 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-c16f108d-3178-4334-9f0f-c3f6dbccee55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:09.945837 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1142/2282] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:52:09 2022] DELETE /identity/v3/projects/549000aa5407484388897bf0fdbfa52b => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:09.945837 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f108d-3178-4334-9f0f-c3f6dbccee55 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:09.948204 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-c16f108d-3178-4334-9f0f-c3f6dbccee55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:09.973973 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1141/2283] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:09.975581 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe7101-ebf7-4a18-8f63-b88b0cabb194 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:09.975981 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe7101-ebf7-4a18-8f63-b88b0cabb194 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:09.976365 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe7101-ebf7-4a18-8f63-b88b0cabb194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:10.000863 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-1cfe7101-ebf7-4a18-8f63-b88b0cabb194 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:10.002322 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-1cfe7101-ebf7-4a18-8f63-b88b0cabb194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:10.012301 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1142/2284] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:10.019495 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe7101-ebf7-4a18-8f63-b88b0cabb194 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:10.020694 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-1cfe7101-ebf7-4a18-8f63-b88b0cabb194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:10.055095 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f108d-3178-4334-9f0f-c3f6dbccee55 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:10.062306 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f97f4-214b-4531-a411-b274b1360e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:10.063251 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f97f4-214b-4531-a411-b274b1360e06 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:10.063673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f97f4-214b-4531-a411-b274b1360e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:10.064098 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f97f4-214b-4531-a411-b274b1360e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:10.067188 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-310f97f4-214b-4531-a411-b274b1360e06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:10.080478 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f97f4-214b-4531-a411-b274b1360e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:10.082017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f97f4-214b-4531-a411-b274b1360e06 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:10.094293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1143/2285] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:52:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:52:10.096377 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c4e22-0ad0-429a-a3c9-3f66228e5698 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:10.096743 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c4e22-0ad0-429a-a3c9-3f66228e5698 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:10.097163 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c4e22-0ad0-429a-a3c9-3f66228e5698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:10.105883 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe7101-ebf7-4a18-8f63-b88b0cabb194 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:10.111191 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5006506-55be-430d-a0a1-81a81f9cb4b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:10.111740 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5006506-55be-430d-a0a1-81a81f9cb4b7 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:10.112027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5006506-55be-430d-a0a1-81a81f9cb4b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:10.112304 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5006506-55be-430d-a0a1-81a81f9cb4b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:10.126248 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-794c4e22-0ad0-429a-a3c9-3f66228e5698 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:10.129966 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5006506-55be-430d-a0a1-81a81f9cb4b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:10.131133 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-794c4e22-0ad0-429a-a3c9-3f66228e5698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:10.138743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5006506-55be-430d-a0a1-81a81f9cb4b7 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:10.150729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1144/2286] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:10.158021 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c4e22-0ad0-429a-a3c9-3f66228e5698 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:10.179461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1143/2287] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:52:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:52:10.183812 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c4e22-0ad0-429a-a3c9-3f66228e5698 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:10.191037 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2d0ac-695e-4a9e-991d-072b8d659bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:10.192895 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2d0ac-695e-4a9e-991d-072b8d659bdc admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:10.193204 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2d0ac-695e-4a9e-991d-072b8d659bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:10.193715 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2d0ac-695e-4a9e-991d-072b8d659bdc admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:10.194414 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2d0ac-695e-4a9e-991d-072b8d659bdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:52:10.194724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2d0ac-695e-4a9e-991d-072b8d659bdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:10.197083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2d0ac-695e-4a9e-991d-072b8d659bdc admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:10.220273 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1145/2288] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:52:10.223035 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5006506-55be-430d-a0a1-81a81f9cb4b7 service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:10.241303 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5006506-55be-430d-a0a1-81a81f9cb4b7 service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:10.249932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30430b4-3746-4cab-84b0-65c72d836447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:10.250574 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30430b4-3746-4cab-84b0-65c72d836447 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:10.251068 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30430b4-3746-4cab-84b0-65c72d836447 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:10.251532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30430b4-3746-4cab-84b0-65c72d836447 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:10.252215 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30430b4-3746-4cab-84b0-65c72d836447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:10.254428 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30430b4-3746-4cab-84b0-65c72d836447 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:10.306061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1144/2289] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:52:10 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:52:10.310536 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2d0ac-695e-4a9e-991d-072b8d659bdc admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:10.331118 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2d0ac-695e-4a9e-991d-072b8d659bdc admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:10.450962 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc80bb-cdf7-4f78-872d-dfb6aaf9fa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:10.452445 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc80bb-cdf7-4f78-872d-dfb6aaf9fa70 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:10.453051 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc80bb-cdf7-4f78-872d-dfb6aaf9fa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:10.453668 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc80bb-cdf7-4f78-872d-dfb6aaf9fa70 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:10.455398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc80bb-cdf7-4f78-872d-dfb6aaf9fa70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:10.459467 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc80bb-cdf7-4f78-872d-dfb6aaf9fa70 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:10.521769 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1146/2290] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:52:10 2022] POST /identity/v3/users => generated 286 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:52:10.529475 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30430b4-3746-4cab-84b0-65c72d836447 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:10.546456 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30430b4-3746-4cab-84b0-65c72d836447 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:10.553973 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3e68d-4e42-43e4-ba6e-7e1fb80a64f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:10.554536 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3e68d-4e42-43e4-ba6e-7e1fb80a64f5 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:10.554979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3e68d-4e42-43e4-ba6e-7e1fb80a64f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:10.555534 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3e68d-4e42-43e4-ba6e-7e1fb80a64f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:10.556900 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3e68d-4e42-43e4-ba6e-7e1fb80a64f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:10.558846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3e68d-4e42-43e4-ba6e-7e1fb80a64f5 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:10.578443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1145/2291] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:52:10.584394 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc80bb-cdf7-4f78-872d-dfb6aaf9fa70 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:10.597650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc80bb-cdf7-4f78-872d-dfb6aaf9fa70 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:10.606514 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1722f-78f8-4fb6-8fe5-9c8628300464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:10.607167 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1722f-78f8-4fb6-8fe5-9c8628300464 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:10.607676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1722f-78f8-4fb6-8fe5-9c8628300464 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:10.607875 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1722f-78f8-4fb6-8fe5-9c8628300464 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:10.608589 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1722f-78f8-4fb6-8fe5-9c8628300464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:10.611122 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1722f-78f8-4fb6-8fe5-9c8628300464 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:10.626989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1147/2292] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:52:10.631563 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3e68d-4e42-43e4-ba6e-7e1fb80a64f5 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:10.637946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1722f-78f8-4fb6-8fe5-9c8628300464 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:10.647114 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3e68d-4e42-43e4-ba6e-7e1fb80a64f5 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:10.654649 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-4af1722f-78f8-4fb6-8fe5-9c8628300464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:10.661790 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a12d0-3d11-46b3-af68-ae37ac6c8a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:10.662705 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a12d0-3d11-46b3-af68-ae37ac6c8a68 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:10.662987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a12d0-3d11-46b3-af68-ae37ac6c8a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:10.663302 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a12d0-3d11-46b3-af68-ae37ac6c8a68 admin admin] PATH_INFO: `/v3/projects/0d3d354feef04653b990bcbb83f2d46e/users/282d843b49ac4f8eb74c050ddaf84a36/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:10.695168 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a12d0-3d11-46b3-af68-ae37ac6c8a68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d3d354feef04653b990bcbb83f2d46e, user_id=282d843b49ac4f8eb74c050ddaf84a36, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:10.700383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a12d0-3d11-46b3-af68-ae37ac6c8a68 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:10.700720 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1722f-78f8-4fb6-8fe5-9c8628300464 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:10.720903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944765e5-5b6f-4da1-9875-77743c06c28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:10.724843 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944765e5-5b6f-4da1-9875-77743c06c28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:10.726050 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944765e5-5b6f-4da1-9875-77743c06c28b admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:10.726881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944765e5-5b6f-4da1-9875-77743c06c28b admin admin] PATH_INFO: `/v3/projects/83cc8952a4a5438f9829f67877ee5a9e` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:10.730958 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944765e5-5b6f-4da1-9875-77743c06c28b admin admin] RBAC: Authorizing `identity:delete_project(project_id=83cc8952a4a5438f9829f67877ee5a9e)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:10.735089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944765e5-5b6f-4da1-9875-77743c06c28b admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:10.742911 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1146/2293] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:52:10 2022] PUT /identity/v3/projects/0d3d354feef04653b990bcbb83f2d46e/users/282d843b49ac4f8eb74c050ddaf84a36/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:10.748699 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73693940-992c-4e12-aa54-59be5831af5e None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:10.749445 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73693940-992c-4e12-aa54-59be5831af5e None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:10.749966 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73693940-992c-4e12-aa54-59be5831af5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:10.784141 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-73693940-992c-4e12-aa54-59be5831af5e None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:10.786100 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-73693940-992c-4e12-aa54-59be5831af5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:10.806026 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:10.832979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-944765e5-5b6f-4da1-9875-77743c06c28b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83cc8952a4a5438f9829f67877ee5a9e', 'request_id': 'req-944765e5-5b6f-4da1-9875-77743c06c28b'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:10.841735 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-944765e5-5b6f-4da1-9875-77743c06c28b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83cc8952a4a5438f9829f67877ee5a9e', 'request_id': 'req-944765e5-5b6f-4da1-9875-77743c06c28b'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:10.853397 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-944765e5-5b6f-4da1-9875-77743c06c28b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83cc8952a4a5438f9829f67877ee5a9e', 'request_id': 'req-944765e5-5b6f-4da1-9875-77743c06c28b'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:10.871618 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-944765e5-5b6f-4da1-9875-77743c06c28b admin admin] The token cache is being invalidate because project 83cc8952a4a5438f9829f67877ee5a9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:52:10.872345 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-944765e5-5b6f-4da1-9875-77743c06c28b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:10.877460 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-944765e5-5b6f-4da1-9875-77743c06c28b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:10.877460 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1148/2294] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:52:10 2022] DELETE /identity/v3/projects/83cc8952a4a5438f9829f67877ee5a9e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:10.877460 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944765e5-5b6f-4da1-9875-77743c06c28b admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:10.878818 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-944765e5-5b6f-4da1-9875-77743c06c28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:10.902862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1147/2295] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:52:10.903719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73693940-992c-4e12-aa54-59be5831af5e None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:10.905182 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-73693940-992c-4e12-aa54-59be5831af5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:10.925370 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73693940-992c-4e12-aa54-59be5831af5e None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:10.943339 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:10.984604 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944765e5-5b6f-4da1-9875-77743c06c28b admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:10.991662 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43717f-8fe6-4011-86ba-e515b0f13289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:10.992351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43717f-8fe6-4011-86ba-e515b0f13289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:10.992750 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43717f-8fe6-4011-86ba-e515b0f13289 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:10.993041 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43717f-8fe6-4011-86ba-e515b0f13289 admin admin] PATH_INFO: `/v3/projects/f326a61157fe4f5a8460da2734481b84` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:10.996174 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43717f-8fe6-4011-86ba-e515b0f13289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f326a61157fe4f5a8460da2734481b84)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:10.998908 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43717f-8fe6-4011-86ba-e515b0f13289 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:11.029631 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3460d89-5abf-46c9-8170-e71fb20ff4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:11.030306 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3460d89-5abf-46c9-8170-e71fb20ff4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:11.030567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3460d89-5abf-46c9-8170-e71fb20ff4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:11.030845 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3460d89-5abf-46c9-8170-e71fb20ff4e4 admin admin] PATH_INFO: `/v3/users/2200ad4e48f94367aa6013876bba7ac9` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:11.033662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3460d89-5abf-46c9-8170-e71fb20ff4e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2200ad4e48f94367aa6013876bba7ac9)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:11.042224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3460d89-5abf-46c9-8170-e71fb20ff4e4 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:11.074484 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ab43717f-8fe6-4011-86ba-e515b0f13289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f326a61157fe4f5a8460da2734481b84', 'request_id': 'req-ab43717f-8fe6-4011-86ba-e515b0f13289'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:11.084687 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ab43717f-8fe6-4011-86ba-e515b0f13289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f326a61157fe4f5a8460da2734481b84', 'request_id': 'req-ab43717f-8fe6-4011-86ba-e515b0f13289'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:11.104293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ab43717f-8fe6-4011-86ba-e515b0f13289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f326a61157fe4f5a8460da2734481b84', 'request_id': 'req-ab43717f-8fe6-4011-86ba-e515b0f13289'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:11.123482 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ab43717f-8fe6-4011-86ba-e515b0f13289 admin admin] The token cache is being invalidate because project f326a61157fe4f5a8460da2734481b84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:52:11.123772 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ab43717f-8fe6-4011-86ba-e515b0f13289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:11.124683 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ab43717f-8fe6-4011-86ba-e515b0f13289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:11.126328 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1149/2296] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:52:10 2022] DELETE /identity/v3/projects/f326a61157fe4f5a8460da2734481b84 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:11.136699 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43717f-8fe6-4011-86ba-e515b0f13289 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:11.141002 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ab43717f-8fe6-4011-86ba-e515b0f13289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:11.162343 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e3460d89-5abf-46c9-8170-e71fb20ff4e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2200ad4e48f94367aa6013876bba7ac9'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:11.164084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e3460d89-5abf-46c9-8170-e71fb20ff4e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2200ad4e48f94367aa6013876bba7ac9'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:11.195138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e3460d89-5abf-46c9-8170-e71fb20ff4e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2200ad4e48f94367aa6013876bba7ac9'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:11.219858 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e3460d89-5abf-46c9-8170-e71fb20ff4e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2200ad4e48f94367aa6013876bba7ac9'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:11.238453 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e3460d89-5abf-46c9-8170-e71fb20ff4e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2200ad4e48f94367aa6013876bba7ac9'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:11.253643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1148/2297] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:52:10 2022] DELETE /identity/v3/users/2200ad4e48f94367aa6013876bba7ac9 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:11.278574 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:11.313225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43717f-8fe6-4011-86ba-e515b0f13289 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:11.488037 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f5419-9da8-429f-b541-5b6b42dc961c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:11.489633 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f5419-9da8-429f-b541-5b6b42dc961c service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:11.489633 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f5419-9da8-429f-b541-5b6b42dc961c service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:11.489633 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f5419-9da8-429f-b541-5b6b42dc961c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:11.492539 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-df7f5419-9da8-429f-b541-5b6b42dc961c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:11.604195 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f5419-9da8-429f-b541-5b6b42dc961c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:11.606826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f5419-9da8-429f-b541-5b6b42dc961c service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:11.622657 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1150/2298] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:52:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:52:11.893299 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3460d89-5abf-46c9-8170-e71fb20ff4e4 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:11.895018 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e3460d89-5abf-46c9-8170-e71fb20ff4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:11.925838 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3460d89-5abf-46c9-8170-e71fb20ff4e4 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:11.954527 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f8676-fc02-4a71-b82f-a13c676fd951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:11.955275 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f8676-fc02-4a71-b82f-a13c676fd951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:11.955745 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f8676-fc02-4a71-b82f-a13c676fd951 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:11.956258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f8676-fc02-4a71-b82f-a13c676fd951 admin admin] PATH_INFO: `/v3/projects/c04be41ffbd54e468f6a9049e30e11a2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:11.958586 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f8676-fc02-4a71-b82f-a13c676fd951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c04be41ffbd54e468f6a9049e30e11a2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:11.963125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f8676-fc02-4a71-b82f-a13c676fd951 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:12.055774 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-b19f8676-fc02-4a71-b82f-a13c676fd951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c04be41ffbd54e468f6a9049e30e11a2', 'request_id': 'req-b19f8676-fc02-4a71-b82f-a13c676fd951'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:12.070377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-b19f8676-fc02-4a71-b82f-a13c676fd951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c04be41ffbd54e468f6a9049e30e11a2', 'request_id': 'req-b19f8676-fc02-4a71-b82f-a13c676fd951'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:12.085363 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-b19f8676-fc02-4a71-b82f-a13c676fd951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c04be41ffbd54e468f6a9049e30e11a2', 'request_id': 'req-b19f8676-fc02-4a71-b82f-a13c676fd951'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:12.106873 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-b19f8676-fc02-4a71-b82f-a13c676fd951 admin admin] The token cache is being invalidate because project c04be41ffbd54e468f6a9049e30e11a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:52:12.107252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-b19f8676-fc02-4a71-b82f-a13c676fd951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:12.108050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-b19f8676-fc02-4a71-b82f-a13c676fd951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:12.113192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1149/2299] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:52:11 2022] DELETE /identity/v3/projects/c04be41ffbd54e468f6a9049e30e11a2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:52:12.115070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6f5ba-0d7c-4a00-829c-b5fb6ef73c74 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:12.115539 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6f5ba-0d7c-4a00-829c-b5fb6ef73c74 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:12.115679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6f5ba-0d7c-4a00-829c-b5fb6ef73c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:12.143680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-bbe6f5ba-0d7c-4a00-829c-b5fb6ef73c74 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:12.145305 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-bbe6f5ba-0d7c-4a00-829c-b5fb6ef73c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:12.245707 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1151/2300] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:12.254571 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f732c-607a-405d-a29e-ca2d388cc50c None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:12.255280 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f732c-607a-405d-a29e-ca2d388cc50c None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:12.255557 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f732c-607a-405d-a29e-ca2d388cc50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:12.287269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-232f732c-607a-405d-a29e-ca2d388cc50c None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:12.288736 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-232f732c-607a-405d-a29e-ca2d388cc50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:12.300293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1150/2301] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:12.305016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6f5ba-0d7c-4a00-829c-b5fb6ef73c74 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:12.317055 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6f5ba-0d7c-4a00-829c-b5fb6ef73c74 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:12.324411 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59093d2-fdc2-42fd-8956-fdaa0f13c2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:12.328090 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59093d2-fdc2-42fd-8956-fdaa0f13c2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:12.329067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59093d2-fdc2-42fd-8956-fdaa0f13c2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:12.329451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59093d2-fdc2-42fd-8956-fdaa0f13c2e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:12.330869 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59093d2-fdc2-42fd-8956-fdaa0f13c2e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:52:12.331271 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59093d2-fdc2-42fd-8956-fdaa0f13c2e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:12.333298 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59093d2-fdc2-42fd-8956-fdaa0f13c2e0 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:12.350082 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1152/2302] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:52:12.356802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f732c-607a-405d-a29e-ca2d388cc50c None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:12.367348 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f732c-607a-405d-a29e-ca2d388cc50c None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:12.373724 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1c0b0-043b-431c-a9ef-549bb4723ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:12.374391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1c0b0-043b-431c-a9ef-549bb4723ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:12.374671 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1c0b0-043b-431c-a9ef-549bb4723ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:12.374943 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1c0b0-043b-431c-a9ef-549bb4723ba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:12.375814 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1c0b0-043b-431c-a9ef-549bb4723ba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:12.377657 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1c0b0-043b-431c-a9ef-549bb4723ba5 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:12.389566 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:12.426941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1151/2303] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:52:12 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:52:12.432981 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59093d2-fdc2-42fd-8956-fdaa0f13c2e0 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:12.451975 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59093d2-fdc2-42fd-8956-fdaa0f13c2e0 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:12.543435 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:12.573461 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e78ce-b005-4e90-a312-3882686253b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:12.574044 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e78ce-b005-4e90-a312-3882686253b1 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:12.574337 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e78ce-b005-4e90-a312-3882686253b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:12.574633 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e78ce-b005-4e90-a312-3882686253b1 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:12.575731 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e78ce-b005-4e90-a312-3882686253b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:12.578295 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e78ce-b005-4e90-a312-3882686253b1 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:12.613537 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1153/2304] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:52:12 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:52:12.617878 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1c0b0-043b-431c-a9ef-549bb4723ba5 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:12.630968 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1c0b0-043b-431c-a9ef-549bb4723ba5 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:12.640299 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3ba84-76b0-4cc2-b989-9ce1ca9a1d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:12.640968 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3ba84-76b0-4cc2-b989-9ce1ca9a1d15 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:12.641248 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3ba84-76b0-4cc2-b989-9ce1ca9a1d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:12.641588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3ba84-76b0-4cc2-b989-9ce1ca9a1d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:12.642343 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3ba84-76b0-4cc2-b989-9ce1ca9a1d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:12.644552 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3ba84-76b0-4cc2-b989-9ce1ca9a1d15 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:12.661122 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1152/2305] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:52:12.663147 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e78ce-b005-4e90-a312-3882686253b1 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:12.664339 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f601160-e43a-4e8c-97ff-a76cf3fb7da0 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:12.664752 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f601160-e43a-4e8c-97ff-a76cf3fb7da0 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:12.665739 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f601160-e43a-4e8c-97ff-a76cf3fb7da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:12.686210 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e78ce-b005-4e90-a312-3882686253b1 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:12.691864 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3dc4cc-4e60-4327-8e9c-16e3d02365be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:12.692586 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3dc4cc-4e60-4327-8e9c-16e3d02365be admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:12.693063 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3dc4cc-4e60-4327-8e9c-16e3d02365be admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:12.693385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3dc4cc-4e60-4327-8e9c-16e3d02365be admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:12.694156 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3dc4cc-4e60-4327-8e9c-16e3d02365be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:12.696195 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3dc4cc-4e60-4327-8e9c-16e3d02365be admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:12.701842 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-0f601160-e43a-4e8c-97ff-a76cf3fb7da0 None None] MFA Rules not processed for user `282d843b49ac4f8eb74c050ddaf84a36`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:12.703461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-0f601160-e43a-4e8c-97ff-a76cf3fb7da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:12.720924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1154/2306] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:52:12.725663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3dc4cc-4e60-4327-8e9c-16e3d02365be admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:12.745037 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3dc4cc-4e60-4327-8e9c-16e3d02365be admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:12.753102 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a863b68-dad2-42d0-a028-13644e51f967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:12.754346 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a863b68-dad2-42d0-a028-13644e51f967 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:12.754801 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a863b68-dad2-42d0-a028-13644e51f967 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:12.755309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a863b68-dad2-42d0-a028-13644e51f967 admin admin] PATH_INFO: `/v3/projects/4d8914ad4a0540919c1e3939f9b93b11/users/0a5c5a37eb264f34a148ad6418608850/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:12.786358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a863b68-dad2-42d0-a028-13644e51f967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8914ad4a0540919c1e3939f9b93b11, user_id=0a5c5a37eb264f34a148ad6418608850, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:12.790909 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a863b68-dad2-42d0-a028-13644e51f967 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:12.817463 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1155/2307] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:52:12 2022] PUT /identity/v3/projects/4d8914ad4a0540919c1e3939f9b93b11/users/0a5c5a37eb264f34a148ad6418608850/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:12.823639 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b61528-3e09-4ac8-bb33-67c4e6929f65 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:12.824210 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b61528-3e09-4ac8-bb33-67c4e6929f65 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:12.824626 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b61528-3e09-4ac8-bb33-67c4e6929f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:12.849603 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1153/2308] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:12.861704 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f601160-e43a-4e8c-97ff-a76cf3fb7da0 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:12.864258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-0f601160-e43a-4e8c-97ff-a76cf3fb7da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:12.864779 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-41b61528-3e09-4ac8-bb33-67c4e6929f65 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:12.866975 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-41b61528-3e09-4ac8-bb33-67c4e6929f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:12.994592 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1156/2309] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:13.006847 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b61528-3e09-4ac8-bb33-67c4e6929f65 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:13.009640 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f601160-e43a-4e8c-97ff-a76cf3fb7da0 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:13.010284 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-41b61528-3e09-4ac8-bb33-67c4e6929f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:13.102862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583403a-7134-4e6f-81f9-ea79c17ebac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:13.103522 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583403a-7134-4e6f-81f9-ea79c17ebac3 service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:13.103819 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583403a-7134-4e6f-81f9-ea79c17ebac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:13.104099 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583403a-7134-4e6f-81f9-ea79c17ebac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:13.122061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b61528-3e09-4ac8-bb33-67c4e6929f65 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:13.126721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a40d0-f2f7-4b88-ad49-37805561d174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:13.127314 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a40d0-f2f7-4b88-ad49-37805561d174 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:13.127596 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a40d0-f2f7-4b88-ad49-37805561d174 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:13.127872 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a40d0-f2f7-4b88-ad49-37805561d174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:13.141214 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a40d0-f2f7-4b88-ad49-37805561d174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:13.143049 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a40d0-f2f7-4b88-ad49-37805561d174 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:13.156419 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1157/2310] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:52:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:52:13.181382 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:13.219706 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583403a-7134-4e6f-81f9-ea79c17ebac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:13.221239 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583403a-7134-4e6f-81f9-ea79c17ebac3 service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:13.240552 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1154/2311] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:52:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:52:14.251233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad751c75-4fb8-4da9-80fe-7b53e2b0fa78 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:14.251839 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad751c75-4fb8-4da9-80fe-7b53e2b0fa78 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:14.251839 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad751c75-4fb8-4da9-80fe-7b53e2b0fa78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:14.291223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-ad751c75-4fb8-4da9-80fe-7b53e2b0fa78 None None] MFA Rules not processed for user `0a5c5a37eb264f34a148ad6418608850`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:14.292440 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ad751c75-4fb8-4da9-80fe-7b53e2b0fa78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:14.325810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:14.397649 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1158/2312] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:14.403018 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583403a-7134-4e6f-81f9-ea79c17ebac3 service cinder] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:14.415969 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583403a-7134-4e6f-81f9-ea79c17ebac3 service cinder] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:14.420988 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb36af-a57d-4bf7-a6e9-164419d39adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:14.421632 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb36af-a57d-4bf7-a6e9-164419d39adc admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:14.421910 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb36af-a57d-4bf7-a6e9-164419d39adc admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:14.422183 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb36af-a57d-4bf7-a6e9-164419d39adc admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:14.422814 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb36af-a57d-4bf7-a6e9-164419d39adc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:14.424716 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb36af-a57d-4bf7-a6e9-164419d39adc admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:14.466105 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1155/2313] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:52:14 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:52:14.473681 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad751c75-4fb8-4da9-80fe-7b53e2b0fa78 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:14.489871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad751c75-4fb8-4da9-80fe-7b53e2b0fa78 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:14.568219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94d4e2-b72d-4c3a-9793-fd8cf11e6d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:14.568950 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94d4e2-b72d-4c3a-9793-fd8cf11e6d80 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:14.569440 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94d4e2-b72d-4c3a-9793-fd8cf11e6d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:14.569834 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94d4e2-b72d-4c3a-9793-fd8cf11e6d80 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:14.570640 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94d4e2-b72d-4c3a-9793-fd8cf11e6d80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:14.573643 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94d4e2-b72d-4c3a-9793-fd8cf11e6d80 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:14.618987 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1159/2314] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:52:14 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:52:14.620948 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb36af-a57d-4bf7-a6e9-164419d39adc admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:14.636033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb36af-a57d-4bf7-a6e9-164419d39adc admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:14.641090 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06c3ec-56e4-473b-a9a8-d0cb9c6d0c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:14.642105 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06c3ec-56e4-473b-a9a8-d0cb9c6d0c7e admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:14.642501 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06c3ec-56e4-473b-a9a8-d0cb9c6d0c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:14.642850 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06c3ec-56e4-473b-a9a8-d0cb9c6d0c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:14.643716 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06c3ec-56e4-473b-a9a8-d0cb9c6d0c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:14.645381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06c3ec-56e4-473b-a9a8-d0cb9c6d0c7e admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:14.659351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1156/2315] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:52:14.664895 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94d4e2-b72d-4c3a-9793-fd8cf11e6d80 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:14.690410 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94d4e2-b72d-4c3a-9793-fd8cf11e6d80 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:14.703172 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681430a-c717-4c45-8ebf-9b44f43c1c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:14.704225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681430a-c717-4c45-8ebf-9b44f43c1c5e admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:14.704731 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681430a-c717-4c45-8ebf-9b44f43c1c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:14.705473 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681430a-c717-4c45-8ebf-9b44f43c1c5e admin admin] PATH_INFO: `/v3/projects/3a74da5fd24d4bf39d580ce0d7165fbf/users/3fc3977823d0450daa0b820dd518cb73/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:14.743630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681430a-c717-4c45-8ebf-9b44f43c1c5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a74da5fd24d4bf39d580ce0d7165fbf, user_id=3fc3977823d0450daa0b820dd518cb73, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:14.747642 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681430a-c717-4c45-8ebf-9b44f43c1c5e admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:14.778375 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1160/2316] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:52:14 2022] PUT /identity/v3/projects/3a74da5fd24d4bf39d580ce0d7165fbf/users/3fc3977823d0450daa0b820dd518cb73/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:14.783423 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06c3ec-56e4-473b-a9a8-d0cb9c6d0c7e admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:14.799685 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06c3ec-56e4-473b-a9a8-d0cb9c6d0c7e admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:14.861625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97aa72-79c6-47a9-af21-23621db8cf27 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:14.861921 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97aa72-79c6-47a9-af21-23621db8cf27 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:14.862427 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97aa72-79c6-47a9-af21-23621db8cf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:14.880117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f41d08-1007-4ccd-928e-3975f87c6f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:14.880604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f41d08-1007-4ccd-928e-3975f87c6f4b admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:14.880905 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f41d08-1007-4ccd-928e-3975f87c6f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:14.881274 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f41d08-1007-4ccd-928e-3975f87c6f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:14.881851 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f41d08-1007-4ccd-928e-3975f87c6f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:14.883736 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f41d08-1007-4ccd-928e-3975f87c6f4b admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:14.888448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-3c97aa72-79c6-47a9-af21-23621db8cf27 None None] MFA Rules not processed for user `282d843b49ac4f8eb74c050ddaf84a36`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:14.889727 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-3c97aa72-79c6-47a9-af21-23621db8cf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:14.895138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1157/2317] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:52:14.900502 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f41d08-1007-4ccd-928e-3975f87c6f4b admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:14.924292 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f41d08-1007-4ccd-928e-3975f87c6f4b admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:14.930755 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f898c40-6705-4da2-b0e5-ff1b32fb464b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:14.931455 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f898c40-6705-4da2-b0e5-ff1b32fb464b admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:14.931732 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f898c40-6705-4da2-b0e5-ff1b32fb464b admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:14.932006 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f898c40-6705-4da2-b0e5-ff1b32fb464b admin admin] PATH_INFO: `/v3/projects/3a74da5fd24d4bf39d580ce0d7165fbf/users/3fc3977823d0450daa0b820dd518cb73/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:14.934317 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f898c40-6705-4da2-b0e5-ff1b32fb464b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a74da5fd24d4bf39d580ce0d7165fbf, user_id=3fc3977823d0450daa0b820dd518cb73, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:14.936974 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f898c40-6705-4da2-b0e5-ff1b32fb464b admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:14.951556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1158/2318] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:52:14 2022] PUT /identity/v3/projects/3a74da5fd24d4bf39d580ce0d7165fbf/users/3fc3977823d0450daa0b820dd518cb73/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:52:14.969024 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1161/2319] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:52:16.082006 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98986355-3c40-4462-a800-0ecdc6d31634 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:16.083446 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98986355-3c40-4462-a800-0ecdc6d31634 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:16.083852 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98986355-3c40-4462-a800-0ecdc6d31634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:16.175818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-98986355-3c40-4462-a800-0ecdc6d31634 None None] MFA Rules not processed for user `3fc3977823d0450daa0b820dd518cb73`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:16.177285 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-98986355-3c40-4462-a800-0ecdc6d31634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:16.291768 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1159/2320] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:16.303566 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f50c4-89e0-4aff-833b-f6447c784ccc None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:16.304368 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f50c4-89e0-4aff-833b-f6447c784ccc None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:16.304368 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f50c4-89e0-4aff-833b-f6447c784ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:16.335766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-4e2f50c4-89e0-4aff-833b-f6447c784ccc None None] MFA Rules not processed for user `0a5c5a37eb264f34a148ad6418608850`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:16.338856 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-4e2f50c4-89e0-4aff-833b-f6447c784ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:16.385849 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:16.434566 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1162/2321] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:16.452213 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98986355-3c40-4462-a800-0ecdc6d31634 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:16.453532 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-98986355-3c40-4462-a800-0ecdc6d31634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:16.469811 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:16.573988 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98986355-3c40-4462-a800-0ecdc6d31634 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:16.585191 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d4bee-04ea-427c-9c93-982a54a3e5fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:16.586240 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d4bee-04ea-427c-9c93-982a54a3e5fc service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:16.587796 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d4bee-04ea-427c-9c93-982a54a3e5fc service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:16.588252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d4bee-04ea-427c-9c93-982a54a3e5fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:16.604187 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d4bee-04ea-427c-9c93-982a54a3e5fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:16.607664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d4bee-04ea-427c-9c93-982a54a3e5fc service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:16.628942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1160/2322] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:52:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:52:26.419549 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=9 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:26.620117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=28 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:34.999213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f50c4-89e0-4aff-833b-f6447c784ccc None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:35.000836 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-4e2f50c4-89e0-4aff-833b-f6447c784ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:35.090765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f50c4-89e0-4aff-833b-f6447c784ccc None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:35.095556 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788c618-84d9-436a-8b28-7f80dc372bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:35.096221 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788c618-84d9-436a-8b28-7f80dc372bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:35.096495 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788c618-84d9-436a-8b28-7f80dc372bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:35.096762 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788c618-84d9-436a-8b28-7f80dc372bcc admin admin] PATH_INFO: `/v3/users/9baa954a467c4bb4a297a2859b38700e` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:35.098146 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788c618-84d9-436a-8b28-7f80dc372bcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9baa954a467c4bb4a297a2859b38700e)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:35.100279 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788c618-84d9-436a-8b28-7f80dc372bcc admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:35.168101 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-d788c618-84d9-436a-8b28-7f80dc372bcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9baa954a467c4bb4a297a2859b38700e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:35.177642 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-d788c618-84d9-436a-8b28-7f80dc372bcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9baa954a467c4bb4a297a2859b38700e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:35.189279 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-d788c618-84d9-436a-8b28-7f80dc372bcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9baa954a467c4bb4a297a2859b38700e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:35.190094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-d788c618-84d9-436a-8b28-7f80dc372bcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9baa954a467c4bb4a297a2859b38700e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:35.209976 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-d788c618-84d9-436a-8b28-7f80dc372bcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9baa954a467c4bb4a297a2859b38700e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:35.218155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1163/2323] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:52:34 2022] DELETE /identity/v3/users/9baa954a467c4bb4a297a2859b38700e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:52:35.222779 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98f206-f2f8-48c0-b776-e4e54842f816 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:35.223426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98f206-f2f8-48c0-b776-e4e54842f816 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:35.223426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98f206-f2f8-48c0-b776-e4e54842f816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:35.245071 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-4b98f206-f2f8-48c0-b776-e4e54842f816 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:35.246483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-4b98f206-f2f8-48c0-b776-e4e54842f816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:35.354782 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1161/2324] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:52:35.370729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788c618-84d9-436a-8b28-7f80dc372bcc admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:35.372852 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-d788c618-84d9-436a-8b28-7f80dc372bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:35.456860 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788c618-84d9-436a-8b28-7f80dc372bcc admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:35.465183 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c2298-2801-4f96-b165-8272b048f670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:35.466153 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c2298-2801-4f96-b165-8272b048f670 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:35.466676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c2298-2801-4f96-b165-8272b048f670 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:35.467259 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c2298-2801-4f96-b165-8272b048f670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:35.482479 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c2298-2801-4f96-b165-8272b048f670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:35.483991 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c2298-2801-4f96-b165-8272b048f670 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:35.496898 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1164/2325] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:52:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:52:36.138289 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98f206-f2f8-48c0-b776-e4e54842f816 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:36.140173 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-4b98f206-f2f8-48c0-b776-e4e54842f816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:36.163849 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98f206-f2f8-48c0-b776-e4e54842f816 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:36.170736 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9273f-6adb-429b-a5d8-3a3304319a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:36.171589 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9273f-6adb-429b-a5d8-3a3304319a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:36.171874 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9273f-6adb-429b-a5d8-3a3304319a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:36.172154 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9273f-6adb-429b-a5d8-3a3304319a5d admin admin] PATH_INFO: `/v3/projects/8fa230125d47431fa53b0a2c9154d8c8` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:36.173544 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9273f-6adb-429b-a5d8-3a3304319a5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fa230125d47431fa53b0a2c9154d8c8)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:36.175660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9273f-6adb-429b-a5d8-3a3304319a5d admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:36.278115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2cb9273f-6adb-429b-a5d8-3a3304319a5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fa230125d47431fa53b0a2c9154d8c8', 'request_id': 'req-2cb9273f-6adb-429b-a5d8-3a3304319a5d'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:36.294033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2cb9273f-6adb-429b-a5d8-3a3304319a5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fa230125d47431fa53b0a2c9154d8c8', 'request_id': 'req-2cb9273f-6adb-429b-a5d8-3a3304319a5d'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:36.311623 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2cb9273f-6adb-429b-a5d8-3a3304319a5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fa230125d47431fa53b0a2c9154d8c8', 'request_id': 'req-2cb9273f-6adb-429b-a5d8-3a3304319a5d'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:36.328912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2cb9273f-6adb-429b-a5d8-3a3304319a5d admin admin] The token cache is being invalidate because project 8fa230125d47431fa53b0a2c9154d8c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:52:36.329358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2cb9273f-6adb-429b-a5d8-3a3304319a5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:36.330176 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2cb9273f-6adb-429b-a5d8-3a3304319a5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:36.332433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1162/2326] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:52:36 2022] DELETE /identity/v3/projects/8fa230125d47431fa53b0a2c9154d8c8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:52:36.338845 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206ecee-ebb1-4d0f-a34c-6cb372ab4956 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:36.339548 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206ecee-ebb1-4d0f-a34c-6cb372ab4956 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:36.340001 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206ecee-ebb1-4d0f-a34c-6cb372ab4956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:36.379712 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-5206ecee-ebb1-4d0f-a34c-6cb372ab4956 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:36.381297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-5206ecee-ebb1-4d0f-a34c-6cb372ab4956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:36.414893 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:36.503380 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1165/2327] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:36.513152 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6648e-dc50-4297-924c-e4ddee761384 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:36.513876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6648e-dc50-4297-924c-e4ddee761384 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:36.514242 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6648e-dc50-4297-924c-e4ddee761384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:36.543267 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-14d6648e-dc50-4297-924c-e4ddee761384 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:36.544687 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-14d6648e-dc50-4297-924c-e4ddee761384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:36.553884 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1163/2328] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:36.560099 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206ecee-ebb1-4d0f-a34c-6cb372ab4956 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:36.573752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206ecee-ebb1-4d0f-a34c-6cb372ab4956 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:36.579931 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5eee8-4090-4c4e-8b6c-4680575359cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:36.580595 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5eee8-4090-4c4e-8b6c-4680575359cf admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:36.580943 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5eee8-4090-4c4e-8b6c-4680575359cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:36.581458 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5eee8-4090-4c4e-8b6c-4680575359cf admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:36.582064 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5eee8-4090-4c4e-8b6c-4680575359cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:52:36.582416 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5eee8-4090-4c4e-8b6c-4680575359cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:36.584686 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5eee8-4090-4c4e-8b6c-4680575359cf admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:36.604087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1166/2329] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:52:36.609026 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6648e-dc50-4297-924c-e4ddee761384 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:36.623442 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6648e-dc50-4297-924c-e4ddee761384 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:36.630975 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f55b5-82a8-4d1f-b23c-c2718962eab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:36.631619 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f55b5-82a8-4d1f-b23c-c2718962eab9 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:36.631902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f55b5-82a8-4d1f-b23c-c2718962eab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:36.632179 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f55b5-82a8-4d1f-b23c-c2718962eab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:36.632847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f55b5-82a8-4d1f-b23c-c2718962eab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:36.634840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f55b5-82a8-4d1f-b23c-c2718962eab9 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:36.673450 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1164/2330] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:52:36 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:52:36.677503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5eee8-4090-4c4e-8b6c-4680575359cf admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:36.692931 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5eee8-4090-4c4e-8b6c-4680575359cf admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:36.785767 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0e581-c634-4bc2-b2b3-67a5c526b095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:36.786385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0e581-c634-4bc2-b2b3-67a5c526b095 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:36.786665 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0e581-c634-4bc2-b2b3-67a5c526b095 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:36.786938 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0e581-c634-4bc2-b2b3-67a5c526b095 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:36.787575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0e581-c634-4bc2-b2b3-67a5c526b095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:36.789554 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0e581-c634-4bc2-b2b3-67a5c526b095 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:36.814928 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1167/2331] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:52:36 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:52:36.819761 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f55b5-82a8-4d1f-b23c-c2718962eab9 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:36.833554 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f55b5-82a8-4d1f-b23c-c2718962eab9 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:36.838843 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcef5df-9b39-4ce3-8d93-b69f14ad82f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:36.839464 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcef5df-9b39-4ce3-8d93-b69f14ad82f0 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:36.839738 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcef5df-9b39-4ce3-8d93-b69f14ad82f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:36.840007 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcef5df-9b39-4ce3-8d93-b69f14ad82f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:36.840670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcef5df-9b39-4ce3-8d93-b69f14ad82f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:36.842333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcef5df-9b39-4ce3-8d93-b69f14ad82f0 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:36.853224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1165/2332] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:52:36.858291 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0e581-c634-4bc2-b2b3-67a5c526b095 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:36.868940 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0e581-c634-4bc2-b2b3-67a5c526b095 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:36.875003 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14002c6f-2806-4757-9552-b3e51f5461df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:36.875664 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14002c6f-2806-4757-9552-b3e51f5461df admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:36.876086 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14002c6f-2806-4757-9552-b3e51f5461df admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:36.876201 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14002c6f-2806-4757-9552-b3e51f5461df admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:36.876800 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14002c6f-2806-4757-9552-b3e51f5461df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:36.878450 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14002c6f-2806-4757-9552-b3e51f5461df admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:36.890354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1168/2333] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:52:36.895017 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcef5df-9b39-4ce3-8d93-b69f14ad82f0 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:36.906433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcef5df-9b39-4ce3-8d93-b69f14ad82f0 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:36.911735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6ece3-ee3d-45a3-bbbb-54d62ed2f1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:36.912404 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6ece3-ee3d-45a3-bbbb-54d62ed2f1b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:36.912683 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6ece3-ee3d-45a3-bbbb-54d62ed2f1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:36.912950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6ece3-ee3d-45a3-bbbb-54d62ed2f1b9 admin admin] PATH_INFO: `/v3/projects/7a0039e1b60d4d2cb807fa9c82cfcd09/users/8328a82e8eea4f9e9c9229e557f93d65/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:36.932924 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6ece3-ee3d-45a3-bbbb-54d62ed2f1b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a0039e1b60d4d2cb807fa9c82cfcd09, user_id=8328a82e8eea4f9e9c9229e557f93d65, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:36.935642 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6ece3-ee3d-45a3-bbbb-54d62ed2f1b9 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:36.951155 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1166/2334] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:52:36 2022] PUT /identity/v3/projects/7a0039e1b60d4d2cb807fa9c82cfcd09/users/8328a82e8eea4f9e9c9229e557f93d65/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:36.956254 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0f6a7-1604-4a77-a5e6-e6fe5b628b71 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:36.956543 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0f6a7-1604-4a77-a5e6-e6fe5b628b71 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:36.956875 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0f6a7-1604-4a77-a5e6-e6fe5b628b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:36.978915 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-67f0f6a7-1604-4a77-a5e6-e6fe5b628b71 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:36.980387 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-67f0f6a7-1604-4a77-a5e6-e6fe5b628b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:37.067400 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1169/2335] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:37.079033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6ece3-ee3d-45a3-bbbb-54d62ed2f1b9 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:37.079946 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-52c6ece3-ee3d-45a3-bbbb-54d62ed2f1b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:37.129585 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:37.188495 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6ece3-ee3d-45a3-bbbb-54d62ed2f1b9 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:37.193932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fbbcf-9b6c-4365-addf-069a6ac235ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:37.194569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fbbcf-9b6c-4365-addf-069a6ac235ea service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:37.194903 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fbbcf-9b6c-4365-addf-069a6ac235ea service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:37.195184 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fbbcf-9b6c-4365-addf-069a6ac235ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:37.207394 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414fbbcf-9b6c-4365-addf-069a6ac235ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:37.209112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414fbbcf-9b6c-4365-addf-069a6ac235ea service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:37.222511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1167/2336] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:52:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:52:43.783766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a934f-bbdc-4b82-823d-660ec863507b None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:43.785965 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a934f-bbdc-4b82-823d-660ec863507b None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:43.786422 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a934f-bbdc-4b82-823d-660ec863507b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:43.824900 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-3f2a934f-bbdc-4b82-823d-660ec863507b None None] MFA Rules not processed for user `8328a82e8eea4f9e9c9229e557f93d65`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:43.827089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-3f2a934f-bbdc-4b82-823d-660ec863507b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:43.860445 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:43.975430 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1170/2337] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:43.983595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fbbcf-9b6c-4365-addf-069a6ac235ea service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:44.004760 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fbbcf-9b6c-4365-addf-069a6ac235ea service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:44.019141 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f1017-7d05-4f5e-84bf-3d7886e285f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:44.022666 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f1017-7d05-4f5e-84bf-3d7886e285f1 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:44.022959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f1017-7d05-4f5e-84bf-3d7886e285f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:44.023241 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f1017-7d05-4f5e-84bf-3d7886e285f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:44.027453 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5d869-4cc5-420b-8c19-48ea07789419 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:44.027747 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5d869-4cc5-420b-8c19-48ea07789419 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:44.028057 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f1017-7d05-4f5e-84bf-3d7886e285f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:44.028209 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5d869-4cc5-420b-8c19-48ea07789419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:44.030123 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f1017-7d05-4f5e-84bf-3d7886e285f1 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:44.067043 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-07c5d869-4cc5-420b-8c19-48ea07789419 None None] MFA Rules not processed for user `a4493625af43482a88023a2aecd73b27`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:44.068686 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-07c5d869-4cc5-420b-8c19-48ea07789419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:44.075493 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1168/2338] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:52:43 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:52:44.081368 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f1017-7d05-4f5e-84bf-3d7886e285f1 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:44.176405 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1171/2339] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:44.190143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f1017-7d05-4f5e-84bf-3d7886e285f1 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:44.196340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80248f-e6ac-4431-8247-0d81e193c976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:44.197193 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80248f-e6ac-4431-8247-0d81e193c976 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:44.197507 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80248f-e6ac-4431-8247-0d81e193c976 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:44.197782 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80248f-e6ac-4431-8247-0d81e193c976 admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:44.198429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80248f-e6ac-4431-8247-0d81e193c976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:44.201009 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80248f-e6ac-4431-8247-0d81e193c976 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:44.231039 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1169/2340] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:52:44 2022] POST /identity/v3/users => generated 298 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:52:44.235244 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5d869-4cc5-420b-8c19-48ea07789419 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:44.250421 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5d869-4cc5-420b-8c19-48ea07789419 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:44.258250 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb250766-7c88-4eab-b5ea-1f40630342ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:44.259025 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb250766-7c88-4eab-b5ea-1f40630342ea admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:44.262180 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb250766-7c88-4eab-b5ea-1f40630342ea admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:44.262614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb250766-7c88-4eab-b5ea-1f40630342ea admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:44.263763 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb250766-7c88-4eab-b5ea-1f40630342ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:44.265854 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb250766-7c88-4eab-b5ea-1f40630342ea admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:44.289459 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1172/2341] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:52:44.292314 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80248f-e6ac-4431-8247-0d81e193c976 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:44.312712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80248f-e6ac-4431-8247-0d81e193c976 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:44.319113 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc5a0b-60c6-4589-a452-0a56c5a39901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:44.319825 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc5a0b-60c6-4589-a452-0a56c5a39901 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:44.320318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc5a0b-60c6-4589-a452-0a56c5a39901 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:44.320615 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc5a0b-60c6-4589-a452-0a56c5a39901 admin admin] PATH_INFO: `/v3/projects/df473b52c6fa49ec899902996369b6e0/users/62a50fa142914049bfab3c5a1cf20d3b/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:44.344794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc5a0b-60c6-4589-a452-0a56c5a39901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df473b52c6fa49ec899902996369b6e0, user_id=62a50fa142914049bfab3c5a1cf20d3b, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:44.348184 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc5a0b-60c6-4589-a452-0a56c5a39901 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:44.371540 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1170/2342] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:52:44 2022] PUT /identity/v3/projects/df473b52c6fa49ec899902996369b6e0/users/62a50fa142914049bfab3c5a1cf20d3b/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:44.375752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb250766-7c88-4eab-b5ea-1f40630342ea admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:44.389963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb250766-7c88-4eab-b5ea-1f40630342ea admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:44.501491 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a256e1-e096-44b4-baa4-de9e80229c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:44.502223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a256e1-e096-44b4-baa4-de9e80229c70 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:44.502764 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a256e1-e096-44b4-baa4-de9e80229c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:44.503143 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a256e1-e096-44b4-baa4-de9e80229c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:44.504308 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a256e1-e096-44b4-baa4-de9e80229c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:44.505912 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a256e1-e096-44b4-baa4-de9e80229c70 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:44.526445 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1173/2343] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:52:44.527777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc5a0b-60c6-4589-a452-0a56c5a39901 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:44.549074 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc5a0b-60c6-4589-a452-0a56c5a39901 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:44.558906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99191901-15ed-4e0c-88c1-e74995944045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:44.558906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99191901-15ed-4e0c-88c1-e74995944045 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:44.558906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99191901-15ed-4e0c-88c1-e74995944045 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:44.558906 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99191901-15ed-4e0c-88c1-e74995944045 admin admin] PATH_INFO: `/v3/projects/df473b52c6fa49ec899902996369b6e0/users/62a50fa142914049bfab3c5a1cf20d3b/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:44.560804 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99191901-15ed-4e0c-88c1-e74995944045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df473b52c6fa49ec899902996369b6e0, user_id=62a50fa142914049bfab3c5a1cf20d3b, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:44.562086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99191901-15ed-4e0c-88c1-e74995944045 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:44.594706 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b71c1e-cda4-4991-9c36-5c1aa31c8066 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:44.595240 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b71c1e-cda4-4991-9c36-5c1aa31c8066 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:44.595590 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b71c1e-cda4-4991-9c36-5c1aa31c8066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:44.614080 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1171/2344] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:52:44 2022] PUT /identity/v3/projects/df473b52c6fa49ec899902996369b6e0/users/62a50fa142914049bfab3c5a1cf20d3b/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:44.635235 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-48b71c1e-cda4-4991-9c36-5c1aa31c8066 None None] MFA Rules not processed for user `282d843b49ac4f8eb74c050ddaf84a36`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:44.637049 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-48b71c1e-cda4-4991-9c36-5c1aa31c8066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:44.772439 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:44.822747 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1174/2345] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:46.323719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99191901-15ed-4e0c-88c1-e74995944045 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:46.327714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-99191901-15ed-4e0c-88c1-e74995944045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:46.463829 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99191901-15ed-4e0c-88c1-e74995944045 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:46.470857 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99a158-a89b-4408-92b2-3e188b2e710e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:46.472005 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99a158-a89b-4408-92b2-3e188b2e710e service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:46.472440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99a158-a89b-4408-92b2-3e188b2e710e service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:46.473539 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99a158-a89b-4408-92b2-3e188b2e710e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:46.476472 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-2b99a158-a89b-4408-92b2-3e188b2e710e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:46.490029 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:46.638641 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99a158-a89b-4408-92b2-3e188b2e710e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:46.642777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99a158-a89b-4408-92b2-3e188b2e710e service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:46.673662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1172/2346] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:52:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:52:52.863040 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde8777-b3e3-424a-bef9-4209ce609f57 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:52.863741 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde8777-b3e3-424a-bef9-4209ce609f57 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:52.864449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde8777-b3e3-424a-bef9-4209ce609f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:52.902537 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-ccde8777-b3e3-424a-bef9-4209ce609f57 None None] MFA Rules not processed for user `62a50fa142914049bfab3c5a1cf20d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:52.903956 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ccde8777-b3e3-424a-bef9-4209ce609f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:53.011688 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1175/2347] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:52:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:53.030453 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99a158-a89b-4408-92b2-3e188b2e710e service cinder] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:53.034062 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-2b99a158-a89b-4408-92b2-3e188b2e710e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:53.220244 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99a158-a89b-4408-92b2-3e188b2e710e service cinder] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:53.242167 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca86af-4b9b-42c9-8f96-f8ee651069e4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbec984d81c84035887220056b3790ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:53.242167 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca86af-4b9b-42c9-8f96-f8ee651069e4 service glance] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:53.242167 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca86af-4b9b-42c9-8f96-f8ee651069e4 service glance] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:53.242167 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca86af-4b9b-42c9-8f96-f8ee651069e4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:53.409101 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca86af-4b9b-42c9-8f96-f8ee651069e4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:53.411499 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca86af-4b9b-42c9-8f96-f8ee651069e4 service glance] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:53.424079 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1173/2348] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:52:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:52:53.756536 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bcc22-3f84-45fb-8e13-0d8eb37e1826 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:53.757276 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bcc22-3f84-45fb-8e13-0d8eb37e1826 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:53.757948 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bcc22-3f84-45fb-8e13-0d8eb37e1826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:53.798580 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-ef0bcc22-3f84-45fb-8e13-0d8eb37e1826 None None] MFA Rules not processed for user `7caa973c63e64d639cc2fb55a4955542`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:53.800955 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ef0bcc22-3f84-45fb-8e13-0d8eb37e1826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:53.998882 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1176/2349] 10.222.0.94 () {58 vars in 1009 bytes} [Wed Aug 24 04:52:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:54.081920 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca86af-4b9b-42c9-8f96-f8ee651069e4 service glance] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:54.083665 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-83ca86af-4b9b-42c9-8f96-f8ee651069e4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:54.226371 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:54.259874 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca86af-4b9b-42c9-8f96-f8ee651069e4 service glance] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:54.267650 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894ce0d-8427-4252-bdc5-582ac4580207 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40d2202203204b06a41e57b9d1a300fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:54.268291 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894ce0d-8427-4252-bdc5-582ac4580207 service swift] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:54.268567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894ce0d-8427-4252-bdc5-582ac4580207 service swift] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:54.268840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894ce0d-8427-4252-bdc5-582ac4580207 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:54.279826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894ce0d-8427-4252-bdc5-582ac4580207 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:54.281985 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894ce0d-8427-4252-bdc5-582ac4580207 service swift] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:54.297433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1174/2350] 10.222.0.94 () {60 vars in 1384 bytes} [Wed Aug 24 04:52:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:53:03.970134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=62 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:04.293547 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=6 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:08.779567 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f63252-6123-4627-b70c-c8b30db60719 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:08.780123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f63252-6123-4627-b70c-c8b30db60719 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:08.780513 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f63252-6123-4627-b70c-c8b30db60719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:08.803179 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-83f63252-6123-4627-b70c-c8b30db60719 None None] MFA Rules not processed for user `8328a82e8eea4f9e9c9229e557f93d65`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:08.806247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-83f63252-6123-4627-b70c-c8b30db60719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:08.815873 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1177/2351] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:53:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:11.707811 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894ce0d-8427-4252-bdc5-582ac4580207 service swift] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:11.709455 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-5894ce0d-8427-4252-bdc5-582ac4580207 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:11.815921 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894ce0d-8427-4252-bdc5-582ac4580207 service swift] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:11.822507 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba154e-203d-4ee6-b3e6-f05be66a3efe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3274d404cb403bbf272ce023aa5e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:11.823136 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba154e-203d-4ee6-b3e6-f05be66a3efe service placement] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:11.823448 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba154e-203d-4ee6-b3e6-f05be66a3efe service placement] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:11.823701 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba154e-203d-4ee6-b3e6-f05be66a3efe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:11.825817 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-5cba154e-203d-4ee6-b3e6-f05be66a3efe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:11.841749 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba154e-203d-4ee6-b3e6-f05be66a3efe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:11.843853 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba154e-203d-4ee6-b3e6-f05be66a3efe service placement] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:11.859889 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1175/2352] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:53:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:53:13.106166 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7106f-f5c6-4249-b7f2-269db4459af6 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:13.106652 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7106f-f5c6-4249-b7f2-269db4459af6 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:13.106761 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7106f-f5c6-4249-b7f2-269db4459af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:13.127897 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-3ea7106f-f5c6-4249-b7f2-269db4459af6 None None] MFA Rules not processed for user `052e427fb0b84fe7b31705fbfb708533`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:13.129031 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-3ea7106f-f5c6-4249-b7f2-269db4459af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:13.192969 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1178/2353] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:53:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:13.946585 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71222b-621e-424f-98f9-db68e9095dc5 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:13.947155 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71222b-621e-424f-98f9-db68e9095dc5 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:13.947347 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71222b-621e-424f-98f9-db68e9095dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:13.978863 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-1f71222b-621e-424f-98f9-db68e9095dc5 None None] MFA Rules not processed for user `7caa973c63e64d639cc2fb55a4955542`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:13.980316 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-1f71222b-621e-424f-98f9-db68e9095dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:13.989167 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1176/2354] 10.222.0.94 () {58 vars in 1009 bytes} [Wed Aug 24 04:53:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:53:14.002119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7106f-f5c6-4249-b7f2-269db4459af6 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:14.020808 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7106f-f5c6-4249-b7f2-269db4459af6 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:14.048514 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afc260-29f6-41d7-ace1-07e56bffedcb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40d2202203204b06a41e57b9d1a300fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:14.049333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afc260-29f6-41d7-ace1-07e56bffedcb service swift] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:14.050692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afc260-29f6-41d7-ace1-07e56bffedcb service swift] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:14.052787 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afc260-29f6-41d7-ace1-07e56bffedcb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:14.070734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18afc260-29f6-41d7-ace1-07e56bffedcb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:14.073577 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18afc260-29f6-41d7-ace1-07e56bffedcb service swift] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:14.096904 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1179/2355] 10.222.0.94 () {60 vars in 1384 bytes} [Wed Aug 24 04:53:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:53:14.685339 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71222b-621e-424f-98f9-db68e9095dc5 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:14.686877 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-1f71222b-621e-424f-98f9-db68e9095dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:14.815162 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71222b-621e-424f-98f9-db68e9095dc5 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:14.821449 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99314c0a-10f0-48de-a40f-109ab0d653d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:14.822108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99314c0a-10f0-48de-a40f-109ab0d653d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:14.822441 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99314c0a-10f0-48de-a40f-109ab0d653d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:14.822710 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99314c0a-10f0-48de-a40f-109ab0d653d3 admin admin] PATH_INFO: `/v3/users/0a5c5a37eb264f34a148ad6418608850` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:14.824214 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99314c0a-10f0-48de-a40f-109ab0d653d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a5c5a37eb264f34a148ad6418608850)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:14.826425 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99314c0a-10f0-48de-a40f-109ab0d653d3 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:14.910587 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-99314c0a-10f0-48de-a40f-109ab0d653d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a5c5a37eb264f34a148ad6418608850'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:14.911279 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-99314c0a-10f0-48de-a40f-109ab0d653d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a5c5a37eb264f34a148ad6418608850'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:14.923286 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-99314c0a-10f0-48de-a40f-109ab0d653d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a5c5a37eb264f34a148ad6418608850'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:14.945566 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-99314c0a-10f0-48de-a40f-109ab0d653d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a5c5a37eb264f34a148ad6418608850'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:14.954682 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-99314c0a-10f0-48de-a40f-109ab0d653d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a5c5a37eb264f34a148ad6418608850'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:14.961339 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1177/2356] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:53:14 2022] DELETE /identity/v3/users/0a5c5a37eb264f34a148ad6418608850 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:53:15.207628 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afc260-29f6-41d7-ace1-07e56bffedcb service swift] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:15.219226 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afc260-29f6-41d7-ace1-07e56bffedcb service swift] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:15.295248 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a1bf5-25a8-4a41-8c49-0302b5237007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:15.295915 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a1bf5-25a8-4a41-8c49-0302b5237007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:15.296303 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a1bf5-25a8-4a41-8c49-0302b5237007 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:15.296479 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a1bf5-25a8-4a41-8c49-0302b5237007 admin admin] PATH_INFO: `/v3/projects/4d8914ad4a0540919c1e3939f9b93b11` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:15.297700 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a1bf5-25a8-4a41-8c49-0302b5237007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d8914ad4a0540919c1e3939f9b93b11)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:15.299608 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a1bf5-25a8-4a41-8c49-0302b5237007 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:15.349372 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e37a1bf5-25a8-4a41-8c49-0302b5237007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d8914ad4a0540919c1e3939f9b93b11', 'request_id': 'req-e37a1bf5-25a8-4a41-8c49-0302b5237007'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:15.356261 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e37a1bf5-25a8-4a41-8c49-0302b5237007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d8914ad4a0540919c1e3939f9b93b11', 'request_id': 'req-e37a1bf5-25a8-4a41-8c49-0302b5237007'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:15.364172 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e37a1bf5-25a8-4a41-8c49-0302b5237007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d8914ad4a0540919c1e3939f9b93b11', 'request_id': 'req-e37a1bf5-25a8-4a41-8c49-0302b5237007'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:15.376332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e37a1bf5-25a8-4a41-8c49-0302b5237007 admin admin] The token cache is being invalidate because project 4d8914ad4a0540919c1e3939f9b93b11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:53:15.376622 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e37a1bf5-25a8-4a41-8c49-0302b5237007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:15.377297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e37a1bf5-25a8-4a41-8c49-0302b5237007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:15.378820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1180/2357] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:53:15 2022] DELETE /identity/v3/projects/4d8914ad4a0540919c1e3939f9b93b11 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:53:15.383666 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99314c0a-10f0-48de-a40f-109ab0d653d3 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:15.385390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-99314c0a-10f0-48de-a40f-109ab0d653d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:15.394168 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:15.401134 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99314c0a-10f0-48de-a40f-109ab0d653d3 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:15.463427 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7064c0-7fb9-42f0-8a80-d853c0390b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:15.464069 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7064c0-7fb9-42f0-8a80-d853c0390b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:15.464350 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7064c0-7fb9-42f0-8a80-d853c0390b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:15.464630 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7064c0-7fb9-42f0-8a80-d853c0390b35 admin admin] PATH_INFO: `/v3/users/3fc3977823d0450daa0b820dd518cb73` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:15.465824 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7064c0-7fb9-42f0-8a80-d853c0390b35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fc3977823d0450daa0b820dd518cb73)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:15.467755 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7064c0-7fb9-42f0-8a80-d853c0390b35 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:15.526620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-6a7064c0-7fb9-42f0-8a80-d853c0390b35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fc3977823d0450daa0b820dd518cb73'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:15.527290 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-6a7064c0-7fb9-42f0-8a80-d853c0390b35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fc3977823d0450daa0b820dd518cb73'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:15.535510 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-6a7064c0-7fb9-42f0-8a80-d853c0390b35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fc3977823d0450daa0b820dd518cb73'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:15.552636 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-6a7064c0-7fb9-42f0-8a80-d853c0390b35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fc3977823d0450daa0b820dd518cb73'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:15.562710 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-6a7064c0-7fb9-42f0-8a80-d853c0390b35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fc3977823d0450daa0b820dd518cb73'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:15.569745 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1178/2358] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:53:15 2022] DELETE /identity/v3/users/3fc3977823d0450daa0b820dd518cb73 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:53:15.832255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a1bf5-25a8-4a41-8c49-0302b5237007 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:15.834794 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-e37a1bf5-25a8-4a41-8c49-0302b5237007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:15.895367 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a1bf5-25a8-4a41-8c49-0302b5237007 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:15.938697 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:16.047868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06a793-3176-40b5-add0-6b2b397ffe55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:16.048720 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06a793-3176-40b5-add0-6b2b397ffe55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:16.048965 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06a793-3176-40b5-add0-6b2b397ffe55 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:16.049250 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06a793-3176-40b5-add0-6b2b397ffe55 admin admin] PATH_INFO: `/v3/projects/3a74da5fd24d4bf39d580ce0d7165fbf` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:16.052871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06a793-3176-40b5-add0-6b2b397ffe55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a74da5fd24d4bf39d580ce0d7165fbf)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:16.055830 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06a793-3176-40b5-add0-6b2b397ffe55 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:16.112101 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-0f06a793-3176-40b5-add0-6b2b397ffe55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a74da5fd24d4bf39d580ce0d7165fbf', 'request_id': 'req-0f06a793-3176-40b5-add0-6b2b397ffe55'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:16.120046 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-0f06a793-3176-40b5-add0-6b2b397ffe55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a74da5fd24d4bf39d580ce0d7165fbf', 'request_id': 'req-0f06a793-3176-40b5-add0-6b2b397ffe55'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:16.130110 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-0f06a793-3176-40b5-add0-6b2b397ffe55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a74da5fd24d4bf39d580ce0d7165fbf', 'request_id': 'req-0f06a793-3176-40b5-add0-6b2b397ffe55'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:16.144198 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-0f06a793-3176-40b5-add0-6b2b397ffe55 admin admin] The token cache is being invalidate because project 3a74da5fd24d4bf39d580ce0d7165fbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:53:16.144477 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-0f06a793-3176-40b5-add0-6b2b397ffe55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:16.145140 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-0f06a793-3176-40b5-add0-6b2b397ffe55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:16.146877 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1181/2359] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:53:15 2022] DELETE /identity/v3/projects/3a74da5fd24d4bf39d580ce0d7165fbf => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:53:16.153275 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e30d57-ccff-4a2c-a619-30cfe3efeb1d None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:16.154327 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e30d57-ccff-4a2c-a619-30cfe3efeb1d None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:16.154916 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e30d57-ccff-4a2c-a619-30cfe3efeb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:16.177449 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-b0e30d57-ccff-4a2c-a619-30cfe3efeb1d None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:16.178763 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-b0e30d57-ccff-4a2c-a619-30cfe3efeb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:16.245506 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1179/2360] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:16.253395 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0527b-b9d1-448c-bf3a-c70fdf25bd10 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:16.254015 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0527b-b9d1-448c-bf3a-c70fdf25bd10 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:16.254117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0527b-b9d1-448c-bf3a-c70fdf25bd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:16.283847 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-39c0527b-b9d1-448c-bf3a-c70fdf25bd10 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:16.285943 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-39c0527b-b9d1-448c-bf3a-c70fdf25bd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:16.302425 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1182/2361] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:16.304513 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e30d57-ccff-4a2c-a619-30cfe3efeb1d None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:16.325091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e30d57-ccff-4a2c-a619-30cfe3efeb1d None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:16.336205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09433c-2672-4f57-b7e5-493e56984649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:16.336833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09433c-2672-4f57-b7e5-493e56984649 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:16.337118 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09433c-2672-4f57-b7e5-493e56984649 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:16.337383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09433c-2672-4f57-b7e5-493e56984649 admin admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:16.338165 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09433c-2672-4f57-b7e5-493e56984649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:53:16.338383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09433c-2672-4f57-b7e5-493e56984649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:16.340034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09433c-2672-4f57-b7e5-493e56984649 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:16.356830 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1180/2362] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:53:16.359909 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0527b-b9d1-448c-bf3a-c70fdf25bd10 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:16.370708 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0527b-b9d1-448c-bf3a-c70fdf25bd10 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:16.375900 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95a3a2-60b4-40a2-8c4a-1708346ca3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:16.376527 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95a3a2-60b4-40a2-8c4a-1708346ca3eb admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:16.376843 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95a3a2-60b4-40a2-8c4a-1708346ca3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:16.377083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95a3a2-60b4-40a2-8c4a-1708346ca3eb admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:16.377840 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95a3a2-60b4-40a2-8c4a-1708346ca3eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:16.379640 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95a3a2-60b4-40a2-8c4a-1708346ca3eb admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:16.434297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1183/2363] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:53:16 2022] POST /identity/v3/projects => generated 367 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:16.436469 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09433c-2672-4f57-b7e5-493e56984649 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:16.452228 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09433c-2672-4f57-b7e5-493e56984649 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:16.458690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:16.541318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd03b3-eea6-4144-9e1e-49447083d051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:16.542218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd03b3-eea6-4144-9e1e-49447083d051 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:16.542661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd03b3-eea6-4144-9e1e-49447083d051 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:16.543216 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd03b3-eea6-4144-9e1e-49447083d051 admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:16.544318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd03b3-eea6-4144-9e1e-49447083d051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:16.548194 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd03b3-eea6-4144-9e1e-49447083d051 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:16.580474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1181/2364] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:53:16 2022] POST /identity/v3/users => generated 284 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:16.585582 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95a3a2-60b4-40a2-8c4a-1708346ca3eb admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:16.597261 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95a3a2-60b4-40a2-8c4a-1708346ca3eb admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:16.604589 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6a2a2-377f-4545-b412-4946a73baeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:16.605323 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6a2a2-377f-4545-b412-4946a73baeff admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:16.605649 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6a2a2-377f-4545-b412-4946a73baeff admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:16.605931 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6a2a2-377f-4545-b412-4946a73baeff admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:16.606749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6a2a2-377f-4545-b412-4946a73baeff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:16.608221 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6a2a2-377f-4545-b412-4946a73baeff admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:16.625423 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1184/2365] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:53:16.627144 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd03b3-eea6-4144-9e1e-49447083d051 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:16.638809 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd03b3-eea6-4144-9e1e-49447083d051 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:16.644701 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde39047-e01f-4a38-93d0-ad42d618c7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:16.645308 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde39047-e01f-4a38-93d0-ad42d618c7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:16.645612 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde39047-e01f-4a38-93d0-ad42d618c7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:16.645892 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde39047-e01f-4a38-93d0-ad42d618c7f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:16.646544 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde39047-e01f-4a38-93d0-ad42d618c7f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:16.648924 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde39047-e01f-4a38-93d0-ad42d618c7f7 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:16.673011 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1182/2366] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:53:16.673620 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6a2a2-377f-4545-b412-4946a73baeff admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:16.698174 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6a2a2-377f-4545-b412-4946a73baeff admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:16.703931 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064cda5-daba-4e66-970d-b3adda6ca969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:16.704701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064cda5-daba-4e66-970d-b3adda6ca969 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:16.705099 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064cda5-daba-4e66-970d-b3adda6ca969 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:16.705620 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064cda5-daba-4e66-970d-b3adda6ca969 admin admin] PATH_INFO: `/v3/projects/998021f2522e4a07b1dfcfc4db752147/users/5be3f35760c64408b63fa3d7db9b2691/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:16.734567 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064cda5-daba-4e66-970d-b3adda6ca969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=998021f2522e4a07b1dfcfc4db752147, user_id=5be3f35760c64408b63fa3d7db9b2691, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:16.737842 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064cda5-daba-4e66-970d-b3adda6ca969 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:16.754551 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1185/2367] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:53:16 2022] PUT /identity/v3/projects/998021f2522e4a07b1dfcfc4db752147/users/5be3f35760c64408b63fa3d7db9b2691/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:53:16.766093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9025e47-10c9-4174-a52f-d7d8ec314251 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:16.766443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9025e47-10c9-4174-a52f-d7d8ec314251 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:16.766736 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9025e47-10c9-4174-a52f-d7d8ec314251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:16.811483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-f9025e47-10c9-4174-a52f-d7d8ec314251 None None] MFA Rules not processed for user `5be3f35760c64408b63fa3d7db9b2691`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:16.812758 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-f9025e47-10c9-4174-a52f-d7d8ec314251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:16.937244 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1183/2368] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:53:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:53:16.950526 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064cda5-daba-4e66-970d-b3adda6ca969 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:16.957376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-6064cda5-daba-4e66-970d-b3adda6ca969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:17.035449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:17.055209 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064cda5-daba-4e66-970d-b3adda6ca969 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:17.059213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3810b8f-8cbc-47b7-80e8-b591658e6035 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbec984d81c84035887220056b3790ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:17.059952 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3810b8f-8cbc-47b7-80e8-b591658e6035 service glance] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:17.060173 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3810b8f-8cbc-47b7-80e8-b591658e6035 service glance] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:17.060434 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3810b8f-8cbc-47b7-80e8-b591658e6035 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:17.070765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3810b8f-8cbc-47b7-80e8-b591658e6035 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:17.072244 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3810b8f-8cbc-47b7-80e8-b591658e6035 service glance] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:17.082931 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1186/2369] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:53:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:53:26.934411 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=62,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:27.078180 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=7 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:37.703003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80f1e3-b0ce-4d6f-a837-c0366844cc6d None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:37.703527 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80f1e3-b0ce-4d6f-a837-c0366844cc6d None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:37.703653 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80f1e3-b0ce-4d6f-a837-c0366844cc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:37.725490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-8f80f1e3-b0ce-4d6f-a837-c0366844cc6d None None] MFA Rules not processed for user `7caa973c63e64d639cc2fb55a4955542`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:37.726809 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-8f80f1e3-b0ce-4d6f-a837-c0366844cc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:37.789776 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1184/2370] 10.222.0.94 () {58 vars in 1009 bytes} [Wed Aug 24 04:53:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:37.803282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3810b8f-8cbc-47b7-80e8-b591658e6035 service glance] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:37.805174 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-f3810b8f-8cbc-47b7-80e8-b591658e6035 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:37.890284 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3810b8f-8cbc-47b7-80e8-b591658e6035 service glance] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:37.898160 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a518adf-8bd5-436e-a4f5-0369de1c81a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40d2202203204b06a41e57b9d1a300fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:37.898663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a518adf-8bd5-436e-a4f5-0369de1c81a8 service swift] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:37.898945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a518adf-8bd5-436e-a4f5-0369de1c81a8 service swift] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:37.899218 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a518adf-8bd5-436e-a4f5-0369de1c81a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:37.909351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a518adf-8bd5-436e-a4f5-0369de1c81a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:37.911007 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a518adf-8bd5-436e-a4f5-0369de1c81a8 service swift] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:37.922934 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1187/2371] 10.222.0.94 () {60 vars in 1384 bytes} [Wed Aug 24 04:53:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 04:53:47.781916 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=25 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:47.918856 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=32 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:52.261421 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80f1e3-b0ce-4d6f-a837-c0366844cc6d None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:52.366068 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80f1e3-b0ce-4d6f-a837-c0366844cc6d None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:52.374104 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d948d-a75d-4306-a03b-987507377821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:52.374432 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d948d-a75d-4306-a03b-987507377821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:52.374786 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d948d-a75d-4306-a03b-987507377821 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:52.374951 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d948d-a75d-4306-a03b-987507377821 admin admin] PATH_INFO: `/v3/users/5be3f35760c64408b63fa3d7db9b2691` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:52.376150 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d948d-a75d-4306-a03b-987507377821 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5be3f35760c64408b63fa3d7db9b2691)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:52.378294 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d948d-a75d-4306-a03b-987507377821 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:52.462322 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-075d948d-a75d-4306-a03b-987507377821 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5be3f35760c64408b63fa3d7db9b2691'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:52.463087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-075d948d-a75d-4306-a03b-987507377821 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5be3f35760c64408b63fa3d7db9b2691'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:52.474699 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-075d948d-a75d-4306-a03b-987507377821 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5be3f35760c64408b63fa3d7db9b2691'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:52.518166 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-075d948d-a75d-4306-a03b-987507377821 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5be3f35760c64408b63fa3d7db9b2691'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:52.538887 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-075d948d-a75d-4306-a03b-987507377821 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5be3f35760c64408b63fa3d7db9b2691'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:52.557311 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1185/2372] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:53:52 2022] DELETE /identity/v3/users/5be3f35760c64408b63fa3d7db9b2691 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:53:52.562688 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee810792-ceee-47a2-bccd-2e673c7b5278 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:52.563360 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee810792-ceee-47a2-bccd-2e673c7b5278 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:52.563360 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee810792-ceee-47a2-bccd-2e673c7b5278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:52.613283 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-ee810792-ceee-47a2-bccd-2e673c7b5278 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:52.626033 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ee810792-ceee-47a2-bccd-2e673c7b5278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:52.872330 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1188/2373] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:52.895595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d948d-a75d-4306-a03b-987507377821 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:52.898834 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-075d948d-a75d-4306-a03b-987507377821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:53.008931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d948d-a75d-4306-a03b-987507377821 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:53.014373 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993acec-38c7-4db7-b3d5-433f3bb63074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:53.015223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993acec-38c7-4db7-b3d5-433f3bb63074 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:53.015548 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993acec-38c7-4db7-b3d5-433f3bb63074 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:53.015794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993acec-38c7-4db7-b3d5-433f3bb63074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:53.030236 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993acec-38c7-4db7-b3d5-433f3bb63074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:53.031719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993acec-38c7-4db7-b3d5-433f3bb63074 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:53.050313 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1186/2374] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:53:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:53:53.497076 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee810792-ceee-47a2-bccd-2e673c7b5278 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:53.500832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ee810792-ceee-47a2-bccd-2e673c7b5278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:53.531159 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee810792-ceee-47a2-bccd-2e673c7b5278 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:53.539179 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901d490-d9e3-457d-ab74-697362993d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:53.540376 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901d490-d9e3-457d-ab74-697362993d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:53.540920 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901d490-d9e3-457d-ab74-697362993d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:53.541292 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901d490-d9e3-457d-ab74-697362993d4a admin admin] PATH_INFO: `/v3/projects/998021f2522e4a07b1dfcfc4db752147` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:53.543169 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1901d490-d9e3-457d-ab74-697362993d4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=998021f2522e4a07b1dfcfc4db752147)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:53.546989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1901d490-d9e3-457d-ab74-697362993d4a admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:53.732474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-1901d490-d9e3-457d-ab74-697362993d4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '998021f2522e4a07b1dfcfc4db752147', 'request_id': 'req-1901d490-d9e3-457d-ab74-697362993d4a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:53.750160 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-1901d490-d9e3-457d-ab74-697362993d4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '998021f2522e4a07b1dfcfc4db752147', 'request_id': 'req-1901d490-d9e3-457d-ab74-697362993d4a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:53.768516 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-1901d490-d9e3-457d-ab74-697362993d4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '998021f2522e4a07b1dfcfc4db752147', 'request_id': 'req-1901d490-d9e3-457d-ab74-697362993d4a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:53.801342 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-1901d490-d9e3-457d-ab74-697362993d4a admin admin] The token cache is being invalidate because project 998021f2522e4a07b1dfcfc4db752147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:53:53.802410 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-1901d490-d9e3-457d-ab74-697362993d4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:53.803726 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-1901d490-d9e3-457d-ab74-697362993d4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:53.806180 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1189/2375] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:53:53 2022] DELETE /identity/v3/projects/998021f2522e4a07b1dfcfc4db752147 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:53:56.450113 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993acec-38c7-4db7-b3d5-433f3bb63074 service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:56.453599 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-3993acec-38c7-4db7-b3d5-433f3bb63074 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:56.470624 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993acec-38c7-4db7-b3d5-433f3bb63074 service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:56.529344 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:56.601904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58e2a1-0a18-453d-96c3-56e6781c64e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:56.601904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58e2a1-0a18-453d-96c3-56e6781c64e6 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:56.601904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58e2a1-0a18-453d-96c3-56e6781c64e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:56.601904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58e2a1-0a18-453d-96c3-56e6781c64e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:56.603534 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-ec58e2a1-0a18-453d-96c3-56e6781c64e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:56.743413 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58e2a1-0a18-453d-96c3-56e6781c64e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:56.745253 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58e2a1-0a18-453d-96c3-56e6781c64e6 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:56.758296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1187/2376] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:53:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:53:58.429141 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e380780-a6bd-4a96-923f-14926667a69a None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:58.429141 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e380780-a6bd-4a96-923f-14926667a69a None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:58.429141 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e380780-a6bd-4a96-923f-14926667a69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:58.451258 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-7e380780-a6bd-4a96-923f-14926667a69a None None] MFA Rules not processed for user `7caa973c63e64d639cc2fb55a4955542`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:58.452518 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-7e380780-a6bd-4a96-923f-14926667a69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:58.514507 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1190/2377] 10.222.0.94 () {58 vars in 967 bytes} [Wed Aug 24 04:53:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:58.530122 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58e2a1-0a18-453d-96c3-56e6781c64e6 service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:58.532098 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-ec58e2a1-0a18-453d-96c3-56e6781c64e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:58.608312 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58e2a1-0a18-453d-96c3-56e6781c64e6 service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:58.613766 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0ce72-f9c9-4602-a3b6-c1a544b761d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40d2202203204b06a41e57b9d1a300fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:58.614897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0ce72-f9c9-4602-a3b6-c1a544b761d4 service swift] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:58.615263 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0ce72-f9c9-4602-a3b6-c1a544b761d4 service swift] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:58.615541 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0ce72-f9c9-4602-a3b6-c1a544b761d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:58.624603 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0ce72-f9c9-4602-a3b6-c1a544b761d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:58.626220 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0ce72-f9c9-4602-a3b6-c1a544b761d4 service swift] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:58.636100 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1188/2378] 10.222.0.94 () {60 vars in 1384 bytes} [Wed Aug 24 04:53:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 04:54:01.032984 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e380780-a6bd-4a96-923f-14926667a69a None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:01.034770 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-7e380780-a6bd-4a96-923f-14926667a69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:01.071760 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:01.128867 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e380780-a6bd-4a96-923f-14926667a69a None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:01.137658 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd1505-39c9-455c-a831-23e7535a4ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:01.138573 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd1505-39c9-455c-a831-23e7535a4ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:01.139034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd1505-39c9-455c-a831-23e7535a4ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:01.139494 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd1505-39c9-455c-a831-23e7535a4ba6 admin admin] PATH_INFO: `/v3/users/282d843b49ac4f8eb74c050ddaf84a36` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:01.141287 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd1505-39c9-455c-a831-23e7535a4ba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=282d843b49ac4f8eb74c050ddaf84a36)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:01.143799 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd1505-39c9-455c-a831-23e7535a4ba6 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:01.210196 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-86dd1505-39c9-455c-a831-23e7535a4ba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '282d843b49ac4f8eb74c050ddaf84a36'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:01.221036 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-86dd1505-39c9-455c-a831-23e7535a4ba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '282d843b49ac4f8eb74c050ddaf84a36'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:01.231016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-86dd1505-39c9-455c-a831-23e7535a4ba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '282d843b49ac4f8eb74c050ddaf84a36'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:01.231923 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-86dd1505-39c9-455c-a831-23e7535a4ba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '282d843b49ac4f8eb74c050ddaf84a36'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:01.248165 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-86dd1505-39c9-455c-a831-23e7535a4ba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '282d843b49ac4f8eb74c050ddaf84a36'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:01.257695 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1191/2379] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:01 2022] DELETE /identity/v3/users/282d843b49ac4f8eb74c050ddaf84a36 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:01.469967 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0ce72-f9c9-4602-a3b6-c1a544b761d4 service swift] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:01.487763 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0ce72-f9c9-4602-a3b6-c1a544b761d4 service swift] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:01.575591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1316255-2cfb-4fff-b7f6-3bf7a87d5d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:01.576387 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1316255-2cfb-4fff-b7f6-3bf7a87d5d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:01.576745 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1316255-2cfb-4fff-b7f6-3bf7a87d5d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:01.577117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1316255-2cfb-4fff-b7f6-3bf7a87d5d67 admin admin] PATH_INFO: `/v3/projects/0d3d354feef04653b990bcbb83f2d46e` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:01.579079 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1316255-2cfb-4fff-b7f6-3bf7a87d5d67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d3d354feef04653b990bcbb83f2d46e)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:01.581920 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1316255-2cfb-4fff-b7f6-3bf7a87d5d67 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:01.586736 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:01.664609 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a1316255-2cfb-4fff-b7f6-3bf7a87d5d67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d3d354feef04653b990bcbb83f2d46e', 'request_id': 'req-a1316255-2cfb-4fff-b7f6-3bf7a87d5d67'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:01.673706 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a1316255-2cfb-4fff-b7f6-3bf7a87d5d67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d3d354feef04653b990bcbb83f2d46e', 'request_id': 'req-a1316255-2cfb-4fff-b7f6-3bf7a87d5d67'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:01.697040 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a1316255-2cfb-4fff-b7f6-3bf7a87d5d67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d3d354feef04653b990bcbb83f2d46e', 'request_id': 'req-a1316255-2cfb-4fff-b7f6-3bf7a87d5d67'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:01.708911 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a1316255-2cfb-4fff-b7f6-3bf7a87d5d67 admin admin] The token cache is being invalidate because project 0d3d354feef04653b990bcbb83f2d46e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:01.709498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a1316255-2cfb-4fff-b7f6-3bf7a87d5d67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:01.710367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a1316255-2cfb-4fff-b7f6-3bf7a87d5d67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:01.716317 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1189/2380] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:01 2022] DELETE /identity/v3/projects/0d3d354feef04653b990bcbb83f2d46e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:01.720217 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fefba-9693-49ea-89cf-d803450c3889 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:01.720509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fefba-9693-49ea-89cf-d803450c3889 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:01.720795 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fefba-9693-49ea-89cf-d803450c3889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:01.745174 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-035fefba-9693-49ea-89cf-d803450c3889 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:01.746603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-035fefba-9693-49ea-89cf-d803450c3889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:01.832669 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1192/2381] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:01.840259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681121af-3569-4116-aec1-66ad21272b2a None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:01.840749 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681121af-3569-4116-aec1-66ad21272b2a None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:01.841090 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681121af-3569-4116-aec1-66ad21272b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:01.866605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-681121af-3569-4116-aec1-66ad21272b2a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:01.874414 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-681121af-3569-4116-aec1-66ad21272b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:01.885035 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1190/2382] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:01.890501 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fefba-9693-49ea-89cf-d803450c3889 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:01.909451 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fefba-9693-49ea-89cf-d803450c3889 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:01.921007 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf5c16-de90-4f95-a821-fd5041779a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:01.922614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf5c16-de90-4f95-a821-fd5041779a4c admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:01.922614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf5c16-de90-4f95-a821-fd5041779a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:01.922614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf5c16-de90-4f95-a821-fd5041779a4c admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:01.923672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf5c16-de90-4f95-a821-fd5041779a4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:54:01.923990 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf5c16-de90-4f95-a821-fd5041779a4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:01.928068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf5c16-de90-4f95-a821-fd5041779a4c admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:01.943930 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1193/2383] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:54:01.948604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681121af-3569-4116-aec1-66ad21272b2a None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:01.958559 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681121af-3569-4116-aec1-66ad21272b2a None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:01.964589 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49dcd1b-aa07-4291-8d84-82f738d9621d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:01.965693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dcd1b-aa07-4291-8d84-82f738d9621d admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:01.966202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dcd1b-aa07-4291-8d84-82f738d9621d admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:01.966737 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dcd1b-aa07-4291-8d84-82f738d9621d admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:01.967879 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49dcd1b-aa07-4291-8d84-82f738d9621d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:01.970699 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49dcd1b-aa07-4291-8d84-82f738d9621d admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:02.004111 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1191/2384] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:01 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:02.008520 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf5c16-de90-4f95-a821-fd5041779a4c admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:02.019453 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf5c16-de90-4f95-a821-fd5041779a4c admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:02.055260 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:02.084000 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94be6d-2837-4d20-8ae5-269b6f7340ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:02.084749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94be6d-2837-4d20-8ae5-269b6f7340ce admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:02.084901 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94be6d-2837-4d20-8ae5-269b6f7340ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:02.085145 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94be6d-2837-4d20-8ae5-269b6f7340ce admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:02.085821 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94be6d-2837-4d20-8ae5-269b6f7340ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:02.087726 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94be6d-2837-4d20-8ae5-269b6f7340ce admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:02.111246 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1194/2385] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:02 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:02.116114 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49dcd1b-aa07-4291-8d84-82f738d9621d admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:02.127521 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49dcd1b-aa07-4291-8d84-82f738d9621d admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:02.133293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e3462-9428-4e7d-a957-016d69e94cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:02.133922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e3462-9428-4e7d-a957-016d69e94cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:02.134195 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e3462-9428-4e7d-a957-016d69e94cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:02.134467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e3462-9428-4e7d-a957-016d69e94cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:02.135142 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e3462-9428-4e7d-a957-016d69e94cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:02.136690 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e3462-9428-4e7d-a957-016d69e94cc7 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:02.147590 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1192/2386] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:02.151800 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94be6d-2837-4d20-8ae5-269b6f7340ce admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:02.162805 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94be6d-2837-4d20-8ae5-269b6f7340ce admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:02.167708 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a272eb3-8775-45fc-ac76-263e47a88efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:02.168323 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a272eb3-8775-45fc-ac76-263e47a88efc admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:02.168605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a272eb3-8775-45fc-ac76-263e47a88efc admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:02.168880 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a272eb3-8775-45fc-ac76-263e47a88efc admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:02.169568 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a272eb3-8775-45fc-ac76-263e47a88efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:02.171201 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a272eb3-8775-45fc-ac76-263e47a88efc admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:02.183399 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1195/2387] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:02.187564 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e3462-9428-4e7d-a957-016d69e94cc7 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:02.199732 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e3462-9428-4e7d-a957-016d69e94cc7 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:02.205705 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8482b-b640-4861-a622-650656a9f89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:02.206686 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8482b-b640-4861-a622-650656a9f89c admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:02.206811 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8482b-b640-4861-a622-650656a9f89c admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:02.207039 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8482b-b640-4861-a622-650656a9f89c admin admin] PATH_INFO: `/v3/projects/9e1b39840172444da03411c964ad7696/users/dffd7cd4c9d34800b6eba8e5b2351957/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:02.224160 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8482b-b640-4861-a622-650656a9f89c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e1b39840172444da03411c964ad7696, user_id=dffd7cd4c9d34800b6eba8e5b2351957, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:02.226822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8482b-b640-4861-a622-650656a9f89c admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:02.241926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1193/2388] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:02 2022] PUT /identity/v3/projects/9e1b39840172444da03411c964ad7696/users/dffd7cd4c9d34800b6eba8e5b2351957/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:02.252708 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8597024-70c0-4753-a4ee-e0ddfa9daeea None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:02.252975 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8597024-70c0-4753-a4ee-e0ddfa9daeea None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:02.253251 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8597024-70c0-4753-a4ee-e0ddfa9daeea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:02.284383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-c8597024-70c0-4753-a4ee-e0ddfa9daeea None None] MFA Rules not processed for user `dffd7cd4c9d34800b6eba8e5b2351957`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:02.285642 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-c8597024-70c0-4753-a4ee-e0ddfa9daeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:02.358772 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1196/2389] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:54:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:02.372057 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8482b-b640-4861-a622-650656a9f89c admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:02.373879 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-afa8482b-b640-4861-a622-650656a9f89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:02.445705 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8482b-b640-4861-a622-650656a9f89c admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:02.449746 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc31ea0-c4a9-44ca-85d1-94209cef886d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbec984d81c84035887220056b3790ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:02.450623 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc31ea0-c4a9-44ca-85d1-94209cef886d service glance] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:02.450947 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc31ea0-c4a9-44ca-85d1-94209cef886d service glance] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:02.451253 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc31ea0-c4a9-44ca-85d1-94209cef886d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:02.461444 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc31ea0-c4a9-44ca-85d1-94209cef886d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:02.462922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc31ea0-c4a9-44ca-85d1-94209cef886d service glance] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:02.473029 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1194/2390] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:12.355809 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=50,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:12.468428 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:35.822826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8597024-70c0-4753-a4ee-e0ddfa9daeea None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:35.887176 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8597024-70c0-4753-a4ee-e0ddfa9daeea None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:35.891834 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7ce74-510a-44ca-946b-bc29d9f2604b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:35.892475 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7ce74-510a-44ca-946b-bc29d9f2604b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:35.892754 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7ce74-510a-44ca-946b-bc29d9f2604b admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:35.893021 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7ce74-510a-44ca-946b-bc29d9f2604b admin admin] PATH_INFO: `/v3/users/dffd7cd4c9d34800b6eba8e5b2351957` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:35.895127 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7ce74-510a-44ca-946b-bc29d9f2604b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dffd7cd4c9d34800b6eba8e5b2351957)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:35.897059 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7ce74-510a-44ca-946b-bc29d9f2604b admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:35.945208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-5ea7ce74-510a-44ca-946b-bc29d9f2604b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dffd7cd4c9d34800b6eba8e5b2351957'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:35.953876 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-5ea7ce74-510a-44ca-946b-bc29d9f2604b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dffd7cd4c9d34800b6eba8e5b2351957'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:35.961978 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-5ea7ce74-510a-44ca-946b-bc29d9f2604b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dffd7cd4c9d34800b6eba8e5b2351957'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:35.962627 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-5ea7ce74-510a-44ca-946b-bc29d9f2604b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dffd7cd4c9d34800b6eba8e5b2351957'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:35.975642 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-5ea7ce74-510a-44ca-946b-bc29d9f2604b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dffd7cd4c9d34800b6eba8e5b2351957'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:35.981602 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1197/2391] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:35 2022] DELETE /identity/v3/users/dffd7cd4c9d34800b6eba8e5b2351957 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:35.986252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bc639-6368-4326-ae6f-5a679813a7a0 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:35.986945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bc639-6368-4326-ae6f-5a679813a7a0 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:35.986945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bc639-6368-4326-ae6f-5a679813a7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:36.007176 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-a38bc639-6368-4326-ae6f-5a679813a7a0 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:36.008420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-a38bc639-6368-4326-ae6f-5a679813a7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:36.069081 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1195/2392] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:36.078996 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7ce74-510a-44ca-946b-bc29d9f2604b admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:36.080449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-5ea7ce74-510a-44ca-946b-bc29d9f2604b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:36.139797 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7ce74-510a-44ca-946b-bc29d9f2604b admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:36.144305 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d936a-6f22-462e-b513-d999d25d399e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:36.144914 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d936a-6f22-462e-b513-d999d25d399e service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:36.145192 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d936a-6f22-462e-b513-d999d25d399e service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:36.145491 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d936a-6f22-462e-b513-d999d25d399e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:36.155727 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d936a-6f22-462e-b513-d999d25d399e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:36.157166 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d936a-6f22-462e-b513-d999d25d399e service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:36.167777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1198/2393] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:36.455252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bc639-6368-4326-ae6f-5a679813a7a0 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:36.457130 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-a38bc639-6368-4326-ae6f-5a679813a7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:36.470827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bc639-6368-4326-ae6f-5a679813a7a0 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:36.479809 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0018b-5581-4141-864b-cd083c3c21e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:36.480671 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0018b-5581-4141-864b-cd083c3c21e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:36.481158 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0018b-5581-4141-864b-cd083c3c21e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:36.481649 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0018b-5581-4141-864b-cd083c3c21e2 admin admin] PATH_INFO: `/v3/projects/9e1b39840172444da03411c964ad7696` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:36.486968 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0018b-5581-4141-864b-cd083c3c21e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e1b39840172444da03411c964ad7696)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:36.489692 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0018b-5581-4141-864b-cd083c3c21e2 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:36.546660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-45c0018b-5581-4141-864b-cd083c3c21e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e1b39840172444da03411c964ad7696', 'request_id': 'req-45c0018b-5581-4141-864b-cd083c3c21e2'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:36.553989 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-45c0018b-5581-4141-864b-cd083c3c21e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e1b39840172444da03411c964ad7696', 'request_id': 'req-45c0018b-5581-4141-864b-cd083c3c21e2'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:36.564020 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-45c0018b-5581-4141-864b-cd083c3c21e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e1b39840172444da03411c964ad7696', 'request_id': 'req-45c0018b-5581-4141-864b-cd083c3c21e2'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:36.585809 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-45c0018b-5581-4141-864b-cd083c3c21e2 admin admin] The token cache is being invalidate because project 9e1b39840172444da03411c964ad7696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:36.586307 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-45c0018b-5581-4141-864b-cd083c3c21e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:36.587379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-45c0018b-5581-4141-864b-cd083c3c21e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:36.590020 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1196/2394] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:36 2022] DELETE /identity/v3/projects/9e1b39840172444da03411c964ad7696 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:36.595242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ac4f-07a1-4b5d-9169-c01e65b543dd None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:36.595575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ac4f-07a1-4b5d-9169-c01e65b543dd None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:36.595852 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ac4f-07a1-4b5d-9169-c01e65b543dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:36.620039 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-1475ac4f-07a1-4b5d-9169-c01e65b543dd None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:36.621282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-1475ac4f-07a1-4b5d-9169-c01e65b543dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:36.639711 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:36.691027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1199/2395] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:36.699257 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e3ac4-fd9a-4ea0-a0cf-8503918f4b8a None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:36.699585 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e3ac4-fd9a-4ea0-a0cf-8503918f4b8a None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:36.699914 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e3ac4-fd9a-4ea0-a0cf-8503918f4b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:36.724664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-f27e3ac4-fd9a-4ea0-a0cf-8503918f4b8a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:36.726083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-f27e3ac4-fd9a-4ea0-a0cf-8503918f4b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:36.734828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1197/2396] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:36.740461 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475ac4f-07a1-4b5d-9169-c01e65b543dd None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:36.752697 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475ac4f-07a1-4b5d-9169-c01e65b543dd None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:36.757559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dced26-0560-44d3-8f0c-58e8d24833c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:36.758262 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dced26-0560-44d3-8f0c-58e8d24833c2 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:36.758524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dced26-0560-44d3-8f0c-58e8d24833c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:36.758798 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dced26-0560-44d3-8f0c-58e8d24833c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:36.759456 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dced26-0560-44d3-8f0c-58e8d24833c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:54:36.759757 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dced26-0560-44d3-8f0c-58e8d24833c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:36.761450 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dced26-0560-44d3-8f0c-58e8d24833c2 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:36.774810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1200/2397] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:54:36.779285 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e3ac4-fd9a-4ea0-a0cf-8503918f4b8a None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:36.790966 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e3ac4-fd9a-4ea0-a0cf-8503918f4b8a None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:36.796340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde6d42-b34f-450c-971a-774724e64ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:36.797023 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde6d42-b34f-450c-971a-774724e64ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:36.797241 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde6d42-b34f-450c-971a-774724e64ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:36.797545 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde6d42-b34f-450c-971a-774724e64ff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:36.798176 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde6d42-b34f-450c-971a-774724e64ff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:36.800996 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde6d42-b34f-450c-971a-774724e64ff9 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:36.832336 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1198/2398] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:36 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:54:36.836706 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dced26-0560-44d3-8f0c-58e8d24833c2 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:36.848669 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dced26-0560-44d3-8f0c-58e8d24833c2 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:36.911294 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6320a3d-7aaa-4b5c-aa39-4cf214cbfdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:36.911994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6320a3d-7aaa-4b5c-aa39-4cf214cbfdce admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:36.912362 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6320a3d-7aaa-4b5c-aa39-4cf214cbfdce admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:36.912690 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6320a3d-7aaa-4b5c-aa39-4cf214cbfdce admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:36.913423 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6320a3d-7aaa-4b5c-aa39-4cf214cbfdce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:36.915755 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6320a3d-7aaa-4b5c-aa39-4cf214cbfdce admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:36.939664 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1201/2399] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:36 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:36.944520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde6d42-b34f-450c-971a-774724e64ff9 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:36.957701 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde6d42-b34f-450c-971a-774724e64ff9 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:36.972530 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65d845-7e0d-491f-9f20-23a969128a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:36.975914 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65d845-7e0d-491f-9f20-23a969128a73 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:36.976202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65d845-7e0d-491f-9f20-23a969128a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:36.976478 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65d845-7e0d-491f-9f20-23a969128a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:36.977165 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65d845-7e0d-491f-9f20-23a969128a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:36.978891 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65d845-7e0d-491f-9f20-23a969128a73 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:36.990493 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1199/2400] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:36.994625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6320a3d-7aaa-4b5c-aa39-4cf214cbfdce admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:37.005833 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6320a3d-7aaa-4b5c-aa39-4cf214cbfdce admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:37.010597 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecad754-d8d2-447e-b260-e5338166f64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:37.011208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecad754-d8d2-447e-b260-e5338166f64d admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:37.011596 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecad754-d8d2-447e-b260-e5338166f64d admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:37.011837 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecad754-d8d2-447e-b260-e5338166f64d admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:37.012402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecad754-d8d2-447e-b260-e5338166f64d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:37.014059 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecad754-d8d2-447e-b260-e5338166f64d admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:37.027356 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1202/2401] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:37.032658 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65d845-7e0d-491f-9f20-23a969128a73 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:37.045274 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65d845-7e0d-491f-9f20-23a969128a73 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:37.051197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd76307-d9d6-4886-bd1b-6091e37f2ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:37.051799 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd76307-d9d6-4886-bd1b-6091e37f2ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:37.052081 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd76307-d9d6-4886-bd1b-6091e37f2ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:37.052355 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd76307-d9d6-4886-bd1b-6091e37f2ab8 admin admin] PATH_INFO: `/v3/projects/fe41614bd768496a8d1f07259afd7390/users/11f24d22e57e4d048153c01127546021/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:37.069016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd76307-d9d6-4886-bd1b-6091e37f2ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe41614bd768496a8d1f07259afd7390, user_id=11f24d22e57e4d048153c01127546021, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:37.071824 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd76307-d9d6-4886-bd1b-6091e37f2ab8 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:37.087341 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1200/2402] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:37 2022] PUT /identity/v3/projects/fe41614bd768496a8d1f07259afd7390/users/11f24d22e57e4d048153c01127546021/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:37.099100 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cc163-c281-4dd9-a72e-8f5610a8a530 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:37.099402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cc163-c281-4dd9-a72e-8f5610a8a530 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:37.099680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cc163-c281-4dd9-a72e-8f5610a8a530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:37.129028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-657cc163-c281-4dd9-a72e-8f5610a8a530 None None] MFA Rules not processed for user `11f24d22e57e4d048153c01127546021`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:37.130320 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-657cc163-c281-4dd9-a72e-8f5610a8a530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:37.201948 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1203/2403] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:54:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:37.214753 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd76307-d9d6-4886-bd1b-6091e37f2ab8 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:37.216552 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-9fd76307-d9d6-4886-bd1b-6091e37f2ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:37.245171 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:37.291607 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd76307-d9d6-4886-bd1b-6091e37f2ab8 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:37.295660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0799c-0863-4847-9e83-26c78217734f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:37.296290 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0799c-0863-4847-9e83-26c78217734f service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:37.296571 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0799c-0863-4847-9e83-26c78217734f service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:37.296852 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0799c-0863-4847-9e83-26c78217734f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:37.307417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0799c-0863-4847-9e83-26c78217734f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:37.308830 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0799c-0863-4847-9e83-26c78217734f service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:37.320895 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1201/2404] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:47.198907 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:47.314528 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=17 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:47.723974 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cc163-c281-4dd9-a72e-8f5610a8a530 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:47.793359 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cc163-c281-4dd9-a72e-8f5610a8a530 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:47.798444 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd42993-4758-420f-b628-00cdfd24c6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:47.799163 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd42993-4758-420f-b628-00cdfd24c6e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:47.799482 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd42993-4758-420f-b628-00cdfd24c6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:47.799919 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd42993-4758-420f-b628-00cdfd24c6e7 admin admin] PATH_INFO: `/v3/users/11f24d22e57e4d048153c01127546021` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:47.801324 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd42993-4758-420f-b628-00cdfd24c6e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11f24d22e57e4d048153c01127546021)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:47.803492 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd42993-4758-420f-b628-00cdfd24c6e7 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:47.858530 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ecd42993-4758-420f-b628-00cdfd24c6e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11f24d22e57e4d048153c01127546021'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:47.867542 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ecd42993-4758-420f-b628-00cdfd24c6e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11f24d22e57e4d048153c01127546021'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:47.877646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ecd42993-4758-420f-b628-00cdfd24c6e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11f24d22e57e4d048153c01127546021'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:47.878460 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ecd42993-4758-420f-b628-00cdfd24c6e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11f24d22e57e4d048153c01127546021'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:47.891876 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ecd42993-4758-420f-b628-00cdfd24c6e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11f24d22e57e4d048153c01127546021'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:47.899002 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1204/2405] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:47 2022] DELETE /identity/v3/users/11f24d22e57e4d048153c01127546021 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:47.904061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc155f-9e2c-4e5f-a34b-d30796c31250 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:47.904408 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc155f-9e2c-4e5f-a34b-d30796c31250 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:47.904862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc155f-9e2c-4e5f-a34b-d30796c31250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:47.934702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-60bc155f-9e2c-4e5f-a34b-d30796c31250 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:47.936867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-60bc155f-9e2c-4e5f-a34b-d30796c31250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:48.022628 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1202/2406] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:48.032901 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd42993-4758-420f-b628-00cdfd24c6e7 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:48.034458 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ecd42993-4758-420f-b628-00cdfd24c6e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:48.108304 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd42993-4758-420f-b628-00cdfd24c6e7 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:48.112238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f0cb9-bbce-4a38-8cae-32838f3e57e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:48.112909 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f0cb9-bbce-4a38-8cae-32838f3e57e3 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:48.113226 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f0cb9-bbce-4a38-8cae-32838f3e57e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:48.113540 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f0cb9-bbce-4a38-8cae-32838f3e57e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:48.123804 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f0cb9-bbce-4a38-8cae-32838f3e57e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:48.125266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f0cb9-bbce-4a38-8cae-32838f3e57e3 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:48.137269 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1205/2407] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:48.430304 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc155f-9e2c-4e5f-a34b-d30796c31250 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:48.431750 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-60bc155f-9e2c-4e5f-a34b-d30796c31250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:48.449562 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc155f-9e2c-4e5f-a34b-d30796c31250 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:48.461341 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a0a4e-000c-48b6-a457-72cd2218ce47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:48.462068 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a0a4e-000c-48b6-a457-72cd2218ce47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:48.462357 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a0a4e-000c-48b6-a457-72cd2218ce47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:48.462614 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a0a4e-000c-48b6-a457-72cd2218ce47 admin admin] PATH_INFO: `/v3/projects/fe41614bd768496a8d1f07259afd7390` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:48.463804 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a0a4e-000c-48b6-a457-72cd2218ce47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe41614bd768496a8d1f07259afd7390)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:48.465778 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a0a4e-000c-48b6-a457-72cd2218ce47 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:48.519941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-209a0a4e-000c-48b6-a457-72cd2218ce47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe41614bd768496a8d1f07259afd7390', 'request_id': 'req-209a0a4e-000c-48b6-a457-72cd2218ce47'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:48.525699 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-209a0a4e-000c-48b6-a457-72cd2218ce47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe41614bd768496a8d1f07259afd7390', 'request_id': 'req-209a0a4e-000c-48b6-a457-72cd2218ce47'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:48.536577 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-209a0a4e-000c-48b6-a457-72cd2218ce47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe41614bd768496a8d1f07259afd7390', 'request_id': 'req-209a0a4e-000c-48b6-a457-72cd2218ce47'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:48.548765 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-209a0a4e-000c-48b6-a457-72cd2218ce47 admin admin] The token cache is being invalidate because project fe41614bd768496a8d1f07259afd7390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:48.549051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-209a0a4e-000c-48b6-a457-72cd2218ce47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:48.549746 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-209a0a4e-000c-48b6-a457-72cd2218ce47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:48.551546 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1203/2408] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:48 2022] DELETE /identity/v3/projects/fe41614bd768496a8d1f07259afd7390 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:58.132442 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:58.545578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:05.461074 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f0cb9-bbce-4a38-8cae-32838f3e57e3 service neutron] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:05.463168 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-071f0cb9-bbce-4a38-8cae-32838f3e57e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:05.476472 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f0cb9-bbce-4a38-8cae-32838f3e57e3 service neutron] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:05.539092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdc387-340d-40a8-ab63-48d3b757dfa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:05.540121 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdc387-340d-40a8-ab63-48d3b757dfa8 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:05.540405 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdc387-340d-40a8-ab63-48d3b757dfa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:05.540675 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdc387-340d-40a8-ab63-48d3b757dfa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:05.544087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-2ffdc387-340d-40a8-ab63-48d3b757dfa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:05.603630 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a0a4e-000c-48b6-a457-72cd2218ce47 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:05.605161 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-209a0a4e-000c-48b6-a457-72cd2218ce47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:05.622294 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a0a4e-000c-48b6-a457-72cd2218ce47 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:05.626397 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9bc76-377b-4d94-a227-da6411ed2029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:05.628747 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9bc76-377b-4d94-a227-da6411ed2029 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:05.629153 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9bc76-377b-4d94-a227-da6411ed2029 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:05.629566 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9bc76-377b-4d94-a227-da6411ed2029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:05.631606 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-ceb9bc76-377b-4d94-a227-da6411ed2029 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:05.655726 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdc387-340d-40a8-ab63-48d3b757dfa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:05.657195 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdc387-340d-40a8-ab63-48d3b757dfa8 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:05.674610 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1206/2409] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:05.742485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9bc76-377b-4d94-a227-da6411ed2029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:05.744485 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9bc76-377b-4d94-a227-da6411ed2029 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:05.758630 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1204/2410] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:55:12.359252 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a65c9-1b34-4791-91a3-c1f3a2b6de4d None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:12.359820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a65c9-1b34-4791-91a3-c1f3a2b6de4d None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:12.359820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a65c9-1b34-4791-91a3-c1f3a2b6de4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:12.382959 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-9a0a65c9-1b34-4791-91a3-c1f3a2b6de4d None None] MFA Rules not processed for user `a4493625af43482a88023a2aecd73b27`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:12.384211 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-9a0a65c9-1b34-4791-91a3-c1f3a2b6de4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:12.446681 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1207/2411] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:55:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:55:15.752171 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=34 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:22.438623 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=79 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:42.765021 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9bc76-377b-4d94-a227-da6411ed2029 service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:42.766733 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-ceb9bc76-377b-4d94-a227-da6411ed2029 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:42.782782 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9bc76-377b-4d94-a227-da6411ed2029 service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:42.788732 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781fc2f-0c2f-4b37-a59b-c46b49d7cd1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:42.789357 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781fc2f-0c2f-4b37-a59b-c46b49d7cd1b service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:42.789667 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781fc2f-0c2f-4b37-a59b-c46b49d7cd1b service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:42.789940 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781fc2f-0c2f-4b37-a59b-c46b49d7cd1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:42.791845 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-6781fc2f-0c2f-4b37-a59b-c46b49d7cd1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:42.876749 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781fc2f-0c2f-4b37-a59b-c46b49d7cd1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:42.878451 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781fc2f-0c2f-4b37-a59b-c46b49d7cd1b service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:42.891383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1205/2412] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:52.884204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=28 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:54.352813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a65c9-1b34-4791-91a3-c1f3a2b6de4d None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:54.354746 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-9a0a65c9-1b34-4791-91a3-c1f3a2b6de4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:54.369997 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a65c9-1b34-4791-91a3-c1f3a2b6de4d None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:54.374959 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89952e7-21d0-4e28-92e1-760e93e1decb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:54.375599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89952e7-21d0-4e28-92e1-760e93e1decb service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:54.375879 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89952e7-21d0-4e28-92e1-760e93e1decb service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:54.376153 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89952e7-21d0-4e28-92e1-760e93e1decb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:54.378084 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-f89952e7-21d0-4e28-92e1-760e93e1decb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:54.390350 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89952e7-21d0-4e28-92e1-760e93e1decb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:54.391887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89952e7-21d0-4e28-92e1-760e93e1decb service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:54.402485 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1208/2413] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:55:59.734191 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e7371-2423-4888-ac2d-23936449ac47 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:59.734808 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e7371-2423-4888-ac2d-23936449ac47 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:59.734808 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e7371-2423-4888-ac2d-23936449ac47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:59.765648 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-7e1e7371-2423-4888-ac2d-23936449ac47 None None] MFA Rules not processed for user `052e427fb0b84fe7b31705fbfb708533`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:59.767865 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-7e1e7371-2423-4888-ac2d-23936449ac47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:59.779125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1206/2414] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:55:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:56:00.155621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89952e7-21d0-4e28-92e1-760e93e1decb service neutron] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:00.164408 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89952e7-21d0-4e28-92e1-760e93e1decb service neutron] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:00.168059 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c6cb4-b6a6-4cc8-a250-a7d8af4c6634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:00.168659 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c6cb4-b6a6-4cc8-a250-a7d8af4c6634 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:00.168943 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c6cb4-b6a6-4cc8-a250-a7d8af4c6634 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:00.169247 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c6cb4-b6a6-4cc8-a250-a7d8af4c6634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:00.171313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ef7c6cb4-b6a6-4cc8-a250-a7d8af4c6634 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:00.181116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c6cb4-b6a6-4cc8-a250-a7d8af4c6634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:00.182568 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c6cb4-b6a6-4cc8-a250-a7d8af4c6634 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:00.190823 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1209/2415] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:56:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:56:00.558829 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e7371-2423-4888-ac2d-23936449ac47 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:00.560763 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-7e1e7371-2423-4888-ac2d-23936449ac47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:00.663563 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e7371-2423-4888-ac2d-23936449ac47 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:00.668708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc9362-55a0-41db-bc3a-63621f493ce4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3274d404cb403bbf272ce023aa5e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:00.669297 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc9362-55a0-41db-bc3a-63621f493ce4 service placement] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:00.669603 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc9362-55a0-41db-bc3a-63621f493ce4 service placement] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:00.669867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc9362-55a0-41db-bc3a-63621f493ce4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:00.671631 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-7ecc9362-55a0-41db-bc3a-63621f493ce4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:00.684382 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc9362-55a0-41db-bc3a-63621f493ce4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:00.686577 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc9362-55a0-41db-bc3a-63621f493ce4 service placement] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:00.704279 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1207/2416] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:56:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:56:03.859274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c6cb4-b6a6-4cc8-a250-a7d8af4c6634 service neutron] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:03.860820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ef7c6cb4-b6a6-4cc8-a250-a7d8af4c6634 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:03.881348 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c6cb4-b6a6-4cc8-a250-a7d8af4c6634 service neutron] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:03.888830 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d5042-1238-469b-928a-d5962de31018 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:03.889497 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d5042-1238-469b-928a-d5962de31018 service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:03.889781 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d5042-1238-469b-928a-d5962de31018 service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:03.890055 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d5042-1238-469b-928a-d5962de31018 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:03.892075 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-628d5042-1238-469b-928a-d5962de31018 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:03.905725 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d5042-1238-469b-928a-d5962de31018 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:03.907375 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d5042-1238-469b-928a-d5962de31018 service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:03.918552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1210/2417] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:56:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:56:10.693039 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=35 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:11.306106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc9362-55a0-41db-bc3a-63621f493ce4 service placement] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:11.322746 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc9362-55a0-41db-bc3a-63621f493ce4 service placement] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:11.330309 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85123aa0-d6a7-4ff1-95ea-069026e14156 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:11.331079 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85123aa0-d6a7-4ff1-95ea-069026e14156 service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:11.331364 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85123aa0-d6a7-4ff1-95ea-069026e14156 service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:11.331739 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85123aa0-d6a7-4ff1-95ea-069026e14156 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:11.333457 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-85123aa0-d6a7-4ff1-95ea-069026e14156 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:11.347349 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85123aa0-d6a7-4ff1-95ea-069026e14156 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:11.348952 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85123aa0-d6a7-4ff1-95ea-069026e14156 service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:11.361245 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1208/2418] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:56:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:56:13.914215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=18 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:16.348327 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d5042-1238-469b-928a-d5962de31018 service nova] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:16.364178 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d5042-1238-469b-928a-d5962de31018 service nova] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:16.369840 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68737f1f-935a-41c7-a634-2c44ef7ab334 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:16.370572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68737f1f-935a-41c7-a634-2c44ef7ab334 service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:16.370913 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68737f1f-935a-41c7-a634-2c44ef7ab334 service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:16.371257 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68737f1f-935a-41c7-a634-2c44ef7ab334 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:16.373204 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-68737f1f-935a-41c7-a634-2c44ef7ab334 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:16.386272 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68737f1f-935a-41c7-a634-2c44ef7ab334 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:16.387881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68737f1f-935a-41c7-a634-2c44ef7ab334 service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:16.399379 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1211/2419] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:56:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:56:21.356729 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=6 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:22.233936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85123aa0-d6a7-4ff1-95ea-069026e14156 service nova] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:22.235419 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-85123aa0-d6a7-4ff1-95ea-069026e14156 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:22.306539 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85123aa0-d6a7-4ff1-95ea-069026e14156 service nova] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:22.312617 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6b92a-ccd7-4f82-ab6c-485ff7292724 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:22.313708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6b92a-ccd7-4f82-ab6c-485ff7292724 service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:22.314216 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6b92a-ccd7-4f82-ab6c-485ff7292724 service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:22.314720 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6b92a-ccd7-4f82-ab6c-485ff7292724 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:22.317697 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-79d6b92a-ccd7-4f82-ab6c-485ff7292724 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:22.336234 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6b92a-ccd7-4f82-ab6c-485ff7292724 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:22.338934 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6b92a-ccd7-4f82-ab6c-485ff7292724 service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:22.358677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1209/2420] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:56:22 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:56:26.394334 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=6 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:32.349357 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=26 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:32.497008 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68737f1f-935a-41c7-a634-2c44ef7ab334 service nova] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:32.498693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-68737f1f-935a-41c7-a634-2c44ef7ab334 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:32.512614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68737f1f-935a-41c7-a634-2c44ef7ab334 service nova] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:32.517010 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e2474-92f2-4e0f-a822-0856fb1183cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:32.517692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e2474-92f2-4e0f-a822-0856fb1183cb service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:32.517971 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e2474-92f2-4e0f-a822-0856fb1183cb service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:32.518393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e2474-92f2-4e0f-a822-0856fb1183cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:32.520465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-1b1e2474-92f2-4e0f-a822-0856fb1183cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:32.588298 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e2474-92f2-4e0f-a822-0856fb1183cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:32.589692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e2474-92f2-4e0f-a822-0856fb1183cb service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:32.600844 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1212/2421] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:56:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:56:42.595470 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=28 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:42.947743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6b92a-ccd7-4f82-ab6c-485ff7292724 service cinder] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:42.957572 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6b92a-ccd7-4f82-ab6c-485ff7292724 service cinder] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:42.961215 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e9b77-ee75-455d-8c01-4419ac13ba6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:42.961832 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e9b77-ee75-455d-8c01-4419ac13ba6a service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:42.962109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e9b77-ee75-455d-8c01-4419ac13ba6a service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:42.962377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e9b77-ee75-455d-8c01-4419ac13ba6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:42.964233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-0c0e9b77-ee75-455d-8c01-4419ac13ba6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:43.036571 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e9b77-ee75-455d-8c01-4419ac13ba6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:43.038337 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e9b77-ee75-455d-8c01-4419ac13ba6a service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:43.049207 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1210/2422] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:56:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:56:44.067537 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9b62b-c2c9-4e33-9ae5-a90076b06f42 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:44.068068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9b62b-c2c9-4e33-9ae5-a90076b06f42 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:44.068068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9b62b-c2c9-4e33-9ae5-a90076b06f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:44.088097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-59a9b62b-c2c9-4e33-9ae5-a90076b06f42 None None] MFA Rules not processed for user `cab4c264979e46a39cc0ddd2df8ee8df`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:56:44.089314 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-59a9b62b-c2c9-4e33-9ae5-a90076b06f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:44.097150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1213/2423] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:56:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:56:47.324292 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e9b77-ee75-455d-8c01-4419ac13ba6a service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:47.346269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e9b77-ee75-455d-8c01-4419ac13ba6a service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:47.363917 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68a9d8-782e-4479-b306-328499008fca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3274d404cb403bbf272ce023aa5e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:47.364974 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68a9d8-782e-4479-b306-328499008fca service placement] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:47.365522 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68a9d8-782e-4479-b306-328499008fca service placement] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:47.366409 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68a9d8-782e-4479-b306-328499008fca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:47.369746 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-1b68a9d8-782e-4479-b306-328499008fca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:47.400762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68a9d8-782e-4479-b306-328499008fca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:47.404841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68a9d8-782e-4479-b306-328499008fca service placement] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:47.429652 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1211/2424] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:56:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:56:47.487428 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9b62b-c2c9-4e33-9ae5-a90076b06f42 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:47.488904 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-59a9b62b-c2c9-4e33-9ae5-a90076b06f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:47.510114 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9b62b-c2c9-4e33-9ae5-a90076b06f42 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:47.516364 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f4615-259a-4484-8491-e175b34f35dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:47.518074 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f4615-259a-4484-8491-e175b34f35dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:47.519380 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f4615-259a-4484-8491-e175b34f35dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:47.520813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f4615-259a-4484-8491-e175b34f35dd admin admin] PATH_INFO: `/v3/users/a4493625af43482a88023a2aecd73b27` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:47.522532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f4615-259a-4484-8491-e175b34f35dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4493625af43482a88023a2aecd73b27)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:47.526674 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f4615-259a-4484-8491-e175b34f35dd admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:47.618360 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e01f4615-259a-4484-8491-e175b34f35dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4493625af43482a88023a2aecd73b27'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:47.630802 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e01f4615-259a-4484-8491-e175b34f35dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4493625af43482a88023a2aecd73b27'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:47.641442 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e01f4615-259a-4484-8491-e175b34f35dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4493625af43482a88023a2aecd73b27'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:47.642188 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e01f4615-259a-4484-8491-e175b34f35dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4493625af43482a88023a2aecd73b27'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:47.658323 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e01f4615-259a-4484-8491-e175b34f35dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4493625af43482a88023a2aecd73b27'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:47.668282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1214/2425] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:56:47 2022] DELETE /identity/v3/users/a4493625af43482a88023a2aecd73b27 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:56:47.867719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68a9d8-782e-4479-b306-328499008fca service placement] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:47.882460 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68a9d8-782e-4479-b306-328499008fca service placement] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:47.976535 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0420d-f25c-4e67-8fe2-8d52d240266e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:47.977205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0420d-f25c-4e67-8fe2-8d52d240266e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:47.977523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0420d-f25c-4e67-8fe2-8d52d240266e admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:47.977796 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0420d-f25c-4e67-8fe2-8d52d240266e admin admin] PATH_INFO: `/v3/projects/aed35c2ce9cf4d32af3df06fca282995` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:47.979076 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0420d-f25c-4e67-8fe2-8d52d240266e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aed35c2ce9cf4d32af3df06fca282995)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:47.981100 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0420d-f25c-4e67-8fe2-8d52d240266e admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:48.037761 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-27b0420d-f25c-4e67-8fe2-8d52d240266e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aed35c2ce9cf4d32af3df06fca282995', 'request_id': 'req-27b0420d-f25c-4e67-8fe2-8d52d240266e'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:48.044584 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-27b0420d-f25c-4e67-8fe2-8d52d240266e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aed35c2ce9cf4d32af3df06fca282995', 'request_id': 'req-27b0420d-f25c-4e67-8fe2-8d52d240266e'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:48.054722 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-27b0420d-f25c-4e67-8fe2-8d52d240266e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aed35c2ce9cf4d32af3df06fca282995', 'request_id': 'req-27b0420d-f25c-4e67-8fe2-8d52d240266e'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:48.069047 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-27b0420d-f25c-4e67-8fe2-8d52d240266e admin admin] The token cache is being invalidate because project aed35c2ce9cf4d32af3df06fca282995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:56:48.080310 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-27b0420d-f25c-4e67-8fe2-8d52d240266e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:48.081879 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-27b0420d-f25c-4e67-8fe2-8d52d240266e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:48.083698 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1212/2426] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:56:47 2022] DELETE /identity/v3/projects/aed35c2ce9cf4d32af3df06fca282995 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:56:48.089120 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5ca15-63c4-4a86-a91b-d04aafacbbfe None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:48.089544 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5ca15-63c4-4a86-a91b-d04aafacbbfe None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:48.089915 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5ca15-63c4-4a86-a91b-d04aafacbbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:48.115649 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-34b5ca15-63c4-4a86-a91b-d04aafacbbfe None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:56:48.118482 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-34b5ca15-63c4-4a86-a91b-d04aafacbbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:48.204216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1215/2427] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:56:48.212619 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a795a40-b82c-478a-936d-8d15d7c29f0c None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:48.213061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a795a40-b82c-478a-936d-8d15d7c29f0c None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:48.213615 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a795a40-b82c-478a-936d-8d15d7c29f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:48.239241 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-3a795a40-b82c-478a-936d-8d15d7c29f0c None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:56:48.240609 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-3a795a40-b82c-478a-936d-8d15d7c29f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:48.249870 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1213/2428] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:56:48.254720 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5ca15-63c4-4a86-a91b-d04aafacbbfe None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:48.266169 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5ca15-63c4-4a86-a91b-d04aafacbbfe None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:48.271100 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec6ee1-6bfa-4192-acff-8b34b1cec88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:48.271732 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec6ee1-6bfa-4192-acff-8b34b1cec88f admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:48.272023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec6ee1-6bfa-4192-acff-8b34b1cec88f admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:48.272290 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec6ee1-6bfa-4192-acff-8b34b1cec88f admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:48.272962 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec6ee1-6bfa-4192-acff-8b34b1cec88f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:56:48.273265 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec6ee1-6bfa-4192-acff-8b34b1cec88f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:48.274915 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec6ee1-6bfa-4192-acff-8b34b1cec88f admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:48.288987 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1216/2429] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:56:48.293233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a795a40-b82c-478a-936d-8d15d7c29f0c None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:48.299234 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:48.304344 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a795a40-b82c-478a-936d-8d15d7c29f0c None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:48.315074 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545de622-0029-4fcb-a12c-127117554afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:48.315831 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545de622-0029-4fcb-a12c-127117554afb admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:48.327105 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545de622-0029-4fcb-a12c-127117554afb admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:48.328178 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545de622-0029-4fcb-a12c-127117554afb admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:48.328178 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545de622-0029-4fcb-a12c-127117554afb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:48.330152 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545de622-0029-4fcb-a12c-127117554afb admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:48.366211 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1214/2430] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:56:48 2022] POST /identity/v3/projects => generated 389 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:56:48.370584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec6ee1-6bfa-4192-acff-8b34b1cec88f admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:48.381917 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec6ee1-6bfa-4192-acff-8b34b1cec88f admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:48.452618 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:48.472150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a306e-0d05-41b2-9b70-9c530089f28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:48.473831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a306e-0d05-41b2-9b70-9c530089f28f admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:48.474618 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a306e-0d05-41b2-9b70-9c530089f28f admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:48.475167 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a306e-0d05-41b2-9b70-9c530089f28f admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:48.478129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a306e-0d05-41b2-9b70-9c530089f28f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:48.482822 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a306e-0d05-41b2-9b70-9c530089f28f admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:48.516231 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1217/2431] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:56:48 2022] POST /identity/v3/users => generated 295 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:56:48.526967 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545de622-0029-4fcb-a12c-127117554afb admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:48.540955 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545de622-0029-4fcb-a12c-127117554afb admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:48.547087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319162da-cb16-450d-a1b4-4b0632674d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:48.547720 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319162da-cb16-450d-a1b4-4b0632674d3e admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:48.548211 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319162da-cb16-450d-a1b4-4b0632674d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:48.548489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319162da-cb16-450d-a1b4-4b0632674d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:48.549165 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319162da-cb16-450d-a1b4-4b0632674d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:48.550873 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319162da-cb16-450d-a1b4-4b0632674d3e admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:48.562767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1215/2432] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:56:48.567021 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a306e-0d05-41b2-9b70-9c530089f28f admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:48.581011 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a306e-0d05-41b2-9b70-9c530089f28f admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:48.587498 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2004347-8403-4664-a608-3895453623dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:48.588144 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2004347-8403-4664-a608-3895453623dd admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:48.588460 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2004347-8403-4664-a608-3895453623dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:48.588739 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2004347-8403-4664-a608-3895453623dd admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:48.589442 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2004347-8403-4664-a608-3895453623dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:48.591781 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2004347-8403-4664-a608-3895453623dd admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:48.604928 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1218/2433] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:56:48.611567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319162da-cb16-450d-a1b4-4b0632674d3e admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:48.625813 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319162da-cb16-450d-a1b4-4b0632674d3e admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:48.631043 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb45cd-edcb-44f0-8d95-1118b187658e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:48.631811 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb45cd-edcb-44f0-8d95-1118b187658e admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:48.632157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb45cd-edcb-44f0-8d95-1118b187658e admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:48.632741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb45cd-edcb-44f0-8d95-1118b187658e admin admin] PATH_INFO: `/v3/projects/e4921710e31240a58c7093f4f7216bbb/users/88c5fc903c704d1789180bdae4018787/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:48.653239 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb45cd-edcb-44f0-8d95-1118b187658e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4921710e31240a58c7093f4f7216bbb, user_id=88c5fc903c704d1789180bdae4018787, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:48.656744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb45cd-edcb-44f0-8d95-1118b187658e admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:48.679458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1216/2434] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:56:48 2022] PUT /identity/v3/projects/e4921710e31240a58c7093f4f7216bbb/users/88c5fc903c704d1789180bdae4018787/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:56:48.684507 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c5814-4473-43c5-b955-bac75a627e30 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:48.685540 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c5814-4473-43c5-b955-bac75a627e30 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:48.685540 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c5814-4473-43c5-b955-bac75a627e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:48.710280 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-7f4c5814-4473-43c5-b955-bac75a627e30 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:56:48.711467 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-7f4c5814-4473-43c5-b955-bac75a627e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:48.801718 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1219/2435] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:56:48.817717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb45cd-edcb-44f0-8d95-1118b187658e admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:48.820023 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-addb45cd-edcb-44f0-8d95-1118b187658e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:48.898016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb45cd-edcb-44f0-8d95-1118b187658e admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:48.901703 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11671d60-a5ed-4a55-ad1e-ede6d2d0694d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:48.902308 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11671d60-a5ed-4a55-ad1e-ede6d2d0694d service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:48.902589 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11671d60-a5ed-4a55-ad1e-ede6d2d0694d service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:48.902873 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11671d60-a5ed-4a55-ad1e-ede6d2d0694d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:48.913558 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11671d60-a5ed-4a55-ad1e-ede6d2d0694d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:48.915006 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11671d60-a5ed-4a55-ad1e-ede6d2d0694d service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:48.929481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1217/2436] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:56:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:56:54.706397 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270949c-61ff-47f3-8581-374a67aa9dc1 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:54.707452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270949c-61ff-47f3-8581-374a67aa9dc1 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:54.707884 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270949c-61ff-47f3-8581-374a67aa9dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:54.749807 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-d270949c-61ff-47f3-8581-374a67aa9dc1 None None] MFA Rules not processed for user `88c5fc903c704d1789180bdae4018787`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:56:54.751976 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-d270949c-61ff-47f3-8581-374a67aa9dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:54.885209 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1220/2437] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:56:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:56:54.896340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11671d60-a5ed-4a55-ad1e-ede6d2d0694d service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:54.901579 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-11671d60-a5ed-4a55-ad1e-ede6d2d0694d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:55.020668 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11671d60-a5ed-4a55-ad1e-ede6d2d0694d service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:55.027550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1fc7e-a058-4787-aa23-0c880a754bd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:55.028287 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1fc7e-a058-4787-aa23-0c880a754bd6 service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:55.028699 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1fc7e-a058-4787-aa23-0c880a754bd6 service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:55.028877 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1fc7e-a058-4787-aa23-0c880a754bd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:55.038399 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1fc7e-a058-4787-aa23-0c880a754bd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:55.040213 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1fc7e-a058-4787-aa23-0c880a754bd6 service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:55.051523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1218/2438] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:56:54 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:56:57.664585 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62aa16-6b14-464b-8a81-12b80d22b90c None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:57.665180 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62aa16-6b14-464b-8a81-12b80d22b90c None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:57.665180 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62aa16-6b14-464b-8a81-12b80d22b90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:57.701207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-7d62aa16-6b14-464b-8a81-12b80d22b90c None None] MFA Rules not processed for user `88c5fc903c704d1789180bdae4018787`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:56:57.703450 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-7d62aa16-6b14-464b-8a81-12b80d22b90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:57.729491 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1221/2439] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:56:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:56:58.264470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1fc7e-a058-4787-aa23-0c880a754bd6 service nova] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:58.275129 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1fc7e-a058-4787-aa23-0c880a754bd6 service nova] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:58.279004 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ebde7-3c89-4523-a60b-782d5e16ef62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:58.279647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ebde7-3c89-4523-a60b-782d5e16ef62 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:58.279930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ebde7-3c89-4523-a60b-782d5e16ef62 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:58.280204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ebde7-3c89-4523-a60b-782d5e16ef62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:58.282138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-d53ebde7-3c89-4523-a60b-782d5e16ef62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:58.293314 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ebde7-3c89-4523-a60b-782d5e16ef62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:58.294806 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ebde7-3c89-4523-a60b-782d5e16ef62 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:58.304781 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1219/2440] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:56:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:57:04.601071 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6427d-fdc9-4a98-9661-91ea9352b3aa None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:04.602072 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6427d-fdc9-4a98-9661-91ea9352b3aa None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:04.602529 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6427d-fdc9-4a98-9661-91ea9352b3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:04.626335 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-bbf6427d-fdc9-4a98-9661-91ea9352b3aa None None] MFA Rules not processed for user `7caa973c63e64d639cc2fb55a4955542`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:57:04.628815 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-bbf6427d-fdc9-4a98-9661-91ea9352b3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:04.728538 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:04.753502 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1222/2441] 10.222.0.94 () {58 vars in 967 bytes} [Wed Aug 24 04:57:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:57:04.846266 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ebde7-3c89-4523-a60b-782d5e16ef62 service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:04.847809 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-d53ebde7-3c89-4523-a60b-782d5e16ef62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:04.878921 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:04.959253 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ebde7-3c89-4523-a60b-782d5e16ef62 service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:04.964711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76259385-69ca-4fd5-bac0-e23618014b1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40d2202203204b06a41e57b9d1a300fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:04.965352 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76259385-69ca-4fd5-bac0-e23618014b1a service swift] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:04.965674 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76259385-69ca-4fd5-bac0-e23618014b1a service swift] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:04.965944 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76259385-69ca-4fd5-bac0-e23618014b1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:04.976245 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76259385-69ca-4fd5-bac0-e23618014b1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:04.977918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76259385-69ca-4fd5-bac0-e23618014b1a service swift] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:04.988670 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1220/2442] 10.222.0.94 () {60 vars in 1384 bytes} [Wed Aug 24 04:57:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 04:57:12.824426 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6427d-fdc9-4a98-9661-91ea9352b3aa None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:12.826481 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-bbf6427d-fdc9-4a98-9661-91ea9352b3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:12.891712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76259385-69ca-4fd5-bac0-e23618014b1a service swift] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:12.893756 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-76259385-69ca-4fd5-bac0-e23618014b1a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:12.908876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76259385-69ca-4fd5-bac0-e23618014b1a service swift] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:12.914624 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2b3f9-8983-4ad9-be1d-c4dad55806dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:12.915298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2b3f9-8983-4ad9-be1d-c4dad55806dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:12.915657 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2b3f9-8983-4ad9-be1d-c4dad55806dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:12.915944 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2b3f9-8983-4ad9-be1d-c4dad55806dc admin admin] PATH_INFO: `/v3/users/8328a82e8eea4f9e9c9229e557f93d65` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:12.917133 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2b3f9-8983-4ad9-be1d-c4dad55806dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8328a82e8eea4f9e9c9229e557f93d65)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:12.919127 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2b3f9-8983-4ad9-be1d-c4dad55806dc admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:12.928202 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6427d-fdc9-4a98-9661-91ea9352b3aa None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:12.933760 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8249e32-7935-4e9b-939f-4e9bc77b31ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3274d404cb403bbf272ce023aa5e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:12.934340 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8249e32-7935-4e9b-939f-4e9bc77b31ce service placement] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:12.934646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8249e32-7935-4e9b-939f-4e9bc77b31ce service placement] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:12.934921 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8249e32-7935-4e9b-939f-4e9bc77b31ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:12.936734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-f8249e32-7935-4e9b-939f-4e9bc77b31ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:12.949906 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8249e32-7935-4e9b-939f-4e9bc77b31ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:12.951440 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8249e32-7935-4e9b-939f-4e9bc77b31ce service placement] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:12.967736 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1223/2443] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:57:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:57:12.982480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a1b2b3f9-8983-4ad9-be1d-c4dad55806dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8328a82e8eea4f9e9c9229e557f93d65'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:12.983175 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a1b2b3f9-8983-4ad9-be1d-c4dad55806dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8328a82e8eea4f9e9c9229e557f93d65'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:12.992268 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a1b2b3f9-8983-4ad9-be1d-c4dad55806dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8328a82e8eea4f9e9c9229e557f93d65'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:13.007588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a1b2b3f9-8983-4ad9-be1d-c4dad55806dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8328a82e8eea4f9e9c9229e557f93d65'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:13.014902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a1b2b3f9-8983-4ad9-be1d-c4dad55806dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8328a82e8eea4f9e9c9229e557f93d65'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:13.022302 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1221/2444] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:57:12 2022] DELETE /identity/v3/users/8328a82e8eea4f9e9c9229e557f93d65 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:57:13.214649 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8249e32-7935-4e9b-939f-4e9bc77b31ce service placement] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:13.228311 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8249e32-7935-4e9b-939f-4e9bc77b31ce service placement] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:13.298166 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc861e-f4d4-401d-9ac5-ef559c74d1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:13.298831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc861e-f4d4-401d-9ac5-ef559c74d1d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:13.299402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc861e-f4d4-401d-9ac5-ef559c74d1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:13.299677 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc861e-f4d4-401d-9ac5-ef559c74d1d8 admin admin] PATH_INFO: `/v3/projects/7a0039e1b60d4d2cb807fa9c82cfcd09` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:13.300815 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc861e-f4d4-401d-9ac5-ef559c74d1d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a0039e1b60d4d2cb807fa9c82cfcd09)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:13.302826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc861e-f4d4-401d-9ac5-ef559c74d1d8 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:13.362502 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-60bc861e-f4d4-401d-9ac5-ef559c74d1d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a0039e1b60d4d2cb807fa9c82cfcd09', 'request_id': 'req-60bc861e-f4d4-401d-9ac5-ef559c74d1d8'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:13.369657 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-60bc861e-f4d4-401d-9ac5-ef559c74d1d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a0039e1b60d4d2cb807fa9c82cfcd09', 'request_id': 'req-60bc861e-f4d4-401d-9ac5-ef559c74d1d8'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:13.379671 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-60bc861e-f4d4-401d-9ac5-ef559c74d1d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a0039e1b60d4d2cb807fa9c82cfcd09', 'request_id': 'req-60bc861e-f4d4-401d-9ac5-ef559c74d1d8'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:13.392010 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-60bc861e-f4d4-401d-9ac5-ef559c74d1d8 admin admin] The token cache is being invalidate because project 7a0039e1b60d4d2cb807fa9c82cfcd09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:57:13.392317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-60bc861e-f4d4-401d-9ac5-ef559c74d1d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:13.393726 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-60bc861e-f4d4-401d-9ac5-ef559c74d1d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:13.395673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1224/2445] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:57:13 2022] DELETE /identity/v3/projects/7a0039e1b60d4d2cb807fa9c82cfcd09 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:57:13.399174 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2b3f9-8983-4ad9-be1d-c4dad55806dc admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:13.400683 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-a1b2b3f9-8983-4ad9-be1d-c4dad55806dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:13.414807 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2b3f9-8983-4ad9-be1d-c4dad55806dc admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:13.482119 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31904c7-836c-471d-90b9-2ce9026104db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:13.482754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31904c7-836c-471d-90b9-2ce9026104db admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:13.483033 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31904c7-836c-471d-90b9-2ce9026104db admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:13.483306 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31904c7-836c-471d-90b9-2ce9026104db admin admin] PATH_INFO: `/v3/users/62a50fa142914049bfab3c5a1cf20d3b` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:13.484474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31904c7-836c-471d-90b9-2ce9026104db admin admin] RBAC: Authorizing `identity:delete_user(user_id=62a50fa142914049bfab3c5a1cf20d3b)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:13.486542 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31904c7-836c-471d-90b9-2ce9026104db admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:13.521050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:13.544056 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-f31904c7-836c-471d-90b9-2ce9026104db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62a50fa142914049bfab3c5a1cf20d3b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:13.544761 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-f31904c7-836c-471d-90b9-2ce9026104db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62a50fa142914049bfab3c5a1cf20d3b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:13.554085 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-f31904c7-836c-471d-90b9-2ce9026104db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62a50fa142914049bfab3c5a1cf20d3b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:13.569789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-f31904c7-836c-471d-90b9-2ce9026104db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62a50fa142914049bfab3c5a1cf20d3b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:13.578084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-f31904c7-836c-471d-90b9-2ce9026104db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62a50fa142914049bfab3c5a1cf20d3b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:13.585914 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1222/2446] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:57:13 2022] DELETE /identity/v3/users/62a50fa142914049bfab3c5a1cf20d3b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:57:13.799532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc861e-f4d4-401d-9ac5-ef559c74d1d8 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:13.801110 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-60bc861e-f4d4-401d-9ac5-ef559c74d1d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:13.824484 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc861e-f4d4-401d-9ac5-ef559c74d1d8 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:13.843034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:13.903107 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480134a-2269-43ce-be7f-961359117694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:13.903881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480134a-2269-43ce-be7f-961359117694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:13.904201 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480134a-2269-43ce-be7f-961359117694 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:13.905154 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480134a-2269-43ce-be7f-961359117694 admin admin] PATH_INFO: `/v3/projects/df473b52c6fa49ec899902996369b6e0` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:13.906631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480134a-2269-43ce-be7f-961359117694 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df473b52c6fa49ec899902996369b6e0)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:13.908937 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480134a-2269-43ce-be7f-961359117694 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:13.976401 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-2480134a-2269-43ce-be7f-961359117694 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df473b52c6fa49ec899902996369b6e0', 'request_id': 'req-2480134a-2269-43ce-be7f-961359117694'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:13.983916 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-2480134a-2269-43ce-be7f-961359117694 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df473b52c6fa49ec899902996369b6e0', 'request_id': 'req-2480134a-2269-43ce-be7f-961359117694'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:13.993666 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-2480134a-2269-43ce-be7f-961359117694 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df473b52c6fa49ec899902996369b6e0', 'request_id': 'req-2480134a-2269-43ce-be7f-961359117694'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:14.005348 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-2480134a-2269-43ce-be7f-961359117694 admin admin] The token cache is being invalidate because project df473b52c6fa49ec899902996369b6e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:57:14.005979 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-2480134a-2269-43ce-be7f-961359117694 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:14.006664 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-2480134a-2269-43ce-be7f-961359117694 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:14.008160 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1225/2447] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:57:13 2022] DELETE /identity/v3/projects/df473b52c6fa49ec899902996369b6e0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:57:23.582145 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:DELETE=6,keystone:SELECT=19,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:24.001500 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:44.685054 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c08bcb-2698-4491-b03c-c3bda941fcba None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:44.685678 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c08bcb-2698-4491-b03c-c3bda941fcba None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:44.685678 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c08bcb-2698-4491-b03c-c3bda941fcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:44.713242 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-d8c08bcb-2698-4491-b03c-c3bda941fcba None None] MFA Rules not processed for user `052e427fb0b84fe7b31705fbfb708533`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:57:44.714526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-d8c08bcb-2698-4491-b03c-c3bda941fcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:44.777713 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1223/2448] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:57:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:57:54.770183 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=25 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:32.531948 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480134a-2269-43ce-be7f-961359117694 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:32.533726 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-2480134a-2269-43ce-be7f-961359117694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:32.706302 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480134a-2269-43ce-be7f-961359117694 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:32.712943 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf23f3-0217-4520-80c3-8899125839e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3274d404cb403bbf272ce023aa5e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:32.713659 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf23f3-0217-4520-80c3-8899125839e1 service placement] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:32.714012 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf23f3-0217-4520-80c3-8899125839e1 service placement] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:32.714393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf23f3-0217-4520-80c3-8899125839e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:32.716461 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-28bf23f3-0217-4520-80c3-8899125839e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:32.731724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf23f3-0217-4520-80c3-8899125839e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:32.733348 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf23f3-0217-4520-80c3-8899125839e1 service placement] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:32.744543 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1226/2449] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:58:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:58:37.922719 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c08bcb-2698-4491-b03c-c3bda941fcba None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:37.924164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-d8c08bcb-2698-4491-b03c-c3bda941fcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:38.028493 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c08bcb-2698-4491-b03c-c3bda941fcba None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:38.035085 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd370d6-8aa8-4db4-ac60-34145c0ead3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:38.036185 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd370d6-8aa8-4db4-ac60-34145c0ead3b service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:38.036684 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd370d6-8aa8-4db4-ac60-34145c0ead3b service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:38.037196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd370d6-8aa8-4db4-ac60-34145c0ead3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:38.040458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-fcd370d6-8aa8-4db4-ac60-34145c0ead3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:38.145376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd370d6-8aa8-4db4-ac60-34145c0ead3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:38.146843 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd370d6-8aa8-4db4-ac60-34145c0ead3b service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:38.168281 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1224/2450] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:58:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:58:41.486333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf23f3-0217-4520-80c3-8899125839e1 service placement] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:41.487757 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-28bf23f3-0217-4520-80c3-8899125839e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:41.504791 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf23f3-0217-4520-80c3-8899125839e1 service placement] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:41.511343 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc38e23-77ba-4a90-a4e6-367340e0680c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:41.511932 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc38e23-77ba-4a90-a4e6-367340e0680c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:41.512214 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc38e23-77ba-4a90-a4e6-367340e0680c admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:41.512491 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc38e23-77ba-4a90-a4e6-367340e0680c admin admin] PATH_INFO: `/v3/users/cab4c264979e46a39cc0ddd2df8ee8df` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:41.513759 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc38e23-77ba-4a90-a4e6-367340e0680c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cab4c264979e46a39cc0ddd2df8ee8df)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:41.515721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc38e23-77ba-4a90-a4e6-367340e0680c admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:41.587966 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-fdc38e23-77ba-4a90-a4e6-367340e0680c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cab4c264979e46a39cc0ddd2df8ee8df'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:58:41.598049 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-fdc38e23-77ba-4a90-a4e6-367340e0680c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cab4c264979e46a39cc0ddd2df8ee8df'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:58:41.606061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-fdc38e23-77ba-4a90-a4e6-367340e0680c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cab4c264979e46a39cc0ddd2df8ee8df'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:58:41.606892 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-fdc38e23-77ba-4a90-a4e6-367340e0680c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cab4c264979e46a39cc0ddd2df8ee8df'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:58:41.618401 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:41.622203 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-fdc38e23-77ba-4a90-a4e6-367340e0680c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cab4c264979e46a39cc0ddd2df8ee8df'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:58:41.631555 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1227/2451] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:58:41 2022] DELETE /identity/v3/users/cab4c264979e46a39cc0ddd2df8ee8df => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:58:41.825908 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd370d6-8aa8-4db4-ac60-34145c0ead3b service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:41.835996 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd370d6-8aa8-4db4-ac60-34145c0ead3b service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:41.886167 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:41.898724 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71c0b7-a032-4ce0-a589-368630db228d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:41.899398 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71c0b7-a032-4ce0-a589-368630db228d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:41.899675 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71c0b7-a032-4ce0-a589-368630db228d admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:41.899948 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71c0b7-a032-4ce0-a589-368630db228d admin admin] PATH_INFO: `/v3/projects/f5dcfc8632b7487e9157ac85305b8b85` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:41.901085 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71c0b7-a032-4ce0-a589-368630db228d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5dcfc8632b7487e9157ac85305b8b85)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:41.903014 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71c0b7-a032-4ce0-a589-368630db228d admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:41.951447 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-9c71c0b7-a032-4ce0-a589-368630db228d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5dcfc8632b7487e9157ac85305b8b85', 'request_id': 'req-9c71c0b7-a032-4ce0-a589-368630db228d'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:58:41.956963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-9c71c0b7-a032-4ce0-a589-368630db228d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5dcfc8632b7487e9157ac85305b8b85', 'request_id': 'req-9c71c0b7-a032-4ce0-a589-368630db228d'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:58:41.963920 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-9c71c0b7-a032-4ce0-a589-368630db228d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5dcfc8632b7487e9157ac85305b8b85', 'request_id': 'req-9c71c0b7-a032-4ce0-a589-368630db228d'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:58:41.975390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-9c71c0b7-a032-4ce0-a589-368630db228d admin admin] The token cache is being invalidate because project f5dcfc8632b7487e9157ac85305b8b85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:58:41.975679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-9c71c0b7-a032-4ce0-a589-368630db228d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:58:41.976309 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-9c71c0b7-a032-4ce0-a589-368630db228d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:58:41.978636 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1225/2452] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:58:41 2022] DELETE /identity/v3/projects/f5dcfc8632b7487e9157ac85305b8b85 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:58:41.983623 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca210af-9556-42a0-b7e4-17f45812920a None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:41.983986 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca210af-9556-42a0-b7e4-17f45812920a None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:41.984358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca210af-9556-42a0-b7e4-17f45812920a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:42.043331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-5ca210af-9556-42a0-b7e4-17f45812920a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:58:42.044560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-5ca210af-9556-42a0-b7e4-17f45812920a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:42.103240 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1228/2453] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:58:42.110992 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47944e-ace9-487e-9427-68704c3100f6 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:42.111347 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47944e-ace9-487e-9427-68704c3100f6 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:42.111687 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47944e-ace9-487e-9427-68704c3100f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:42.132185 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-5c47944e-ace9-487e-9427-68704c3100f6 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:58:42.133381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-5c47944e-ace9-487e-9427-68704c3100f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:42.141272 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1226/2454] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:58:42.145503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca210af-9556-42a0-b7e4-17f45812920a None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:42.155928 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca210af-9556-42a0-b7e4-17f45812920a None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:42.160536 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42820ede-1ce6-4f68-b667-bfb4b5d652df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:42.161144 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42820ede-1ce6-4f68-b667-bfb4b5d652df admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:42.161447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42820ede-1ce6-4f68-b667-bfb4b5d652df admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:42.161727 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42820ede-1ce6-4f68-b667-bfb4b5d652df admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:42.162398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42820ede-1ce6-4f68-b667-bfb4b5d652df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:58:42.162688 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42820ede-1ce6-4f68-b667-bfb4b5d652df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:42.164288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42820ede-1ce6-4f68-b667-bfb4b5d652df admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:42.176282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1229/2455] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:58:42.181284 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47944e-ace9-487e-9427-68704c3100f6 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:42.190966 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47944e-ace9-487e-9427-68704c3100f6 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:42.195534 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2611838-3f0e-4805-b81f-20c85e38a10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:42.196174 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2611838-3f0e-4805-b81f-20c85e38a10d admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:42.196450 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2611838-3f0e-4805-b81f-20c85e38a10d admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:42.196716 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2611838-3f0e-4805-b81f-20c85e38a10d admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:42.197347 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2611838-3f0e-4805-b81f-20c85e38a10d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:42.199266 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2611838-3f0e-4805-b81f-20c85e38a10d admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:42.228246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1227/2456] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:58:42 2022] POST /identity/v3/projects => generated 357 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:58:42.232693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42820ede-1ce6-4f68-b667-bfb4b5d652df admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:42.242641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42820ede-1ce6-4f68-b667-bfb4b5d652df admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:42.301153 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb9a49-6186-4141-bdc2-e345c176e66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:42.301795 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb9a49-6186-4141-bdc2-e345c176e66e admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:42.302083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb9a49-6186-4141-bdc2-e345c176e66e admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:42.302362 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb9a49-6186-4141-bdc2-e345c176e66e admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:42.303001 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb9a49-6186-4141-bdc2-e345c176e66e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:42.304914 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb9a49-6186-4141-bdc2-e345c176e66e admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:42.326633 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1230/2457] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:58:42 2022] POST /identity/v3/users => generated 279 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:58:42.330773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2611838-3f0e-4805-b81f-20c85e38a10d admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:42.341778 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2611838-3f0e-4805-b81f-20c85e38a10d admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:42.346488 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33befc-f1ae-4b1d-9769-5f14d6cb5ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:42.347087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33befc-f1ae-4b1d-9769-5f14d6cb5ccd admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:42.347360 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33befc-f1ae-4b1d-9769-5f14d6cb5ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:42.347627 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33befc-f1ae-4b1d-9769-5f14d6cb5ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:42.348267 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c33befc-f1ae-4b1d-9769-5f14d6cb5ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:42.349875 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c33befc-f1ae-4b1d-9769-5f14d6cb5ccd admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:42.360726 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1228/2458] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:58:42.364968 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb9a49-6186-4141-bdc2-e345c176e66e admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:42.375505 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb9a49-6186-4141-bdc2-e345c176e66e admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:42.380426 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1aa96-d75c-4000-933a-6007ea7f6d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:42.381029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1aa96-d75c-4000-933a-6007ea7f6d09 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:42.381311 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1aa96-d75c-4000-933a-6007ea7f6d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:42.381632 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1aa96-d75c-4000-933a-6007ea7f6d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:42.382267 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1aa96-d75c-4000-933a-6007ea7f6d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:42.383919 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1aa96-d75c-4000-933a-6007ea7f6d09 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:42.395104 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1231/2459] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:58:42.399985 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33befc-f1ae-4b1d-9769-5f14d6cb5ccd admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:42.410092 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33befc-f1ae-4b1d-9769-5f14d6cb5ccd admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:42.414605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed1a36-ebbb-4bd5-9742-727c3a23a258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:42.415992 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed1a36-ebbb-4bd5-9742-727c3a23a258 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:42.416293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed1a36-ebbb-4bd5-9742-727c3a23a258 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:42.416555 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed1a36-ebbb-4bd5-9742-727c3a23a258 admin admin] PATH_INFO: `/v3/projects/02bdd0cbf1e54f8b96c553c3b91a59a9/users/a8ed4ef7d89f403fa7674f91907b6b9a/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:42.431185 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed1a36-ebbb-4bd5-9742-727c3a23a258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02bdd0cbf1e54f8b96c553c3b91a59a9, user_id=a8ed4ef7d89f403fa7674f91907b6b9a, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:42.433907 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed1a36-ebbb-4bd5-9742-727c3a23a258 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:42.446636 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1229/2460] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:58:42 2022] PUT /identity/v3/projects/02bdd0cbf1e54f8b96c553c3b91a59a9/users/a8ed4ef7d89f403fa7674f91907b6b9a/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:58:42.456956 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44917239-564a-4934-b66e-cc95a6965cf7 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:42.457244 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44917239-564a-4934-b66e-cc95a6965cf7 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:42.457559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44917239-564a-4934-b66e-cc95a6965cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:42.486695 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-44917239-564a-4934-b66e-cc95a6965cf7 None None] MFA Rules not processed for user `a8ed4ef7d89f403fa7674f91907b6b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:58:42.487844 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-44917239-564a-4934-b66e-cc95a6965cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:42.507275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:42.560093 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1232/2461] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:58:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:58:42.564589 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed1a36-ebbb-4bd5-9742-727c3a23a258 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:42.628503 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed1a36-ebbb-4bd5-9742-727c3a23a258 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:42.634360 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a28296-04c9-40a9-8195-3a8492948985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:42.635119 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a28296-04c9-40a9-8195-3a8492948985 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:42.635401 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a28296-04c9-40a9-8195-3a8492948985 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:42.635675 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a28296-04c9-40a9-8195-3a8492948985 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:42.636325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a28296-04c9-40a9-8195-3a8492948985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:42.638259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a28296-04c9-40a9-8195-3a8492948985 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:42.662817 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:42.671392 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1230/2462] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:58:42 2022] POST /identity/v3/projects => generated 355 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:58:42.676641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44917239-564a-4934-b66e-cc95a6965cf7 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:42.688402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44917239-564a-4934-b66e-cc95a6965cf7 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:42.756520 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b034ec-9a43-4443-a824-69e312d8b7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:42.757190 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b034ec-9a43-4443-a824-69e312d8b7ac admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:42.757599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b034ec-9a43-4443-a824-69e312d8b7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:42.757999 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b034ec-9a43-4443-a824-69e312d8b7ac admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:42.758803 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b034ec-9a43-4443-a824-69e312d8b7ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:42.760959 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b034ec-9a43-4443-a824-69e312d8b7ac admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:42.782834 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1233/2463] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:58:42 2022] POST /identity/v3/users => generated 284 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:58:42.787957 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a28296-04c9-40a9-8195-3a8492948985 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:42.802589 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a28296-04c9-40a9-8195-3a8492948985 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:42.808148 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abb549-870e-4013-a3d4-8289e9630f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:42.808727 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abb549-870e-4013-a3d4-8289e9630f7f admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:42.809006 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abb549-870e-4013-a3d4-8289e9630f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:42.809270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abb549-870e-4013-a3d4-8289e9630f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:42.809949 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abb549-870e-4013-a3d4-8289e9630f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:42.811525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abb549-870e-4013-a3d4-8289e9630f7f admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:42.822546 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1231/2464] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:58:42.826878 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b034ec-9a43-4443-a824-69e312d8b7ac admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:42.837789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b034ec-9a43-4443-a824-69e312d8b7ac admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:42.842804 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11699588-9446-4ec9-b7f9-981d67edc186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:42.843478 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11699588-9446-4ec9-b7f9-981d67edc186 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:42.843762 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11699588-9446-4ec9-b7f9-981d67edc186 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:42.844041 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11699588-9446-4ec9-b7f9-981d67edc186 admin admin] PATH_INFO: `/v3/projects/54a41536e81944d1a94801acfd8e6a51/users/f55e41d453fe40c89b4199fa534d7afd/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:42.861083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11699588-9446-4ec9-b7f9-981d67edc186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a41536e81944d1a94801acfd8e6a51, user_id=f55e41d453fe40c89b4199fa534d7afd, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:42.863771 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11699588-9446-4ec9-b7f9-981d67edc186 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:42.878740 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1234/2465] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:58:42 2022] PUT /identity/v3/projects/54a41536e81944d1a94801acfd8e6a51/users/f55e41d453fe40c89b4199fa534d7afd/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:58:42.882799 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abb549-870e-4013-a3d4-8289e9630f7f admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:42.893687 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abb549-870e-4013-a3d4-8289e9630f7f admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:42.951139 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a0239-27ea-4531-8a88-02d34ca5c540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:42.951744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a0239-27ea-4531-8a88-02d34ca5c540 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:42.952001 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a0239-27ea-4531-8a88-02d34ca5c540 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:42.952272 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a0239-27ea-4531-8a88-02d34ca5c540 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:42.952914 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a0239-27ea-4531-8a88-02d34ca5c540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:42.954530 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a0239-27ea-4531-8a88-02d34ca5c540 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:42.966048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1232/2466] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:58:42.970637 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11699588-9446-4ec9-b7f9-981d67edc186 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:42.981330 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11699588-9446-4ec9-b7f9-981d67edc186 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:42.986328 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605a3ad-f255-4e56-bbcb-826f30e41b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:42.986994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605a3ad-f255-4e56-bbcb-826f30e41b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:42.987274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605a3ad-f255-4e56-bbcb-826f30e41b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:42.987547 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605a3ad-f255-4e56-bbcb-826f30e41b60 admin admin] PATH_INFO: `/v3/projects/54a41536e81944d1a94801acfd8e6a51/users/f55e41d453fe40c89b4199fa534d7afd/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:42.989523 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605a3ad-f255-4e56-bbcb-826f30e41b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a41536e81944d1a94801acfd8e6a51, user_id=f55e41d453fe40c89b4199fa534d7afd, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:42.992142 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605a3ad-f255-4e56-bbcb-826f30e41b60 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:43.003648 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1235/2467] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:58:42 2022] PUT /identity/v3/projects/54a41536e81944d1a94801acfd8e6a51/users/f55e41d453fe40c89b4199fa534d7afd/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:58:43.016044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf925d3-7e01-44f2-8246-4f8b7caa039d None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:43.016341 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf925d3-7e01-44f2-8246-4f8b7caa039d None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:43.017353 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf925d3-7e01-44f2-8246-4f8b7caa039d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:43.045951 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-ccf925d3-7e01-44f2-8246-4f8b7caa039d None None] MFA Rules not processed for user `f55e41d453fe40c89b4199fa534d7afd`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:58:43.047194 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-ccf925d3-7e01-44f2-8246-4f8b7caa039d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:43.119075 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1233/2468] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:58:43 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:58:43.131132 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605a3ad-f255-4e56-bbcb-826f30e41b60 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:43.132928 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-e605a3ad-f255-4e56-bbcb-826f30e41b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:43.218088 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605a3ad-f255-4e56-bbcb-826f30e41b60 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:43.221897 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19826104-0420-4101-8360-32e687e24d87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:43.222519 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19826104-0420-4101-8360-32e687e24d87 service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:43.222803 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19826104-0420-4101-8360-32e687e24d87 service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:43.223082 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19826104-0420-4101-8360-32e687e24d87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:43.229712 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:43.237079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19826104-0420-4101-8360-32e687e24d87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:43.238784 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19826104-0420-4101-8360-32e687e24d87 service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:43.250519 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1236/2469] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:58:43 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:58:43.337162 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf925d3-7e01-44f2-8246-4f8b7caa039d None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:43.352025 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf925d3-7e01-44f2-8246-4f8b7caa039d None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:43.356963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ae6bf-0a1f-48b3-bbe5-c8dbee017eca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:43.357680 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ae6bf-0a1f-48b3-bbe5-c8dbee017eca service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:43.358098 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ae6bf-0a1f-48b3-bbe5-c8dbee017eca service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:43.358502 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ae6bf-0a1f-48b3-bbe5-c8dbee017eca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:43.434215 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ae6bf-0a1f-48b3-bbe5-c8dbee017eca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:43.435677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ae6bf-0a1f-48b3-bbe5-c8dbee017eca service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:43.445049 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1234/2470] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:58:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:58:51.493291 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a73eb-6fa6-43f7-b568-215af427d663 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:51.493815 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a73eb-6fa6-43f7-b568-215af427d663 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:51.493967 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a73eb-6fa6-43f7-b568-215af427d663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:51.526963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-502a73eb-6fa6-43f7-b568-215af427d663 None None] MFA Rules not processed for user `7caa973c63e64d639cc2fb55a4955542`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:58:51.528216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-502a73eb-6fa6-43f7-b568-215af427d663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:51.598353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1237/2471] 10.222.0.94 () {58 vars in 1009 bytes} [Wed Aug 24 04:58:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:58:51.653490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ae6bf-0a1f-48b3-bbe5-c8dbee017eca service cinder] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:51.655109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-3c9ae6bf-0a1f-48b3-bbe5-c8dbee017eca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:51.667837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:51.756556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ae6bf-0a1f-48b3-bbe5-c8dbee017eca service cinder] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:51.762850 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa66ad6-6696-4e35-9aa5-0f8b2b9112f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40d2202203204b06a41e57b9d1a300fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:51.764287 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa66ad6-6696-4e35-9aa5-0f8b2b9112f0 service swift] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:51.764710 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa66ad6-6696-4e35-9aa5-0f8b2b9112f0 service swift] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:51.765048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa66ad6-6696-4e35-9aa5-0f8b2b9112f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:51.777430 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa66ad6-6696-4e35-9aa5-0f8b2b9112f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:51.779325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa66ad6-6696-4e35-9aa5-0f8b2b9112f0 service swift] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:51.788169 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1235/2472] 10.222.0.94 () {60 vars in 1384 bytes} [Wed Aug 24 04:58:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:58:58.965367 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a73eb-6fa6-43f7-b568-215af427d663 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:59.046024 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a73eb-6fa6-43f7-b568-215af427d663 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:59.050937 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af71013-8b35-4682-a009-c7d27169a41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:59.051601 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af71013-8b35-4682-a009-c7d27169a41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:59.051879 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af71013-8b35-4682-a009-c7d27169a41a admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:59.052149 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af71013-8b35-4682-a009-c7d27169a41a admin admin] PATH_INFO: `/v3/users/a8ed4ef7d89f403fa7674f91907b6b9a` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:59.053303 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af71013-8b35-4682-a009-c7d27169a41a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8ed4ef7d89f403fa7674f91907b6b9a)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:59.055335 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af71013-8b35-4682-a009-c7d27169a41a admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:59.121651 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6af71013-8b35-4682-a009-c7d27169a41a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8ed4ef7d89f403fa7674f91907b6b9a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:58:59.132424 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6af71013-8b35-4682-a009-c7d27169a41a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8ed4ef7d89f403fa7674f91907b6b9a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:58:59.144337 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6af71013-8b35-4682-a009-c7d27169a41a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8ed4ef7d89f403fa7674f91907b6b9a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:58:59.145941 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6af71013-8b35-4682-a009-c7d27169a41a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8ed4ef7d89f403fa7674f91907b6b9a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:58:59.162200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6af71013-8b35-4682-a009-c7d27169a41a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8ed4ef7d89f403fa7674f91907b6b9a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:58:59.170480 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1238/2473] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:58:58 2022] DELETE /identity/v3/users/a8ed4ef7d89f403fa7674f91907b6b9a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:58:59.175174 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f72f4-1e3b-4322-b744-fca3a09d9511 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:59.175677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f72f4-1e3b-4322-b744-fca3a09d9511 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:59.175763 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f72f4-1e3b-4322-b744-fca3a09d9511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:59.217316 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-357f72f4-1e3b-4322-b744-fca3a09d9511 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:58:59.218600 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-357f72f4-1e3b-4322-b744-fca3a09d9511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:59.300489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1236/2474] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:58:59.313710 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af71013-8b35-4682-a009-c7d27169a41a admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:59.315216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-6af71013-8b35-4682-a009-c7d27169a41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:59.320614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:59.389151 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af71013-8b35-4682-a009-c7d27169a41a admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:59.394167 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7224025-2c7d-478e-85d9-9806a9c9c684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:59.394795 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7224025-2c7d-478e-85d9-9806a9c9c684 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:59.395463 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7224025-2c7d-478e-85d9-9806a9c9c684 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:59.395939 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7224025-2c7d-478e-85d9-9806a9c9c684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:59.408982 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7224025-2c7d-478e-85d9-9806a9c9c684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:59.410842 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7224025-2c7d-478e-85d9-9806a9c9c684 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:59.424350 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1239/2475] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:58:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:58:59.853744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f72f4-1e3b-4322-b744-fca3a09d9511 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:59.855504 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-357f72f4-1e3b-4322-b744-fca3a09d9511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:59.872161 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f72f4-1e3b-4322-b744-fca3a09d9511 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:59.887550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7063fa2-2efd-4157-a0db-e54f23800928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:59.888548 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7063fa2-2efd-4157-a0db-e54f23800928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:59.889541 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7063fa2-2efd-4157-a0db-e54f23800928 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:59.890116 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7063fa2-2efd-4157-a0db-e54f23800928 admin admin] PATH_INFO: `/v3/projects/02bdd0cbf1e54f8b96c553c3b91a59a9` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:59.891488 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7063fa2-2efd-4157-a0db-e54f23800928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02bdd0cbf1e54f8b96c553c3b91a59a9)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:59.893604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7063fa2-2efd-4157-a0db-e54f23800928 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:59.968588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e7063fa2-2efd-4157-a0db-e54f23800928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02bdd0cbf1e54f8b96c553c3b91a59a9', 'request_id': 'req-e7063fa2-2efd-4157-a0db-e54f23800928'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:58:59.976438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e7063fa2-2efd-4157-a0db-e54f23800928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02bdd0cbf1e54f8b96c553c3b91a59a9', 'request_id': 'req-e7063fa2-2efd-4157-a0db-e54f23800928'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:58:59.992883 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e7063fa2-2efd-4157-a0db-e54f23800928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02bdd0cbf1e54f8b96c553c3b91a59a9', 'request_id': 'req-e7063fa2-2efd-4157-a0db-e54f23800928'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:00.008552 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e7063fa2-2efd-4157-a0db-e54f23800928 admin admin] The token cache is being invalidate because project 02bdd0cbf1e54f8b96c553c3b91a59a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:59:00.008839 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e7063fa2-2efd-4157-a0db-e54f23800928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:00.009533 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e7063fa2-2efd-4157-a0db-e54f23800928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:00.011289 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1237/2476] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:58:59 2022] DELETE /identity/v3/projects/02bdd0cbf1e54f8b96c553c3b91a59a9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:00.015389 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7224025-2c7d-478e-85d9-9806a9c9c684 service neutron] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:00.027523 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7224025-2c7d-478e-85d9-9806a9c9c684 service neutron] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:00.106163 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8c62b-7b31-485d-b598-e342249de8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:00.106834 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8c62b-7b31-485d-b598-e342249de8df admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:00.107174 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8c62b-7b31-485d-b598-e342249de8df admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:00.107482 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8c62b-7b31-485d-b598-e342249de8df admin admin] PATH_INFO: `/v3/users/f55e41d453fe40c89b4199fa534d7afd` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:00.109556 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8c62b-7b31-485d-b598-e342249de8df admin admin] RBAC: Authorizing `identity:delete_user(user_id=f55e41d453fe40c89b4199fa534d7afd)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:00.111501 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8c62b-7b31-485d-b598-e342249de8df admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:00.180213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-a4f8c62b-7b31-485d-b598-e342249de8df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f55e41d453fe40c89b4199fa534d7afd'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:00.191292 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-a4f8c62b-7b31-485d-b598-e342249de8df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f55e41d453fe40c89b4199fa534d7afd'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:00.199945 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-a4f8c62b-7b31-485d-b598-e342249de8df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f55e41d453fe40c89b4199fa534d7afd'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:00.200947 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-a4f8c62b-7b31-485d-b598-e342249de8df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f55e41d453fe40c89b4199fa534d7afd'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:00.216052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-a4f8c62b-7b31-485d-b598-e342249de8df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f55e41d453fe40c89b4199fa534d7afd'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:00.222481 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1240/2477] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:59:00 2022] DELETE /identity/v3/users/f55e41d453fe40c89b4199fa534d7afd => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:00.633138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7063fa2-2efd-4157-a0db-e54f23800928 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:00.634960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e7063fa2-2efd-4157-a0db-e54f23800928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:00.657100 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7063fa2-2efd-4157-a0db-e54f23800928 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:00.690038 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:00.752138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8953d-9d6f-4926-b42f-903ba855a706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:00.752138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8953d-9d6f-4926-b42f-903ba855a706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:00.752461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8953d-9d6f-4926-b42f-903ba855a706 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:00.752577 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8953d-9d6f-4926-b42f-903ba855a706 admin admin] PATH_INFO: `/v3/projects/54a41536e81944d1a94801acfd8e6a51` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:00.753944 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8953d-9d6f-4926-b42f-903ba855a706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54a41536e81944d1a94801acfd8e6a51)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:00.756128 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8953d-9d6f-4926-b42f-903ba855a706 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:00.825276 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-7cc8953d-9d6f-4926-b42f-903ba855a706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54a41536e81944d1a94801acfd8e6a51', 'request_id': 'req-7cc8953d-9d6f-4926-b42f-903ba855a706'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:00.832128 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-7cc8953d-9d6f-4926-b42f-903ba855a706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54a41536e81944d1a94801acfd8e6a51', 'request_id': 'req-7cc8953d-9d6f-4926-b42f-903ba855a706'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:00.844500 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-7cc8953d-9d6f-4926-b42f-903ba855a706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54a41536e81944d1a94801acfd8e6a51', 'request_id': 'req-7cc8953d-9d6f-4926-b42f-903ba855a706'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:00.856620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-7cc8953d-9d6f-4926-b42f-903ba855a706 admin admin] The token cache is being invalidate because project 54a41536e81944d1a94801acfd8e6a51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:59:00.856909 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-7cc8953d-9d6f-4926-b42f-903ba855a706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:00.857625 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-7cc8953d-9d6f-4926-b42f-903ba855a706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:00.859468 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1238/2478] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:59:00 2022] DELETE /identity/v3/projects/54a41536e81944d1a94801acfd8e6a51 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:00.864212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477e1fd-8308-4ee4-91f2-946ba2a20b21 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:00.864508 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477e1fd-8308-4ee4-91f2-946ba2a20b21 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:00.864788 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477e1fd-8308-4ee4-91f2-946ba2a20b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:00.887013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-0477e1fd-8308-4ee4-91f2-946ba2a20b21 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:00.888251 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-0477e1fd-8308-4ee4-91f2-946ba2a20b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:00.923122 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:00.973414 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1241/2479] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:00.982034 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0261e-7ee6-47d2-815d-fa3e1facbb39 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:00.982327 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0261e-7ee6-47d2-815d-fa3e1facbb39 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:00.982650 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0261e-7ee6-47d2-815d-fa3e1facbb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:01.003477 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-f2d0261e-7ee6-47d2-815d-fa3e1facbb39 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:01.004650 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-f2d0261e-7ee6-47d2-815d-fa3e1facbb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:01.015742 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1239/2480] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:01.019721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477e1fd-8308-4ee4-91f2-946ba2a20b21 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:01.032824 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477e1fd-8308-4ee4-91f2-946ba2a20b21 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:01.038382 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86a6bb-0fbf-4e46-9af8-30f8918f193f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:01.039005 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86a6bb-0fbf-4e46-9af8-30f8918f193f admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:01.039286 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86a6bb-0fbf-4e46-9af8-30f8918f193f admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:01.039594 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86a6bb-0fbf-4e46-9af8-30f8918f193f admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:01.040253 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b86a6bb-0fbf-4e46-9af8-30f8918f193f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:59:01.040561 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b86a6bb-0fbf-4e46-9af8-30f8918f193f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:01.042237 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b86a6bb-0fbf-4e46-9af8-30f8918f193f admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:01.056549 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1242/2481] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:59:01.061181 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0261e-7ee6-47d2-815d-fa3e1facbb39 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:01.071323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0261e-7ee6-47d2-815d-fa3e1facbb39 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:01.076858 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347584f1-7026-40db-802a-1997771ed63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:01.077533 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347584f1-7026-40db-802a-1997771ed63c admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:01.077820 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347584f1-7026-40db-802a-1997771ed63c admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:01.078091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347584f1-7026-40db-802a-1997771ed63c admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:01.078853 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347584f1-7026-40db-802a-1997771ed63c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:01.080754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347584f1-7026-40db-802a-1997771ed63c admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:01.117542 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1240/2482] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:59:01 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:59:01.118997 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86a6bb-0fbf-4e46-9af8-30f8918f193f admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:01.131900 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86a6bb-0fbf-4e46-9af8-30f8918f193f admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:01.197497 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a083b96-92da-4c09-9f89-2a5137cb85af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:01.198210 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a083b96-92da-4c09-9f89-2a5137cb85af admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:01.198641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a083b96-92da-4c09-9f89-2a5137cb85af admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:01.201799 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a083b96-92da-4c09-9f89-2a5137cb85af admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:01.201799 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a083b96-92da-4c09-9f89-2a5137cb85af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:01.202042 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a083b96-92da-4c09-9f89-2a5137cb85af admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:01.226881 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1243/2483] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:59:01 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:59:01.231929 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347584f1-7026-40db-802a-1997771ed63c admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:01.243399 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347584f1-7026-40db-802a-1997771ed63c admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:01.248503 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8cddc-6ae8-4bd3-a008-00f1cf32c30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:01.249110 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8cddc-6ae8-4bd3-a008-00f1cf32c30c admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:01.249386 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8cddc-6ae8-4bd3-a008-00f1cf32c30c admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:01.249704 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8cddc-6ae8-4bd3-a008-00f1cf32c30c admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:01.250363 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8cddc-6ae8-4bd3-a008-00f1cf32c30c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:01.252218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8cddc-6ae8-4bd3-a008-00f1cf32c30c admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:01.263561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1241/2484] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:59:01.267794 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a083b96-92da-4c09-9f89-2a5137cb85af admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:01.278874 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a083b96-92da-4c09-9f89-2a5137cb85af admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:01.283840 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11022ef2-4e41-471b-852b-6ddb763bde84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:01.284488 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11022ef2-4e41-471b-852b-6ddb763bde84 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:01.284858 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11022ef2-4e41-471b-852b-6ddb763bde84 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:01.285134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11022ef2-4e41-471b-852b-6ddb763bde84 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:01.285812 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11022ef2-4e41-471b-852b-6ddb763bde84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:01.287390 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11022ef2-4e41-471b-852b-6ddb763bde84 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:01.299682 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1244/2485] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:59:01.304008 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8cddc-6ae8-4bd3-a008-00f1cf32c30c admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:01.315704 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8cddc-6ae8-4bd3-a008-00f1cf32c30c admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:01.320492 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20f1cb-429c-40cf-8f02-d41f02666149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:01.321152 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20f1cb-429c-40cf-8f02-d41f02666149 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:01.321459 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20f1cb-429c-40cf-8f02-d41f02666149 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:01.321737 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20f1cb-429c-40cf-8f02-d41f02666149 admin admin] PATH_INFO: `/v3/projects/853e5b2c87904d9f9a483bdd7f427240/users/91ac7189ca974db1b95a15e70102dc32/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:01.338213 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20f1cb-429c-40cf-8f02-d41f02666149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=853e5b2c87904d9f9a483bdd7f427240, user_id=91ac7189ca974db1b95a15e70102dc32, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:01.341875 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20f1cb-429c-40cf-8f02-d41f02666149 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:01.357790 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1242/2486] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:59:01 2022] PUT /identity/v3/projects/853e5b2c87904d9f9a483bdd7f427240/users/91ac7189ca974db1b95a15e70102dc32/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:01.369857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596dce9-dc33-4223-97ab-ab7d5535c85e None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:01.370146 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596dce9-dc33-4223-97ab-ab7d5535c85e None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:01.370423 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596dce9-dc33-4223-97ab-ab7d5535c85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:01.407682 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-1596dce9-dc33-4223-97ab-ab7d5535c85e None None] MFA Rules not processed for user `91ac7189ca974db1b95a15e70102dc32`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:01.408887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-1596dce9-dc33-4223-97ab-ab7d5535c85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:01.480334 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1245/2487] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:01.485127 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20f1cb-429c-40cf-8f02-d41f02666149 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:01.540465 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:01.557006 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20f1cb-429c-40cf-8f02-d41f02666149 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:01.561847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea316a-5e67-46d5-a08b-c24471059a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:01.562453 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea316a-5e67-46d5-a08b-c24471059a47 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:01.562734 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea316a-5e67-46d5-a08b-c24471059a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:01.563009 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea316a-5e67-46d5-a08b-c24471059a47 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:01.563666 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea316a-5e67-46d5-a08b-c24471059a47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:01.565585 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea316a-5e67-46d5-a08b-c24471059a47 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:01.593851 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1243/2488] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:59:01 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:59:01.597953 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596dce9-dc33-4223-97ab-ab7d5535c85e None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:01.608939 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596dce9-dc33-4223-97ab-ab7d5535c85e None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:01.626025 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:01.673281 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e1b4e-ed26-4fae-8168-283864a720b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:01.673929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e1b4e-ed26-4fae-8168-283864a720b4 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:01.674213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e1b4e-ed26-4fae-8168-283864a720b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:01.674493 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e1b4e-ed26-4fae-8168-283864a720b4 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:01.675141 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e1b4e-ed26-4fae-8168-283864a720b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:01.677067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e1b4e-ed26-4fae-8168-283864a720b4 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:01.700281 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1246/2489] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:59:01 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:59:01.705817 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea316a-5e67-46d5-a08b-c24471059a47 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:01.717644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea316a-5e67-46d5-a08b-c24471059a47 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:01.722522 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358e636-3d68-4366-aad7-9085eb4e2196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:01.723133 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358e636-3d68-4366-aad7-9085eb4e2196 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:01.723414 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358e636-3d68-4366-aad7-9085eb4e2196 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:01.723689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358e636-3d68-4366-aad7-9085eb4e2196 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:01.724338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358e636-3d68-4366-aad7-9085eb4e2196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:01.725975 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358e636-3d68-4366-aad7-9085eb4e2196 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:01.737061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1244/2490] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:59:01.741274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e1b4e-ed26-4fae-8168-283864a720b4 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:01.751585 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e1b4e-ed26-4fae-8168-283864a720b4 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:01.756165 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62230b-a04f-44aa-9c12-421dbbc520b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:01.756807 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62230b-a04f-44aa-9c12-421dbbc520b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:01.757084 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62230b-a04f-44aa-9c12-421dbbc520b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:01.757354 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62230b-a04f-44aa-9c12-421dbbc520b2 admin admin] PATH_INFO: `/v3/projects/3c11262aa03f43648028fc328a70bca2/users/5408c166f39d450b9ac8b0d29be7b8f9/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:01.772542 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62230b-a04f-44aa-9c12-421dbbc520b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c11262aa03f43648028fc328a70bca2, user_id=5408c166f39d450b9ac8b0d29be7b8f9, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:01.775204 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62230b-a04f-44aa-9c12-421dbbc520b2 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:01.789047 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1247/2491] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:59:01 2022] PUT /identity/v3/projects/3c11262aa03f43648028fc328a70bca2/users/5408c166f39d450b9ac8b0d29be7b8f9/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:01.793450 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358e636-3d68-4366-aad7-9085eb4e2196 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:01.803661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358e636-3d68-4366-aad7-9085eb4e2196 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:01.862331 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a2870-1275-45bb-92a4-0de370aec392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:01.862947 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a2870-1275-45bb-92a4-0de370aec392 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:01.863224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a2870-1275-45bb-92a4-0de370aec392 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:01.863498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a2870-1275-45bb-92a4-0de370aec392 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:01.864223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a2870-1275-45bb-92a4-0de370aec392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:01.866566 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a2870-1275-45bb-92a4-0de370aec392 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:01.879407 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1245/2492] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:59:01.883750 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62230b-a04f-44aa-9c12-421dbbc520b2 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:01.895155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62230b-a04f-44aa-9c12-421dbbc520b2 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:01.899777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4e857-e2ce-44ee-998b-78415a197e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:01.900432 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4e857-e2ce-44ee-998b-78415a197e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:01.900713 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4e857-e2ce-44ee-998b-78415a197e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:01.900987 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4e857-e2ce-44ee-998b-78415a197e5b admin admin] PATH_INFO: `/v3/projects/3c11262aa03f43648028fc328a70bca2/users/5408c166f39d450b9ac8b0d29be7b8f9/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:01.903171 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4e857-e2ce-44ee-998b-78415a197e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c11262aa03f43648028fc328a70bca2, user_id=5408c166f39d450b9ac8b0d29be7b8f9, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:01.905923 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4e857-e2ce-44ee-998b-78415a197e5b admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:01.917204 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1248/2493] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:59:01 2022] PUT /identity/v3/projects/3c11262aa03f43648028fc328a70bca2/users/5408c166f39d450b9ac8b0d29be7b8f9/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:01.927880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce637510-3484-4d05-af68-b63f29ac40a0 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:01.928164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce637510-3484-4d05-af68-b63f29ac40a0 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:01.928496 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce637510-3484-4d05-af68-b63f29ac40a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:01.960282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-ce637510-3484-4d05-af68-b63f29ac40a0 None None] MFA Rules not processed for user `5408c166f39d450b9ac8b0d29be7b8f9`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:01.961585 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-ce637510-3484-4d05-af68-b63f29ac40a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:02.031030 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1246/2494] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:01 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:02.043649 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4e857-e2ce-44ee-998b-78415a197e5b admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:02.045457 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-c4f4e857-e2ce-44ee-998b-78415a197e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:02.110788 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4e857-e2ce-44ee-998b-78415a197e5b admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:02.114447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af25ab3-b0d9-42dd-b865-64551d995ba7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:02.115055 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af25ab3-b0d9-42dd-b865-64551d995ba7 service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:02.115334 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af25ab3-b0d9-42dd-b865-64551d995ba7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:02.115602 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af25ab3-b0d9-42dd-b865-64551d995ba7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:02.126303 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af25ab3-b0d9-42dd-b865-64551d995ba7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:02.127734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af25ab3-b0d9-42dd-b865-64551d995ba7 service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:02.139181 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1249/2495] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:02 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:59:02.504899 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce637510-3484-4d05-af68-b63f29ac40a0 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:02.515356 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce637510-3484-4d05-af68-b63f29ac40a0 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:02.520503 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9f14b-3787-4621-a0ae-aff99e4905a6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5408c166f39d450b9ac8b0d29be7b8f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c11262aa03f43648028fc328a70bca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:02.520972 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9f14b-3787-4621-a0ae-aff99e4905a6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:02.521252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9f14b-3787-4621-a0ae-aff99e4905a6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:02.521631 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9f14b-3787-4621-a0ae-aff99e4905a6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:02.522936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9f14b-3787-4621-a0ae-aff99e4905a6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:59:02.522936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9f14b-3787-4621-a0ae-aff99e4905a6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:02.524377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9f14b-3787-4621-a0ae-aff99e4905a6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:02.542837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1247/2496] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:59:02.544590 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af25ab3-b0d9-42dd-b865-64551d995ba7 service cinder] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:02.555690 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af25ab3-b0d9-42dd-b865-64551d995ba7 service cinder] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:02.561893 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91784309-4aca-4879-8438-f6ffe0e46541 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5408c166f39d450b9ac8b0d29be7b8f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c11262aa03f43648028fc328a70bca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:02.562615 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91784309-4aca-4879-8438-f6ffe0e46541 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:02.562957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91784309-4aca-4879-8438-f6ffe0e46541 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:02.563291 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91784309-4aca-4879-8438-f6ffe0e46541 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:02.563980 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91784309-4aca-4879-8438-f6ffe0e46541 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:02.566050 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91784309-4aca-4879-8438-f6ffe0e46541 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:02.600622 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1250/2497] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:59:02 2022] POST /identity/v3/projects => generated 355 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:59:02.602204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9f14b-3787-4621-a0ae-aff99e4905a6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:02.613730 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9f14b-3787-4621-a0ae-aff99e4905a6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:02.645299 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:02.678664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eed22d-175b-42ba-ba20-6652180fbeb6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5408c166f39d450b9ac8b0d29be7b8f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c11262aa03f43648028fc328a70bca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:02.679779 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eed22d-175b-42ba-ba20-6652180fbeb6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:02.680064 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eed22d-175b-42ba-ba20-6652180fbeb6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:02.680404 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eed22d-175b-42ba-ba20-6652180fbeb6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:02.681120 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eed22d-175b-42ba-ba20-6652180fbeb6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:59:02.681345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eed22d-175b-42ba-ba20-6652180fbeb6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:02.683056 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eed22d-175b-42ba-ba20-6652180fbeb6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:02.697140 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1248/2498] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:59:02.740339 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91784309-4aca-4879-8438-f6ffe0e46541 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:02.751975 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91784309-4aca-4879-8438-f6ffe0e46541 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:02.757294 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56ad47-06b2-44db-be5e-32cb6c9914e6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5408c166f39d450b9ac8b0d29be7b8f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c11262aa03f43648028fc328a70bca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:02.758000 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56ad47-06b2-44db-be5e-32cb6c9914e6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:02.758288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56ad47-06b2-44db-be5e-32cb6c9914e6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:02.758567 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56ad47-06b2-44db-be5e-32cb6c9914e6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] PATH_INFO: `/v3/projects/dfb64682d9a84041a7eb49973b20d021` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:02.759758 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56ad47-06b2-44db-be5e-32cb6c9914e6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dfb64682d9a84041a7eb49973b20d021)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:02.761868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56ad47-06b2-44db-be5e-32cb6c9914e6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:02.814096 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:02.815593 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ad56ad47-06b2-44db-be5e-32cb6c9914e6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfb64682d9a84041a7eb49973b20d021', 'request_id': 'req-ad56ad47-06b2-44db-be5e-32cb6c9914e6'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:02.829300 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ad56ad47-06b2-44db-be5e-32cb6c9914e6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfb64682d9a84041a7eb49973b20d021', 'request_id': 'req-ad56ad47-06b2-44db-be5e-32cb6c9914e6'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:02.842212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ad56ad47-06b2-44db-be5e-32cb6c9914e6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfb64682d9a84041a7eb49973b20d021', 'request_id': 'req-ad56ad47-06b2-44db-be5e-32cb6c9914e6'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:02.854196 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ad56ad47-06b2-44db-be5e-32cb6c9914e6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] The token cache is being invalidate because project dfb64682d9a84041a7eb49973b20d021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:59:02.854487 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ad56ad47-06b2-44db-be5e-32cb6c9914e6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:02.855174 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ad56ad47-06b2-44db-be5e-32cb6c9914e6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:02.857364 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1251/2499] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:59:02 2022] DELETE /identity/v3/projects/dfb64682d9a84041a7eb49973b20d021 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:03.068346 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eed22d-175b-42ba-ba20-6652180fbeb6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:03.070122 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-f7eed22d-175b-42ba-ba20-6652180fbeb6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:03.139822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eed22d-175b-42ba-ba20-6652180fbeb6 tempest-VolumeQuotaClassesTest-2060838003 tempest-VolumeQuotaClassesTest-2060838003-project-admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:03.198650 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16484fef-5fbf-440c-b4b2-f7d368881d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:03.199354 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16484fef-5fbf-440c-b4b2-f7d368881d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:03.199801 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16484fef-5fbf-440c-b4b2-f7d368881d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:03.200265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16484fef-5fbf-440c-b4b2-f7d368881d10 admin admin] PATH_INFO: `/v3/users/91ac7189ca974db1b95a15e70102dc32` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:03.201470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16484fef-5fbf-440c-b4b2-f7d368881d10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91ac7189ca974db1b95a15e70102dc32)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:03.203443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16484fef-5fbf-440c-b4b2-f7d368881d10 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:03.255213 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-16484fef-5fbf-440c-b4b2-f7d368881d10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91ac7189ca974db1b95a15e70102dc32'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:03.255884 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-16484fef-5fbf-440c-b4b2-f7d368881d10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91ac7189ca974db1b95a15e70102dc32'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:03.263678 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-16484fef-5fbf-440c-b4b2-f7d368881d10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91ac7189ca974db1b95a15e70102dc32'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:03.276316 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-16484fef-5fbf-440c-b4b2-f7d368881d10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91ac7189ca974db1b95a15e70102dc32'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:03.278868 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:03.286209 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-16484fef-5fbf-440c-b4b2-f7d368881d10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91ac7189ca974db1b95a15e70102dc32'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:03.292795 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1249/2500] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:59:03 2022] DELETE /identity/v3/users/91ac7189ca974db1b95a15e70102dc32 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:03.297894 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c1be4-1ad4-48e9-a653-a7c4089da02f None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:03.298380 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c1be4-1ad4-48e9-a653-a7c4089da02f None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:03.298484 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c1be4-1ad4-48e9-a653-a7c4089da02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:03.317568 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-9a2c1be4-1ad4-48e9-a653-a7c4089da02f None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:03.318766 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-9a2c1be4-1ad4-48e9-a653-a7c4089da02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:03.377388 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1252/2501] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:03.387107 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16484fef-5fbf-440c-b4b2-f7d368881d10 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:03.388544 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-16484fef-5fbf-440c-b4b2-f7d368881d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:03.446700 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16484fef-5fbf-440c-b4b2-f7d368881d10 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:03.450372 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9920d-1469-423e-9195-5d0edb353e92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:03.450978 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9920d-1469-423e-9195-5d0edb353e92 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:03.451255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9920d-1469-423e-9195-5d0edb353e92 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:03.451528 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9920d-1469-423e-9195-5d0edb353e92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:03.460883 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9920d-1469-423e-9195-5d0edb353e92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:03.462442 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9920d-1469-423e-9195-5d0edb353e92 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:03.472526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1250/2502] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:59:03.752681 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c1be4-1ad4-48e9-a653-a7c4089da02f None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:03.754259 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-9a2c1be4-1ad4-48e9-a653-a7c4089da02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:03.767481 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c1be4-1ad4-48e9-a653-a7c4089da02f None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:03.773552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea4e1b-5375-46e3-ab33-14b5b87dec85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:03.774710 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea4e1b-5375-46e3-ab33-14b5b87dec85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:03.775162 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea4e1b-5375-46e3-ab33-14b5b87dec85 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:03.775442 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea4e1b-5375-46e3-ab33-14b5b87dec85 admin admin] PATH_INFO: `/v3/projects/853e5b2c87904d9f9a483bdd7f427240` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:03.776587 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea4e1b-5375-46e3-ab33-14b5b87dec85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=853e5b2c87904d9f9a483bdd7f427240)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:03.779438 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea4e1b-5375-46e3-ab33-14b5b87dec85 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:03.826659 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b6ea4e1b-5375-46e3-ab33-14b5b87dec85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '853e5b2c87904d9f9a483bdd7f427240', 'request_id': 'req-b6ea4e1b-5375-46e3-ab33-14b5b87dec85'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:03.833038 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b6ea4e1b-5375-46e3-ab33-14b5b87dec85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '853e5b2c87904d9f9a483bdd7f427240', 'request_id': 'req-b6ea4e1b-5375-46e3-ab33-14b5b87dec85'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:03.841322 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b6ea4e1b-5375-46e3-ab33-14b5b87dec85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '853e5b2c87904d9f9a483bdd7f427240', 'request_id': 'req-b6ea4e1b-5375-46e3-ab33-14b5b87dec85'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:03.851854 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b6ea4e1b-5375-46e3-ab33-14b5b87dec85 admin admin] The token cache is being invalidate because project 853e5b2c87904d9f9a483bdd7f427240 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:59:03.852224 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b6ea4e1b-5375-46e3-ab33-14b5b87dec85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:03.852790 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-b6ea4e1b-5375-46e3-ab33-14b5b87dec85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:03.854316 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1253/2503] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:59:03 2022] DELETE /identity/v3/projects/853e5b2c87904d9f9a483bdd7f427240 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:03.858373 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9920d-1469-423e-9195-5d0edb353e92 service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:03.868147 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9920d-1469-423e-9195-5d0edb353e92 service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:03.927313 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8c041-3fce-4f0c-bfb2-d7ce048f3da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:03.927951 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8c041-3fce-4f0c-bfb2-d7ce048f3da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:03.928225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8c041-3fce-4f0c-bfb2-d7ce048f3da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:03.928495 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8c041-3fce-4f0c-bfb2-d7ce048f3da5 admin admin] PATH_INFO: `/v3/users/5408c166f39d450b9ac8b0d29be7b8f9` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:03.929662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8c041-3fce-4f0c-bfb2-d7ce048f3da5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5408c166f39d450b9ac8b0d29be7b8f9)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:03.931573 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8c041-3fce-4f0c-bfb2-d7ce048f3da5 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:03.981312 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-52a8c041-3fce-4f0c-bfb2-d7ce048f3da5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5408c166f39d450b9ac8b0d29be7b8f9'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:03.981999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-52a8c041-3fce-4f0c-bfb2-d7ce048f3da5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5408c166f39d450b9ac8b0d29be7b8f9'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:03.990080 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-52a8c041-3fce-4f0c-bfb2-d7ce048f3da5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5408c166f39d450b9ac8b0d29be7b8f9'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:04.003723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-52a8c041-3fce-4f0c-bfb2-d7ce048f3da5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5408c166f39d450b9ac8b0d29be7b8f9'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:04.015354 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-52a8c041-3fce-4f0c-bfb2-d7ce048f3da5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5408c166f39d450b9ac8b0d29be7b8f9'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:04.021682 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1251/2504] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:59:03 2022] DELETE /identity/v3/users/5408c166f39d450b9ac8b0d29be7b8f9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:04.311993 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea4e1b-5375-46e3-ab33-14b5b87dec85 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:04.313981 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-b6ea4e1b-5375-46e3-ab33-14b5b87dec85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:04.337348 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea4e1b-5375-46e3-ab33-14b5b87dec85 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:04.420567 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0430c1-2c9d-4609-96eb-21e86831dd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:04.421265 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0430c1-2c9d-4609-96eb-21e86831dd00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:04.421525 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0430c1-2c9d-4609-96eb-21e86831dd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:04.421801 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0430c1-2c9d-4609-96eb-21e86831dd00 admin admin] PATH_INFO: `/v3/projects/3c11262aa03f43648028fc328a70bca2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:04.423212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0430c1-2c9d-4609-96eb-21e86831dd00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c11262aa03f43648028fc328a70bca2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:04.425242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0430c1-2c9d-4609-96eb-21e86831dd00 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:04.427126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:04.498532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-3b0430c1-2c9d-4609-96eb-21e86831dd00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c11262aa03f43648028fc328a70bca2', 'request_id': 'req-3b0430c1-2c9d-4609-96eb-21e86831dd00'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:04.505031 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-3b0430c1-2c9d-4609-96eb-21e86831dd00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c11262aa03f43648028fc328a70bca2', 'request_id': 'req-3b0430c1-2c9d-4609-96eb-21e86831dd00'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:04.514061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-3b0430c1-2c9d-4609-96eb-21e86831dd00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c11262aa03f43648028fc328a70bca2', 'request_id': 'req-3b0430c1-2c9d-4609-96eb-21e86831dd00'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:04.525017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-3b0430c1-2c9d-4609-96eb-21e86831dd00 admin admin] The token cache is being invalidate because project 3c11262aa03f43648028fc328a70bca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:59:04.525308 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-3b0430c1-2c9d-4609-96eb-21e86831dd00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:04.525984 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-3b0430c1-2c9d-4609-96eb-21e86831dd00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:04.528176 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1254/2505] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:59:04 2022] DELETE /identity/v3/projects/3c11262aa03f43648028fc328a70bca2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:04.533084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13903a2-e7f1-4f87-bcb9-a01989095a2b None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:04.533626 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13903a2-e7f1-4f87-bcb9-a01989095a2b None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:04.533721 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13903a2-e7f1-4f87-bcb9-a01989095a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:04.553325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-d13903a2-e7f1-4f87-bcb9-a01989095a2b None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:04.554581 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-d13903a2-e7f1-4f87-bcb9-a01989095a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:04.563817 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:04.624860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1252/2506] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:04.634424 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fc270-4bde-491b-a159-bce737bb8e4c None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:04.634714 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fc270-4bde-491b-a159-bce737bb8e4c None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:04.634995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fc270-4bde-491b-a159-bce737bb8e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:04.658264 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-bd6fc270-4bde-491b-a159-bce737bb8e4c None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:04.659567 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-bd6fc270-4bde-491b-a159-bce737bb8e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:04.667642 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1255/2507] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:04.672029 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13903a2-e7f1-4f87-bcb9-a01989095a2b None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:04.682124 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13903a2-e7f1-4f87-bcb9-a01989095a2b None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:04.687473 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8dbd8-df5d-424f-9436-2e0bc2e05dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:04.688198 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8dbd8-df5d-424f-9436-2e0bc2e05dad admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:04.688366 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8dbd8-df5d-424f-9436-2e0bc2e05dad admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:04.688633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8dbd8-df5d-424f-9436-2e0bc2e05dad admin admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:04.689313 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8dbd8-df5d-424f-9436-2e0bc2e05dad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:59:04.689680 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8dbd8-df5d-424f-9436-2e0bc2e05dad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:04.691297 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8dbd8-df5d-424f-9436-2e0bc2e05dad admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:04.705918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1253/2508] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:59:04.710323 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fc270-4bde-491b-a159-bce737bb8e4c None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:04.724586 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fc270-4bde-491b-a159-bce737bb8e4c None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:04.732559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe7f8c-414f-4ce3-ae66-eea543faea9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:04.733453 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe7f8c-414f-4ce3-ae66-eea543faea9b admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:04.733850 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe7f8c-414f-4ce3-ae66-eea543faea9b admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:04.734215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe7f8c-414f-4ce3-ae66-eea543faea9b admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:04.734944 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe7f8c-414f-4ce3-ae66-eea543faea9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:04.737001 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe7f8c-414f-4ce3-ae66-eea543faea9b admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:04.775424 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1256/2509] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:59:04 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:59:04.781158 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8dbd8-df5d-424f-9436-2e0bc2e05dad admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:04.792142 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8dbd8-df5d-424f-9436-2e0bc2e05dad admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:04.857123 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf78fef-a1a7-48b1-bf5a-bf4b2f5352bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:04.857775 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf78fef-a1a7-48b1-bf5a-bf4b2f5352bb admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:04.858058 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf78fef-a1a7-48b1-bf5a-bf4b2f5352bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:04.858333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf78fef-a1a7-48b1-bf5a-bf4b2f5352bb admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:04.859103 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf78fef-a1a7-48b1-bf5a-bf4b2f5352bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:04.861350 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf78fef-a1a7-48b1-bf5a-bf4b2f5352bb admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:04.889694 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1254/2510] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:59:04 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:59:04.891073 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe7f8c-414f-4ce3-ae66-eea543faea9b admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:04.902251 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe7f8c-414f-4ce3-ae66-eea543faea9b admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:04.908429 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c68474-ba45-4d4b-93ed-62d189fb89cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:04.909047 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c68474-ba45-4d4b-93ed-62d189fb89cd admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:04.909334 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c68474-ba45-4d4b-93ed-62d189fb89cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:04.909652 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c68474-ba45-4d4b-93ed-62d189fb89cd admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:04.910314 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c68474-ba45-4d4b-93ed-62d189fb89cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:04.912804 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c68474-ba45-4d4b-93ed-62d189fb89cd admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:04.931309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1257/2511] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:59:04.937032 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf78fef-a1a7-48b1-bf5a-bf4b2f5352bb admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:04.947392 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf78fef-a1a7-48b1-bf5a-bf4b2f5352bb admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:04.952848 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790432a-c462-48f3-a4be-abe1f0474030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:04.953491 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790432a-c462-48f3-a4be-abe1f0474030 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:04.953777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790432a-c462-48f3-a4be-abe1f0474030 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:04.954083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790432a-c462-48f3-a4be-abe1f0474030 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:04.954732 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790432a-c462-48f3-a4be-abe1f0474030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:04.956333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790432a-c462-48f3-a4be-abe1f0474030 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:04.967816 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1255/2512] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:59:04.972115 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c68474-ba45-4d4b-93ed-62d189fb89cd admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:04.982572 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c68474-ba45-4d4b-93ed-62d189fb89cd admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:04.987470 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e01b55-a838-40cb-9200-f9564ef02ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:04.988125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e01b55-a838-40cb-9200-f9564ef02ce2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:04.988404 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e01b55-a838-40cb-9200-f9564ef02ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:04.988678 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e01b55-a838-40cb-9200-f9564ef02ce2 admin admin] PATH_INFO: `/v3/projects/386e84e281ca44db86f42daec9359fe9/users/5831a7804e2a4c1581a53decc0f89724/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:05.004691 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e01b55-a838-40cb-9200-f9564ef02ce2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=386e84e281ca44db86f42daec9359fe9, user_id=5831a7804e2a4c1581a53decc0f89724, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:05.007477 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e01b55-a838-40cb-9200-f9564ef02ce2 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:05.021814 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1258/2513] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:59:04 2022] PUT /identity/v3/projects/386e84e281ca44db86f42daec9359fe9/users/5831a7804e2a4c1581a53decc0f89724/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:05.033976 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2bc70-3f95-42e0-a584-3748fcf5a13a None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:05.034260 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2bc70-3f95-42e0-a584-3748fcf5a13a None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:05.034562 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2bc70-3f95-42e0-a584-3748fcf5a13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:05.063652 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-edb2bc70-3f95-42e0-a584-3748fcf5a13a None None] MFA Rules not processed for user `5831a7804e2a4c1581a53decc0f89724`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:05.064874 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-edb2bc70-3f95-42e0-a584-3748fcf5a13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:05.135310 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1256/2514] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:05.147535 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e01b55-a838-40cb-9200-f9564ef02ce2 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:05.149944 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-95e01b55-a838-40cb-9200-f9564ef02ce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:05.213380 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e01b55-a838-40cb-9200-f9564ef02ce2 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:05.216694 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbb464-b859-4e9b-a92d-7850e55e94b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:05.217329 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbb464-b859-4e9b-a92d-7850e55e94b8 service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:05.217676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbb464-b859-4e9b-a92d-7850e55e94b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:05.217994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbb464-b859-4e9b-a92d-7850e55e94b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:05.227442 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbb464-b859-4e9b-a92d-7850e55e94b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:05.228906 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbb464-b859-4e9b-a92d-7850e55e94b8 service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:05.239454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1259/2515] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:59:06.360046 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccea1d5-4f9e-4534-9bc8-ca8114436ab1 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:06.360593 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccea1d5-4f9e-4534-9bc8-ca8114436ab1 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:06.360593 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccea1d5-4f9e-4534-9bc8-ca8114436ab1 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:06.361994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1257/2516] 10.222.0.94 () {54 vars in 921 bytes} [Wed Aug 24 04:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:59:06.368980 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4392a-0717-4a5d-bce1-c2eaf8fb80b9 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:06.369744 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4392a-0717-4a5d-bce1-c2eaf8fb80b9 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:06.369744 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4392a-0717-4a5d-bce1-c2eaf8fb80b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:06.420926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-40e4392a-0717-4a5d-bce1-c2eaf8fb80b9 None None] MFA Rules not processed for user `5bdbda2b9c8f48338c5117585a229cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:06.422076 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-40e4392a-0717-4a5d-bce1-c2eaf8fb80b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:06.440340 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:06.538711 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1260/2517] 10.222.0.94 () {58 vars in 1018 bytes} [Wed Aug 24 04:59:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:59:06.551000 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccea1d5-4f9e-4534-9bc8-ca8114436ab1 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:06.553436 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-4ccea1d5-4f9e-4534-9bc8-ca8114436ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:06.569091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:06.650623 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccea1d5-4f9e-4534-9bc8-ca8114436ab1 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:06.655109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227a070-8dbd-44b9-ae37-fc0a4d6210cf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbec984d81c84035887220056b3790ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:06.656068 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227a070-8dbd-44b9-ae37-fc0a4d6210cf service glance] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:06.656068 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227a070-8dbd-44b9-ae37-fc0a4d6210cf service glance] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:06.656373 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227a070-8dbd-44b9-ae37-fc0a4d6210cf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:06.669271 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227a070-8dbd-44b9-ae37-fc0a4d6210cf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:06.671365 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227a070-8dbd-44b9-ae37-fc0a4d6210cf service glance] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:06.702277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1258/2518] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:59:06.812913 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29cc79-d9de-4761-a823-76d0c59ce930 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:06.813200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29cc79-d9de-4761-a823-76d0c59ce930 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:06.813490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29cc79-d9de-4761-a823-76d0c59ce930 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:06.815051 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1261/2519] 10.222.0.94 () {54 vars in 921 bytes} [Wed Aug 24 04:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:59:06.820575 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769e29f-d581-4365-85bb-62af0ec18fb6 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:06.820907 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769e29f-d581-4365-85bb-62af0ec18fb6 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:06.821781 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769e29f-d581-4365-85bb-62af0ec18fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:06.844665 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-c769e29f-d581-4365-85bb-62af0ec18fb6 None None] MFA Rules not processed for user `0742c7ecf68d40a38c8947a05eee2797`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:06.845894 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-c769e29f-d581-4365-85bb-62af0ec18fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:06.933931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1259/2520] 10.222.0.94 () {58 vars in 1018 bytes} [Wed Aug 24 04:59:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:06.946485 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29cc79-d9de-4761-a823-76d0c59ce930 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:06.948328 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-7a29cc79-d9de-4761-a823-76d0c59ce930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:06.965009 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29cc79-d9de-4761-a823-76d0c59ce930 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:06.969385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc560651-2e90-44c2-9c6d-fec7abb21a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:06.970063 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc560651-2e90-44c2-9c6d-fec7abb21a69 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:06.970347 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc560651-2e90-44c2-9c6d-fec7abb21a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:06.970628 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc560651-2e90-44c2-9c6d-fec7abb21a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:06.978904 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc560651-2e90-44c2-9c6d-fec7abb21a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:06.980358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc560651-2e90-44c2-9c6d-fec7abb21a69 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:06.990156 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1262/2521] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:59:07.082801 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1a476-4504-4d51-817a-9b3ff8dcd328 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:07.083093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1a476-4504-4d51-817a-9b3ff8dcd328 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:07.083374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1a476-4504-4d51-817a-9b3ff8dcd328 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:07.084765 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1260/2522] 10.222.0.94 () {54 vars in 921 bytes} [Wed Aug 24 04:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:59:07.091083 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a9816-2d22-4897-bb08-53b637b98d29 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:07.091394 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a9816-2d22-4897-bb08-53b637b98d29 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:07.091853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a9816-2d22-4897-bb08-53b637b98d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:07.113698 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-ef7a9816-2d22-4897-bb08-53b637b98d29 None None] MFA Rules not processed for user `5bdbda2b9c8f48338c5117585a229cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:07.114913 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ef7a9816-2d22-4897-bb08-53b637b98d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:07.124461 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1263/2523] 10.222.0.94 () {58 vars in 1018 bytes} [Wed Aug 24 04:59:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:07.135315 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1a476-4504-4d51-817a-9b3ff8dcd328 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:07.146714 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1a476-4504-4d51-817a-9b3ff8dcd328 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:07.150374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c68c71-3773-4897-a633-33d0dbd93c98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:07.150975 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c68c71-3773-4897-a633-33d0dbd93c98 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:07.151255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c68c71-3773-4897-a633-33d0dbd93c98 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:07.151522 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c68c71-3773-4897-a633-33d0dbd93c98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:07.163123 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c68c71-3773-4897-a633-33d0dbd93c98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:07.164576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c68c71-3773-4897-a633-33d0dbd93c98 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:07.177135 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1261/2524] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:59:09.909117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff8dca-2dc3-4064-a0d3-8ad3af0646fd None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:09.909802 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff8dca-2dc3-4064-a0d3-8ad3af0646fd None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:09.909802 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff8dca-2dc3-4064-a0d3-8ad3af0646fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:09.931077 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-12ff8dca-2dc3-4064-a0d3-8ad3af0646fd None None] MFA Rules not processed for user `7caa973c63e64d639cc2fb55a4955542`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:09.932506 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-12ff8dca-2dc3-4064-a0d3-8ad3af0646fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:09.994613 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1264/2525] 10.222.0.94 () {58 vars in 1009 bytes} [Wed Aug 24 04:59:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:10.009211 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c68c71-3773-4897-a633-33d0dbd93c98 service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:10.010824 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-89c68c71-3773-4897-a633-33d0dbd93c98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:10.097334 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c68c71-3773-4897-a633-33d0dbd93c98 service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:10.102533 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432bc04-7ef6-47e1-a3cb-62bed52afcc5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40d2202203204b06a41e57b9d1a300fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:10.103218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432bc04-7ef6-47e1-a3cb-62bed52afcc5 service swift] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:10.103349 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432bc04-7ef6-47e1-a3cb-62bed52afcc5 service swift] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:10.103601 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432bc04-7ef6-47e1-a3cb-62bed52afcc5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:10.113200 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432bc04-7ef6-47e1-a3cb-62bed52afcc5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:10.114946 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432bc04-7ef6-47e1-a3cb-62bed52afcc5 service swift] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:10.124990 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1262/2526] 10.222.0.94 () {60 vars in 1384 bytes} [Wed Aug 24 04:59:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:59:10.932776 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff8dca-2dc3-4064-a0d3-8ad3af0646fd None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:11.024101 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff8dca-2dc3-4064-a0d3-8ad3af0646fd None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:11.029606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e24f5-d6c9-4a68-818b-8be5fc35ab49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:11.030294 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e24f5-d6c9-4a68-818b-8be5fc35ab49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:11.030601 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e24f5-d6c9-4a68-818b-8be5fc35ab49 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:11.031051 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e24f5-d6c9-4a68-818b-8be5fc35ab49 admin admin] PATH_INFO: `/v3/users/5831a7804e2a4c1581a53decc0f89724` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:11.033071 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e24f5-d6c9-4a68-818b-8be5fc35ab49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5831a7804e2a4c1581a53decc0f89724)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:11.036958 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e24f5-d6c9-4a68-818b-8be5fc35ab49 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:11.094209 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:11.121120 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-025e24f5-d6c9-4a68-818b-8be5fc35ab49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5831a7804e2a4c1581a53decc0f89724'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:11.152143 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-025e24f5-d6c9-4a68-818b-8be5fc35ab49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5831a7804e2a4c1581a53decc0f89724'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:11.172762 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-025e24f5-d6c9-4a68-818b-8be5fc35ab49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5831a7804e2a4c1581a53decc0f89724'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:11.175039 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-025e24f5-d6c9-4a68-818b-8be5fc35ab49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5831a7804e2a4c1581a53decc0f89724'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:11.208207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-025e24f5-d6c9-4a68-818b-8be5fc35ab49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5831a7804e2a4c1581a53decc0f89724'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:11.216842 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1265/2527] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:59:10 2022] DELETE /identity/v3/users/5831a7804e2a4c1581a53decc0f89724 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:11.223795 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f59f8-15a6-4e49-8eaf-b0bb6756c773 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:11.224631 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f59f8-15a6-4e49-8eaf-b0bb6756c773 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:11.224789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f59f8-15a6-4e49-8eaf-b0bb6756c773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:11.252871 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-419f59f8-15a6-4e49-8eaf-b0bb6756c773 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:11.254177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-419f59f8-15a6-4e49-8eaf-b0bb6756c773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:11.291900 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:11.323145 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1263/2528] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:11.336320 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e24f5-d6c9-4a68-818b-8be5fc35ab49 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:11.337812 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-025e24f5-d6c9-4a68-818b-8be5fc35ab49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:11.439138 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e24f5-d6c9-4a68-818b-8be5fc35ab49 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:11.443813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700ab25-8c0f-426c-9fa1-d76d969733cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:11.444782 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700ab25-8c0f-426c-9fa1-d76d969733cd service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:11.445230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700ab25-8c0f-426c-9fa1-d76d969733cd service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:11.445720 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700ab25-8c0f-426c-9fa1-d76d969733cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:11.459924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700ab25-8c0f-426c-9fa1-d76d969733cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:11.461365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700ab25-8c0f-426c-9fa1-d76d969733cd service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:11.474051 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1266/2529] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:59:11.938895 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f59f8-15a6-4e49-8eaf-b0bb6756c773 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:11.940672 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-419f59f8-15a6-4e49-8eaf-b0bb6756c773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:11.958391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f59f8-15a6-4e49-8eaf-b0bb6756c773 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:11.978534 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dde35-a48e-4622-89d6-21046e096f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:11.979194 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dde35-a48e-4622-89d6-21046e096f6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:11.979470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dde35-a48e-4622-89d6-21046e096f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:11.979737 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dde35-a48e-4622-89d6-21046e096f6b admin admin] PATH_INFO: `/v3/projects/386e84e281ca44db86f42daec9359fe9` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:11.982654 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dde35-a48e-4622-89d6-21046e096f6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=386e84e281ca44db86f42daec9359fe9)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:11.984661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dde35-a48e-4622-89d6-21046e096f6b admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:12.065289 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e99dde35-a48e-4622-89d6-21046e096f6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '386e84e281ca44db86f42daec9359fe9', 'request_id': 'req-e99dde35-a48e-4622-89d6-21046e096f6b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:12.071738 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e99dde35-a48e-4622-89d6-21046e096f6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '386e84e281ca44db86f42daec9359fe9', 'request_id': 'req-e99dde35-a48e-4622-89d6-21046e096f6b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:12.083829 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e99dde35-a48e-4622-89d6-21046e096f6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '386e84e281ca44db86f42daec9359fe9', 'request_id': 'req-e99dde35-a48e-4622-89d6-21046e096f6b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:12.107224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e99dde35-a48e-4622-89d6-21046e096f6b admin admin] The token cache is being invalidate because project 386e84e281ca44db86f42daec9359fe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:59:12.107727 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e99dde35-a48e-4622-89d6-21046e096f6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:12.108660 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-e99dde35-a48e-4622-89d6-21046e096f6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:12.111672 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1264/2530] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:59:11 2022] DELETE /identity/v3/projects/386e84e281ca44db86f42daec9359fe9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:12.117873 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5e328-3d72-43c3-ba65-ca3a425c7281 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:12.118490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5e328-3d72-43c3-ba65-ca3a425c7281 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:12.118662 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5e328-3d72-43c3-ba65-ca3a425c7281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:12.145370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-63a5e328-3d72-43c3-ba65-ca3a425c7281 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:12.146948 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-63a5e328-3d72-43c3-ba65-ca3a425c7281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:12.222328 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1267/2531] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:12.236962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b71c0-8feb-4939-b865-c723ccb5b9b4 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:12.237547 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b71c0-8feb-4939-b865-c723ccb5b9b4 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:12.237547 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b71c0-8feb-4939-b865-c723ccb5b9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:12.261445 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-675b71c0-8feb-4939-b865-c723ccb5b9b4 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:12.262718 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-675b71c0-8feb-4939-b865-c723ccb5b9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:12.272823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1265/2532] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:12.276655 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5e328-3d72-43c3-ba65-ca3a425c7281 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:12.287573 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5e328-3d72-43c3-ba65-ca3a425c7281 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:12.292765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ea3f5-9990-4542-99ae-7b6947a3a779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:12.293432 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ea3f5-9990-4542-99ae-7b6947a3a779 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:12.293705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ea3f5-9990-4542-99ae-7b6947a3a779 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:12.294955 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ea3f5-9990-4542-99ae-7b6947a3a779 admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:12.295642 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ea3f5-9990-4542-99ae-7b6947a3a779 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:59:12.295950 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ea3f5-9990-4542-99ae-7b6947a3a779 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:12.297630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ea3f5-9990-4542-99ae-7b6947a3a779 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:12.311221 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1268/2533] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:59:12.315980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b71c0-8feb-4939-b865-c723ccb5b9b4 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:12.326788 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b71c0-8feb-4939-b865-c723ccb5b9b4 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:12.332564 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90699ef-c54b-4db2-8c2a-220f5771ff27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:12.333487 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90699ef-c54b-4db2-8c2a-220f5771ff27 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:12.333780 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90699ef-c54b-4db2-8c2a-220f5771ff27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:12.334174 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90699ef-c54b-4db2-8c2a-220f5771ff27 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:12.334945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90699ef-c54b-4db2-8c2a-220f5771ff27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:12.337699 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90699ef-c54b-4db2-8c2a-220f5771ff27 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:12.387319 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1266/2534] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:59:12 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:59:12.393984 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ea3f5-9990-4542-99ae-7b6947a3a779 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:12.408442 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ea3f5-9990-4542-99ae-7b6947a3a779 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:12.482181 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:12.522620 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2c0a8-9964-47c3-ad78-ba9764c09a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:12.523476 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2c0a8-9964-47c3-ad78-ba9764c09a83 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:12.523763 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2c0a8-9964-47c3-ad78-ba9764c09a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:12.524040 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2c0a8-9964-47c3-ad78-ba9764c09a83 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:12.524712 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2c0a8-9964-47c3-ad78-ba9764c09a83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:12.526769 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2c0a8-9964-47c3-ad78-ba9764c09a83 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:12.556035 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1269/2535] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:59:12 2022] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:59:12.561296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90699ef-c54b-4db2-8c2a-220f5771ff27 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:12.572533 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90699ef-c54b-4db2-8c2a-220f5771ff27 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:12.578885 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0a7a3-3f5c-40b4-a8fe-7b47323ed99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:12.579511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0a7a3-3f5c-40b4-a8fe-7b47323ed99c admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:12.579791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0a7a3-3f5c-40b4-a8fe-7b47323ed99c admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:12.580066 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0a7a3-3f5c-40b4-a8fe-7b47323ed99c admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:12.580723 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0a7a3-3f5c-40b4-a8fe-7b47323ed99c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:12.582391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0a7a3-3f5c-40b4-a8fe-7b47323ed99c admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:12.595184 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1267/2536] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:59:12.601396 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2c0a8-9964-47c3-ad78-ba9764c09a83 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:12.618221 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2c0a8-9964-47c3-ad78-ba9764c09a83 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:12.625651 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675e0e2-0266-4f7e-81ad-c697eeae83e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:12.627297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675e0e2-0266-4f7e-81ad-c697eeae83e8 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:12.627586 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675e0e2-0266-4f7e-81ad-c697eeae83e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:12.627894 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675e0e2-0266-4f7e-81ad-c697eeae83e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:12.628781 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675e0e2-0266-4f7e-81ad-c697eeae83e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:12.630704 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675e0e2-0266-4f7e-81ad-c697eeae83e8 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:12.647115 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1270/2537] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:59:12.651853 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0a7a3-3f5c-40b4-a8fe-7b47323ed99c admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:12.664106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0a7a3-3f5c-40b4-a8fe-7b47323ed99c admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:12.669546 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9039d7-4e48-4b14-86fd-c49350924cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:12.670227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9039d7-4e48-4b14-86fd-c49350924cb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:12.670513 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9039d7-4e48-4b14-86fd-c49350924cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:12.670860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9039d7-4e48-4b14-86fd-c49350924cb9 admin admin] PATH_INFO: `/v3/projects/c81897e52f7c4720baa25e72862de780/users/7caadb9c57564ebd9fbb6abfcfaf2b43/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:12.688021 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9039d7-4e48-4b14-86fd-c49350924cb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c81897e52f7c4720baa25e72862de780, user_id=7caadb9c57564ebd9fbb6abfcfaf2b43, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:12.690865 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9039d7-4e48-4b14-86fd-c49350924cb9 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:12.710875 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1268/2538] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:59:12 2022] PUT /identity/v3/projects/c81897e52f7c4720baa25e72862de780/users/7caadb9c57564ebd9fbb6abfcfaf2b43/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:12.723109 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e3de1-8881-4792-9903-7e1d210f0ebd None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:12.723583 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e3de1-8881-4792-9903-7e1d210f0ebd None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:12.723961 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e3de1-8881-4792-9903-7e1d210f0ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:12.771689 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-3f2e3de1-8881-4792-9903-7e1d210f0ebd None None] MFA Rules not processed for user `7caadb9c57564ebd9fbb6abfcfaf2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:12.774131 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-3f2e3de1-8881-4792-9903-7e1d210f0ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:12.933758 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1271/2539] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:12.952224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9039d7-4e48-4b14-86fd-c49350924cb9 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:12.954294 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-2c9039d7-4e48-4b14-86fd-c49350924cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:13.084119 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9039d7-4e48-4b14-86fd-c49350924cb9 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:13.088276 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f9693-90bb-4133-88e4-b32230ecf219 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:13.088908 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f9693-90bb-4133-88e4-b32230ecf219 service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:13.089189 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f9693-90bb-4133-88e4-b32230ecf219 service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:13.089492 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f9693-90bb-4133-88e4-b32230ecf219 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:13.099853 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f9693-90bb-4133-88e4-b32230ecf219 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:13.101339 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f9693-90bb-4133-88e4-b32230ecf219 service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:13.108067 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:13.114579 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1269/2540] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:59:16.881396 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e3de1-8881-4792-9903-7e1d210f0ebd None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:16.989315 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e3de1-8881-4792-9903-7e1d210f0ebd None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:16.994232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6da323-29e5-4d1d-9f3a-daf7ee970a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:16.994922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6da323-29e5-4d1d-9f3a-daf7ee970a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:16.995345 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6da323-29e5-4d1d-9f3a-daf7ee970a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:16.995628 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6da323-29e5-4d1d-9f3a-daf7ee970a88 admin admin] PATH_INFO: `/v3/users/7caadb9c57564ebd9fbb6abfcfaf2b43` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:16.996799 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6da323-29e5-4d1d-9f3a-daf7ee970a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7caadb9c57564ebd9fbb6abfcfaf2b43)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:16.998992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6da323-29e5-4d1d-9f3a-daf7ee970a88 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:17.097347 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:17.102618 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-3d6da323-29e5-4d1d-9f3a-daf7ee970a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7caadb9c57564ebd9fbb6abfcfaf2b43'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:17.114855 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-3d6da323-29e5-4d1d-9f3a-daf7ee970a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7caadb9c57564ebd9fbb6abfcfaf2b43'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:17.123408 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-3d6da323-29e5-4d1d-9f3a-daf7ee970a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7caadb9c57564ebd9fbb6abfcfaf2b43'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:17.124165 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-3d6da323-29e5-4d1d-9f3a-daf7ee970a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7caadb9c57564ebd9fbb6abfcfaf2b43'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:17.140263 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-3d6da323-29e5-4d1d-9f3a-daf7ee970a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7caadb9c57564ebd9fbb6abfcfaf2b43'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:17.147078 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1272/2541] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:59:16 2022] DELETE /identity/v3/users/7caadb9c57564ebd9fbb6abfcfaf2b43 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:17.153207 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585bc14-3404-403f-9ac5-c597186c58ab None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:17.154035 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585bc14-3404-403f-9ac5-c597186c58ab None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:17.154035 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585bc14-3404-403f-9ac5-c597186c58ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:17.178755 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-7585bc14-3404-403f-9ac5-c597186c58ab None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:17.181117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-7585bc14-3404-403f-9ac5-c597186c58ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:17.270484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1270/2542] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:17.280511 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6da323-29e5-4d1d-9f3a-daf7ee970a88 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:17.282281 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-3d6da323-29e5-4d1d-9f3a-daf7ee970a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:17.390632 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6da323-29e5-4d1d-9f3a-daf7ee970a88 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:17.394680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91c250-9f48-47d6-922d-e35dfe1a8902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:17.395320 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91c250-9f48-47d6-922d-e35dfe1a8902 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:17.395599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91c250-9f48-47d6-922d-e35dfe1a8902 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:17.395871 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91c250-9f48-47d6-922d-e35dfe1a8902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:17.407209 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91c250-9f48-47d6-922d-e35dfe1a8902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:17.408760 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91c250-9f48-47d6-922d-e35dfe1a8902 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:17.421212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1273/2543] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:59:17.813290 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585bc14-3404-403f-9ac5-c597186c58ab None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:17.815766 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-7585bc14-3404-403f-9ac5-c597186c58ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:17.852776 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585bc14-3404-403f-9ac5-c597186c58ab None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:17.859950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa9241-778a-41a5-9aed-23ec1bf8ebb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:17.860644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa9241-778a-41a5-9aed-23ec1bf8ebb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:17.860900 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa9241-778a-41a5-9aed-23ec1bf8ebb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:17.861134 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa9241-778a-41a5-9aed-23ec1bf8ebb8 admin admin] PATH_INFO: `/v3/projects/c81897e52f7c4720baa25e72862de780` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:17.862333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa9241-778a-41a5-9aed-23ec1bf8ebb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c81897e52f7c4720baa25e72862de780)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:17.864258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa9241-778a-41a5-9aed-23ec1bf8ebb8 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:17.940077 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2caa9241-778a-41a5-9aed-23ec1bf8ebb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c81897e52f7c4720baa25e72862de780', 'request_id': 'req-2caa9241-778a-41a5-9aed-23ec1bf8ebb8'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:17.949567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2caa9241-778a-41a5-9aed-23ec1bf8ebb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c81897e52f7c4720baa25e72862de780', 'request_id': 'req-2caa9241-778a-41a5-9aed-23ec1bf8ebb8'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:17.960703 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2caa9241-778a-41a5-9aed-23ec1bf8ebb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c81897e52f7c4720baa25e72862de780', 'request_id': 'req-2caa9241-778a-41a5-9aed-23ec1bf8ebb8'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:17.984227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2caa9241-778a-41a5-9aed-23ec1bf8ebb8 admin admin] The token cache is being invalidate because project c81897e52f7c4720baa25e72862de780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:59:17.984749 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2caa9241-778a-41a5-9aed-23ec1bf8ebb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:17.985763 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-2caa9241-778a-41a5-9aed-23ec1bf8ebb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:17.988302 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1271/2544] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:59:17 2022] DELETE /identity/v3/projects/c81897e52f7c4720baa25e72862de780 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:17.993370 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaec057-14b5-4e3b-af8e-ee0bbdd937cf None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:17.993948 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaec057-14b5-4e3b-af8e-ee0bbdd937cf None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:17.993948 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaec057-14b5-4e3b-af8e-ee0bbdd937cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:18.021068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-8eaec057-14b5-4e3b-af8e-ee0bbdd937cf None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:18.022350 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-8eaec057-14b5-4e3b-af8e-ee0bbdd937cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:18.123765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1274/2545] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:18.137224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a06ed1-5f69-4a19-afd9-544239f31296 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:18.137843 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a06ed1-5f69-4a19-afd9-544239f31296 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:18.138310 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a06ed1-5f69-4a19-afd9-544239f31296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:18.177788 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-a5a06ed1-5f69-4a19-afd9-544239f31296 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:18.191814 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-a5a06ed1-5f69-4a19-afd9-544239f31296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:18.224960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1272/2546] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:18.229641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaec057-14b5-4e3b-af8e-ee0bbdd937cf None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:18.252274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaec057-14b5-4e3b-af8e-ee0bbdd937cf None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:18.259810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72027e-3c7d-469d-a216-27161404536b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:18.261270 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72027e-3c7d-469d-a216-27161404536b admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:18.261773 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72027e-3c7d-469d-a216-27161404536b admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:18.262195 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72027e-3c7d-469d-a216-27161404536b admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:18.263007 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72027e-3c7d-469d-a216-27161404536b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:59:18.263741 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72027e-3c7d-469d-a216-27161404536b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:18.265254 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72027e-3c7d-469d-a216-27161404536b admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:18.295256 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1275/2547] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:59:18.300348 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a06ed1-5f69-4a19-afd9-544239f31296 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:18.314853 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a06ed1-5f69-4a19-afd9-544239f31296 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:18.334116 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a186d-0835-4376-ab80-3ae011841f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:18.335138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a186d-0835-4376-ab80-3ae011841f34 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:18.335427 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a186d-0835-4376-ab80-3ae011841f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:18.335960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a186d-0835-4376-ab80-3ae011841f34 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:18.336804 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a186d-0835-4376-ab80-3ae011841f34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:18.340596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a186d-0835-4376-ab80-3ae011841f34 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:18.391322 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1273/2548] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:59:18 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:59:18.391992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72027e-3c7d-469d-a216-27161404536b admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:18.404331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72027e-3c7d-469d-a216-27161404536b admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:18.479335 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:18.507775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db4a15-fe80-488f-990b-4c11e9291067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:18.509435 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db4a15-fe80-488f-990b-4c11e9291067 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:18.509819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db4a15-fe80-488f-990b-4c11e9291067 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:18.510145 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db4a15-fe80-488f-990b-4c11e9291067 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:18.510888 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db4a15-fe80-488f-990b-4c11e9291067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:18.514113 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db4a15-fe80-488f-990b-4c11e9291067 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:18.545678 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a186d-0835-4376-ab80-3ae011841f34 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:18.546563 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1276/2549] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:59:18 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:59:18.559064 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a186d-0835-4376-ab80-3ae011841f34 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:18.566320 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a776a-fd1d-44f8-bf06-10edc1e3e66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:18.566320 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a776a-fd1d-44f8-bf06-10edc1e3e66e admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:18.568128 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a776a-fd1d-44f8-bf06-10edc1e3e66e admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:18.568128 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a776a-fd1d-44f8-bf06-10edc1e3e66e admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:18.568128 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a776a-fd1d-44f8-bf06-10edc1e3e66e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:18.569463 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a776a-fd1d-44f8-bf06-10edc1e3e66e admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:18.584835 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1274/2550] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:59:18.589533 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db4a15-fe80-488f-990b-4c11e9291067 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:18.606823 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db4a15-fe80-488f-990b-4c11e9291067 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:18.613788 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc91335-af3b-49e8-93b7-93d872963f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:18.614423 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc91335-af3b-49e8-93b7-93d872963f61 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:18.614718 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc91335-af3b-49e8-93b7-93d872963f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:18.615007 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc91335-af3b-49e8-93b7-93d872963f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:18.615643 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc91335-af3b-49e8-93b7-93d872963f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:18.617298 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc91335-af3b-49e8-93b7-93d872963f61 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:18.630542 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1277/2551] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:59:18.635324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a776a-fd1d-44f8-bf06-10edc1e3e66e admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:18.646753 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a776a-fd1d-44f8-bf06-10edc1e3e66e admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:18.651465 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99094133-00f7-4cd3-ae7b-50ba8b39417d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:18.652165 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99094133-00f7-4cd3-ae7b-50ba8b39417d admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:18.652498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99094133-00f7-4cd3-ae7b-50ba8b39417d admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:18.652802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99094133-00f7-4cd3-ae7b-50ba8b39417d admin admin] PATH_INFO: `/v3/projects/fdb40f1bca16444b8877a6c88ec1f187/users/af4eb8bd9bc84d499686d4a5c23e3665/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:18.674793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99094133-00f7-4cd3-ae7b-50ba8b39417d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb40f1bca16444b8877a6c88ec1f187, user_id=af4eb8bd9bc84d499686d4a5c23e3665, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:18.675220 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99094133-00f7-4cd3-ae7b-50ba8b39417d admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:18.704407 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1275/2552] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:59:18 2022] PUT /identity/v3/projects/fdb40f1bca16444b8877a6c88ec1f187/users/af4eb8bd9bc84d499686d4a5c23e3665/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:18.706930 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe01ec1-2027-4dc0-8772-2a735dbad65a None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:18.707215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe01ec1-2027-4dc0-8772-2a735dbad65a None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:18.707486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe01ec1-2027-4dc0-8772-2a735dbad65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:18.740864 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-bfe01ec1-2027-4dc0-8772-2a735dbad65a None None] MFA Rules not processed for user `af4eb8bd9bc84d499686d4a5c23e3665`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:18.742282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-bfe01ec1-2027-4dc0-8772-2a735dbad65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:18.816078 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1278/2553] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:18.820791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99094133-00f7-4cd3-ae7b-50ba8b39417d admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:18.844310 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:18.890764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99094133-00f7-4cd3-ae7b-50ba8b39417d admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:18.895659 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1708c-6021-46e8-b6b4-f95a78c954b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:18.896232 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1708c-6021-46e8-b6b4-f95a78c954b5 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:18.896518 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1708c-6021-46e8-b6b4-f95a78c954b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:18.896792 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1708c-6021-46e8-b6b4-f95a78c954b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:18.897912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1708c-6021-46e8-b6b4-f95a78c954b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:18.899402 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1708c-6021-46e8-b6b4-f95a78c954b5 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:18.929142 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1276/2554] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:59:18 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:59:18.933178 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe01ec1-2027-4dc0-8772-2a735dbad65a None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:18.946033 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe01ec1-2027-4dc0-8772-2a735dbad65a None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:19.006790 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c2a59-e6f1-4b27-9376-3b2537ca40b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:19.007525 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c2a59-e6f1-4b27-9376-3b2537ca40b9 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:19.007702 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c2a59-e6f1-4b27-9376-3b2537ca40b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:19.007958 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c2a59-e6f1-4b27-9376-3b2537ca40b9 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:19.008624 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c2a59-e6f1-4b27-9376-3b2537ca40b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:19.010709 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c2a59-e6f1-4b27-9376-3b2537ca40b9 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:19.036373 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1279/2555] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:59:18 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:59:19.040761 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1708c-6021-46e8-b6b4-f95a78c954b5 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:19.051505 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1708c-6021-46e8-b6b4-f95a78c954b5 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:19.056315 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d840729-d6ae-4206-977f-8ba8b499e78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:19.056929 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d840729-d6ae-4206-977f-8ba8b499e78b admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:19.057206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d840729-d6ae-4206-977f-8ba8b499e78b admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:19.057503 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d840729-d6ae-4206-977f-8ba8b499e78b admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:19.058204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d840729-d6ae-4206-977f-8ba8b499e78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:19.059845 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d840729-d6ae-4206-977f-8ba8b499e78b admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:19.072010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1277/2556] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:59:19.076937 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c2a59-e6f1-4b27-9376-3b2537ca40b9 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:19.087464 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c2a59-e6f1-4b27-9376-3b2537ca40b9 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:19.092463 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee66c02-5226-48d8-84cd-c424e0a59e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:19.093091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee66c02-5226-48d8-84cd-c424e0a59e77 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:19.093379 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee66c02-5226-48d8-84cd-c424e0a59e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:19.093683 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee66c02-5226-48d8-84cd-c424e0a59e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:19.094333 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee66c02-5226-48d8-84cd-c424e0a59e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:19.095929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee66c02-5226-48d8-84cd-c424e0a59e77 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:19.106585 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1280/2557] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:59:19.110975 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d840729-d6ae-4206-977f-8ba8b499e78b admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:19.122010 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d840729-d6ae-4206-977f-8ba8b499e78b admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:19.127870 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdb585-177f-420c-ac48-e63632e57e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:19.128545 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdb585-177f-420c-ac48-e63632e57e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:19.128821 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdb585-177f-420c-ac48-e63632e57e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:19.129167 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdb585-177f-420c-ac48-e63632e57e90 admin admin] PATH_INFO: `/v3/projects/6de42cf5883f46b4a8cf32f0d2b83ccf/users/4ea47b575d2145fb86564f0ae090526f/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:19.147303 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabdb585-177f-420c-ac48-e63632e57e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de42cf5883f46b4a8cf32f0d2b83ccf, user_id=4ea47b575d2145fb86564f0ae090526f, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:19.150027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabdb585-177f-420c-ac48-e63632e57e90 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:19.165615 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1278/2558] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:59:19 2022] PUT /identity/v3/projects/6de42cf5883f46b4a8cf32f0d2b83ccf/users/4ea47b575d2145fb86564f0ae090526f/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:19.177861 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45ae50-9273-4ac9-9a3c-ec0f8e6599ec None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:19.178262 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45ae50-9273-4ac9-9a3c-ec0f8e6599ec None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:19.178542 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45ae50-9273-4ac9-9a3c-ec0f8e6599ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:19.209082 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-aa45ae50-9273-4ac9-9a3c-ec0f8e6599ec None None] MFA Rules not processed for user `4ea47b575d2145fb86564f0ae090526f`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:19.212744 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-aa45ae50-9273-4ac9-9a3c-ec0f8e6599ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:19.242582 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:19.287287 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1281/2559] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:59:19.292003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdb585-177f-420c-ac48-e63632e57e90 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:19.360361 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdb585-177f-420c-ac48-e63632e57e90 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:19.365304 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fa72e-49df-42f1-8814-0eb6ffe75701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:19.365962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fa72e-49df-42f1-8814-0eb6ffe75701 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:19.366244 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fa72e-49df-42f1-8814-0eb6ffe75701 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:19.366516 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fa72e-49df-42f1-8814-0eb6ffe75701 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:19.367178 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3fa72e-49df-42f1-8814-0eb6ffe75701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:19.369090 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3fa72e-49df-42f1-8814-0eb6ffe75701 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:19.406715 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1279/2560] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:59:19 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:59:19.407866 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45ae50-9273-4ac9-9a3c-ec0f8e6599ec None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:19.420241 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45ae50-9273-4ac9-9a3c-ec0f8e6599ec None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:19.493774 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94508f63-a81f-4371-b0a6-ee8f6e2bdcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:19.494410 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94508f63-a81f-4371-b0a6-ee8f6e2bdcc7 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:19.494694 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94508f63-a81f-4371-b0a6-ee8f6e2bdcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:19.494966 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94508f63-a81f-4371-b0a6-ee8f6e2bdcc7 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:19.495616 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94508f63-a81f-4371-b0a6-ee8f6e2bdcc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:19.497662 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94508f63-a81f-4371-b0a6-ee8f6e2bdcc7 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:19.523701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1282/2561] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:59:19 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:59:19.527679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fa72e-49df-42f1-8814-0eb6ffe75701 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:19.541149 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fa72e-49df-42f1-8814-0eb6ffe75701 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:19.549628 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad1bc0-adf5-4bab-bb46-97a9751b38fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:19.550403 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad1bc0-adf5-4bab-bb46-97a9751b38fd admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:19.550922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad1bc0-adf5-4bab-bb46-97a9751b38fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:19.551225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad1bc0-adf5-4bab-bb46-97a9751b38fd admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:19.552056 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad1bc0-adf5-4bab-bb46-97a9751b38fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:19.554354 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad1bc0-adf5-4bab-bb46-97a9751b38fd admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:19.573344 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1280/2562] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:59:19.577969 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94508f63-a81f-4371-b0a6-ee8f6e2bdcc7 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:19.589799 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94508f63-a81f-4371-b0a6-ee8f6e2bdcc7 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:19.596562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541a57b-7dcd-42a3-b282-afd21e4269be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:19.597240 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541a57b-7dcd-42a3-b282-afd21e4269be admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:19.597564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541a57b-7dcd-42a3-b282-afd21e4269be admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:19.597868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541a57b-7dcd-42a3-b282-afd21e4269be admin admin] PATH_INFO: `/v3/projects/0e7d56d9b98940a2a276e2476c9e6229/users/d9e6a3ed7f3c4c798dc5258bae101933/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:19.616311 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541a57b-7dcd-42a3-b282-afd21e4269be admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e7d56d9b98940a2a276e2476c9e6229, user_id=d9e6a3ed7f3c4c798dc5258bae101933, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:19.619023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541a57b-7dcd-42a3-b282-afd21e4269be admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:19.637353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1283/2563] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:59:19 2022] PUT /identity/v3/projects/0e7d56d9b98940a2a276e2476c9e6229/users/d9e6a3ed7f3c4c798dc5258bae101933/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:59:19.643072 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad1bc0-adf5-4bab-bb46-97a9751b38fd admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:19.660418 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad1bc0-adf5-4bab-bb46-97a9751b38fd admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:19.707658 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:19.734259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030df803-6e26-4b08-88ba-dcd398801cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:19.734882 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030df803-6e26-4b08-88ba-dcd398801cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:19.735165 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030df803-6e26-4b08-88ba-dcd398801cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:19.735416 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030df803-6e26-4b08-88ba-dcd398801cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:19.736138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030df803-6e26-4b08-88ba-dcd398801cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:19.737724 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030df803-6e26-4b08-88ba-dcd398801cf3 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:19.748667 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1281/2564] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:59:19.753323 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541a57b-7dcd-42a3-b282-afd21e4269be admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:19.764180 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541a57b-7dcd-42a3-b282-afd21e4269be admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:19.768894 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0e48b-0983-4f2b-b3dd-7423d62b0ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:19.769618 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0e48b-0983-4f2b-b3dd-7423d62b0ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:19.769902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0e48b-0983-4f2b-b3dd-7423d62b0ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:19.770175 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0e48b-0983-4f2b-b3dd-7423d62b0ec5 admin admin] PATH_INFO: `/v3/projects/0e7d56d9b98940a2a276e2476c9e6229/users/d9e6a3ed7f3c4c798dc5258bae101933/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:19.772079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0e48b-0983-4f2b-b3dd-7423d62b0ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e7d56d9b98940a2a276e2476c9e6229, user_id=d9e6a3ed7f3c4c798dc5258bae101933, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:19.774734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0e48b-0983-4f2b-b3dd-7423d62b0ec5 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:19.785973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1284/2565] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:59:19 2022] PUT /identity/v3/projects/0e7d56d9b98940a2a276e2476c9e6229/users/d9e6a3ed7f3c4c798dc5258bae101933/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:19.797113 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d928d-46ea-4d4e-ad25-b9c68bbf52a5 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:19.797560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d928d-46ea-4d4e-ad25-b9c68bbf52a5 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:19.797747 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d928d-46ea-4d4e-ad25-b9c68bbf52a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:19.825385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-891d928d-46ea-4d4e-ad25-b9c68bbf52a5 None None] MFA Rules not processed for user `d9e6a3ed7f3c4c798dc5258bae101933`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:19.826713 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-891d928d-46ea-4d4e-ad25-b9c68bbf52a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:19.899619 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1282/2566] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:59:19.911244 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0e48b-0983-4f2b-b3dd-7423d62b0ec5 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:19.913001 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-d6c0e48b-0983-4f2b-b3dd-7423d62b0ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:19.971813 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0e48b-0983-4f2b-b3dd-7423d62b0ec5 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:19.975522 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703abdc6-2eb2-48a6-bb3f-bbd14223937f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:19.976126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703abdc6-2eb2-48a6-bb3f-bbd14223937f service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:19.976414 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703abdc6-2eb2-48a6-bb3f-bbd14223937f service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:19.976681 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703abdc6-2eb2-48a6-bb3f-bbd14223937f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:20.013218 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:20.038788 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703abdc6-2eb2-48a6-bb3f-bbd14223937f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:20.040237 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703abdc6-2eb2-48a6-bb3f-bbd14223937f service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:20.050962 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1285/2567] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:59:21.598320 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d928d-46ea-4d4e-ad25-b9c68bbf52a5 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:21.599803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-891d928d-46ea-4d4e-ad25-b9c68bbf52a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:21.613727 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d928d-46ea-4d4e-ad25-b9c68bbf52a5 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:21.617635 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f71df3-3801-49d7-8756-e16772dc62d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:21.618277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f71df3-3801-49d7-8756-e16772dc62d1 service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:21.618560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f71df3-3801-49d7-8756-e16772dc62d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:21.618833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f71df3-3801-49d7-8756-e16772dc62d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:21.686598 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f71df3-3801-49d7-8756-e16772dc62d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:21.687656 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f71df3-3801-49d7-8756-e16772dc62d1 service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:21.698253 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1283/2568] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:59:22.275850 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703abdc6-2eb2-48a6-bb3f-bbd14223937f service cinder] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:22.285292 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703abdc6-2eb2-48a6-bb3f-bbd14223937f service cinder] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:22.289057 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1747623-897a-4fb0-89ae-a09d7299bdda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:22.289701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1747623-897a-4fb0-89ae-a09d7299bdda service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:22.289985 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1747623-897a-4fb0-89ae-a09d7299bdda service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:22.290259 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1747623-897a-4fb0-89ae-a09d7299bdda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:22.301539 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1747623-897a-4fb0-89ae-a09d7299bdda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:22.303058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1747623-897a-4fb0-89ae-a09d7299bdda service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:22.315267 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1286/2569] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:59:26.303378 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f71df3-3801-49d7-8756-e16772dc62d1 service cinder] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:26.369350 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f71df3-3801-49d7-8756-e16772dc62d1 service cinder] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:26.373983 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9638b0d-986d-4294-8835-4a69f81c71a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:26.374616 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9638b0d-986d-4294-8835-4a69f81c71a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:26.374895 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9638b0d-986d-4294-8835-4a69f81c71a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:26.375165 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9638b0d-986d-4294-8835-4a69f81c71a6 admin admin] PATH_INFO: `/v3/users/af4eb8bd9bc84d499686d4a5c23e3665` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:26.376544 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9638b0d-986d-4294-8835-4a69f81c71a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af4eb8bd9bc84d499686d4a5c23e3665)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:26.378505 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9638b0d-986d-4294-8835-4a69f81c71a6 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:26.384108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:26.430406 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-f9638b0d-986d-4294-8835-4a69f81c71a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af4eb8bd9bc84d499686d4a5c23e3665'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:26.431045 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-f9638b0d-986d-4294-8835-4a69f81c71a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af4eb8bd9bc84d499686d4a5c23e3665'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:26.438451 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-f9638b0d-986d-4294-8835-4a69f81c71a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af4eb8bd9bc84d499686d4a5c23e3665'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:26.454936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-f9638b0d-986d-4294-8835-4a69f81c71a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af4eb8bd9bc84d499686d4a5c23e3665'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:26.459163 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-f9638b0d-986d-4294-8835-4a69f81c71a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af4eb8bd9bc84d499686d4a5c23e3665'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:26.465167 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1284/2570] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:59:26 2022] DELETE /identity/v3/users/af4eb8bd9bc84d499686d4a5c23e3665 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:26.469664 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1ad7a-a84e-4325-8d1c-1ae475eba21e None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:26.470146 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1ad7a-a84e-4325-8d1c-1ae475eba21e None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:26.470259 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1ad7a-a84e-4325-8d1c-1ae475eba21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:26.490518 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-b7c1ad7a-a84e-4325-8d1c-1ae475eba21e None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:26.491987 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-b7c1ad7a-a84e-4325-8d1c-1ae475eba21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:26.559119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1287/2571] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:26.569860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9638b0d-986d-4294-8835-4a69f81c71a6 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:26.571420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-f9638b0d-986d-4294-8835-4a69f81c71a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:26.669023 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9638b0d-986d-4294-8835-4a69f81c71a6 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:26.673775 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2440e4-23f7-477f-afea-b9b741645f0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:26.674488 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2440e4-23f7-477f-afea-b9b741645f0a service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:26.674836 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2440e4-23f7-477f-afea-b9b741645f0a service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:26.675249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2440e4-23f7-477f-afea-b9b741645f0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:26.691066 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2440e4-23f7-477f-afea-b9b741645f0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:26.693339 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2440e4-23f7-477f-afea-b9b741645f0a service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:26.704920 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1285/2572] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:59:26.995972 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1ad7a-a84e-4325-8d1c-1ae475eba21e None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:26.997432 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-b7c1ad7a-a84e-4325-8d1c-1ae475eba21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:27.009925 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1ad7a-a84e-4325-8d1c-1ae475eba21e None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:27.015324 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee816d4-8712-4254-b739-049975d2cc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:27.015973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee816d4-8712-4254-b739-049975d2cc48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:27.016284 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee816d4-8712-4254-b739-049975d2cc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:27.016516 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee816d4-8712-4254-b739-049975d2cc48 admin admin] PATH_INFO: `/v3/projects/fdb40f1bca16444b8877a6c88ec1f187` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:27.017690 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee816d4-8712-4254-b739-049975d2cc48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdb40f1bca16444b8877a6c88ec1f187)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:27.020156 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee816d4-8712-4254-b739-049975d2cc48 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:27.075917 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-4ee816d4-8712-4254-b739-049975d2cc48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdb40f1bca16444b8877a6c88ec1f187', 'request_id': 'req-4ee816d4-8712-4254-b739-049975d2cc48'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:27.083261 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-4ee816d4-8712-4254-b739-049975d2cc48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdb40f1bca16444b8877a6c88ec1f187', 'request_id': 'req-4ee816d4-8712-4254-b739-049975d2cc48'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:27.093334 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-4ee816d4-8712-4254-b739-049975d2cc48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdb40f1bca16444b8877a6c88ec1f187', 'request_id': 'req-4ee816d4-8712-4254-b739-049975d2cc48'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:27.108638 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-4ee816d4-8712-4254-b739-049975d2cc48 admin admin] The token cache is being invalidate because project fdb40f1bca16444b8877a6c88ec1f187 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:59:27.108929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-4ee816d4-8712-4254-b739-049975d2cc48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:27.109613 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-4ee816d4-8712-4254-b739-049975d2cc48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:27.111106 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1288/2573] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:59:26 2022] DELETE /identity/v3/projects/fdb40f1bca16444b8877a6c88ec1f187 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:59:27.115393 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2440e4-23f7-477f-afea-b9b741645f0a service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:27.126155 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2440e4-23f7-477f-afea-b9b741645f0a service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:27.185387 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46e54a-0e91-42d4-b9d7-7051158b8f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:27.186062 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46e54a-0e91-42d4-b9d7-7051158b8f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:27.186346 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46e54a-0e91-42d4-b9d7-7051158b8f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:27.186620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46e54a-0e91-42d4-b9d7-7051158b8f39 admin admin] PATH_INFO: `/v3/users/4ea47b575d2145fb86564f0ae090526f` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:27.187830 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46e54a-0e91-42d4-b9d7-7051158b8f39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ea47b575d2145fb86564f0ae090526f)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:27.189873 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46e54a-0e91-42d4-b9d7-7051158b8f39 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:27.219679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:27.241367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-5b46e54a-0e91-42d4-b9d7-7051158b8f39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ea47b575d2145fb86564f0ae090526f'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:27.242044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-5b46e54a-0e91-42d4-b9d7-7051158b8f39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ea47b575d2145fb86564f0ae090526f'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:27.251115 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-5b46e54a-0e91-42d4-b9d7-7051158b8f39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ea47b575d2145fb86564f0ae090526f'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:27.264954 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-5b46e54a-0e91-42d4-b9d7-7051158b8f39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ea47b575d2145fb86564f0ae090526f'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:27.272876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-5b46e54a-0e91-42d4-b9d7-7051158b8f39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ea47b575d2145fb86564f0ae090526f'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:27.279256 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1286/2574] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:59:27 2022] DELETE /identity/v3/users/4ea47b575d2145fb86564f0ae090526f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:27.559703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee816d4-8712-4254-b739-049975d2cc48 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:27.561505 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-4ee816d4-8712-4254-b739-049975d2cc48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:27.583026 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee816d4-8712-4254-b739-049975d2cc48 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:27.629067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:27.645241 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e1439-4739-49c6-a6fc-423147228690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:27.645932 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e1439-4739-49c6-a6fc-423147228690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:27.646211 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e1439-4739-49c6-a6fc-423147228690 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:27.646481 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e1439-4739-49c6-a6fc-423147228690 admin admin] PATH_INFO: `/v3/projects/6de42cf5883f46b4a8cf32f0d2b83ccf` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:27.647625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e1439-4739-49c6-a6fc-423147228690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6de42cf5883f46b4a8cf32f0d2b83ccf)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:27.649582 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e1439-4739-49c6-a6fc-423147228690 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:27.701358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-347e1439-4739-49c6-a6fc-423147228690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6de42cf5883f46b4a8cf32f0d2b83ccf', 'request_id': 'req-347e1439-4739-49c6-a6fc-423147228690'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:27.709417 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-347e1439-4739-49c6-a6fc-423147228690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6de42cf5883f46b4a8cf32f0d2b83ccf', 'request_id': 'req-347e1439-4739-49c6-a6fc-423147228690'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:27.720843 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-347e1439-4739-49c6-a6fc-423147228690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6de42cf5883f46b4a8cf32f0d2b83ccf', 'request_id': 'req-347e1439-4739-49c6-a6fc-423147228690'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:27.733894 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-347e1439-4739-49c6-a6fc-423147228690 admin admin] The token cache is being invalidate because project 6de42cf5883f46b4a8cf32f0d2b83ccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:59:27.734188 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-347e1439-4739-49c6-a6fc-423147228690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:27.734959 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-347e1439-4739-49c6-a6fc-423147228690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:27.736448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1289/2575] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:59:27 2022] DELETE /identity/v3/projects/6de42cf5883f46b4a8cf32f0d2b83ccf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:59:27.741427 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46e54a-0e91-42d4-b9d7-7051158b8f39 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:27.742939 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-5b46e54a-0e91-42d4-b9d7-7051158b8f39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:27.756484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46e54a-0e91-42d4-b9d7-7051158b8f39 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:27.817867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadd3d2-071e-4ee4-8d55-87affa0a53a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:27.818429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadd3d2-071e-4ee4-8d55-87affa0a53a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:27.818708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadd3d2-071e-4ee4-8d55-87affa0a53a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:27.818981 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadd3d2-071e-4ee4-8d55-87affa0a53a1 admin admin] PATH_INFO: `/v3/users/d9e6a3ed7f3c4c798dc5258bae101933` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:27.820403 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadd3d2-071e-4ee4-8d55-87affa0a53a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9e6a3ed7f3c4c798dc5258bae101933)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:27.822422 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadd3d2-071e-4ee4-8d55-87affa0a53a1 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:27.872259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-adadd3d2-071e-4ee4-8d55-87affa0a53a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9e6a3ed7f3c4c798dc5258bae101933'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:27.872935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-adadd3d2-071e-4ee4-8d55-87affa0a53a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9e6a3ed7f3c4c798dc5258bae101933'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:27.882151 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-adadd3d2-071e-4ee4-8d55-87affa0a53a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9e6a3ed7f3c4c798dc5258bae101933'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:27.895662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-adadd3d2-071e-4ee4-8d55-87affa0a53a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9e6a3ed7f3c4c798dc5258bae101933'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:27.903096 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-adadd3d2-071e-4ee4-8d55-87affa0a53a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9e6a3ed7f3c4c798dc5258bae101933'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:27.909904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1287/2576] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:59:27 2022] DELETE /identity/v3/users/d9e6a3ed7f3c4c798dc5258bae101933 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:28.179146 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e1439-4739-49c6-a6fc-423147228690 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:28.180600 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-347e1439-4739-49c6-a6fc-423147228690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:28.193776 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e1439-4739-49c6-a6fc-423147228690 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:28.260539 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28042d8-61df-44b4-ac8e-9649d768fb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:28.261270 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28042d8-61df-44b4-ac8e-9649d768fb87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:28.261590 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28042d8-61df-44b4-ac8e-9649d768fb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:28.261872 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28042d8-61df-44b4-ac8e-9649d768fb87 admin admin] PATH_INFO: `/v3/projects/0e7d56d9b98940a2a276e2476c9e6229` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:28.263018 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28042d8-61df-44b4-ac8e-9649d768fb87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e7d56d9b98940a2a276e2476c9e6229)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:28.264914 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28042d8-61df-44b4-ac8e-9649d768fb87 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:28.313824 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e28042d8-61df-44b4-ac8e-9649d768fb87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e7d56d9b98940a2a276e2476c9e6229', 'request_id': 'req-e28042d8-61df-44b4-ac8e-9649d768fb87'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:28.321082 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e28042d8-61df-44b4-ac8e-9649d768fb87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e7d56d9b98940a2a276e2476c9e6229', 'request_id': 'req-e28042d8-61df-44b4-ac8e-9649d768fb87'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:28.328101 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e28042d8-61df-44b4-ac8e-9649d768fb87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e7d56d9b98940a2a276e2476c9e6229', 'request_id': 'req-e28042d8-61df-44b4-ac8e-9649d768fb87'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:28.339317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e28042d8-61df-44b4-ac8e-9649d768fb87 admin admin] The token cache is being invalidate because project 0e7d56d9b98940a2a276e2476c9e6229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:59:28.339607 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e28042d8-61df-44b4-ac8e-9649d768fb87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:28.340235 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e28042d8-61df-44b4-ac8e-9649d768fb87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:28.341825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1290/2577] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:59:28 2022] DELETE /identity/v3/projects/0e7d56d9b98940a2a276e2476c9e6229 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:28.346867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52d4cd-da0e-4c83-8d54-42243117730a None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:28.347161 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52d4cd-da0e-4c83-8d54-42243117730a None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:28.347508 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52d4cd-da0e-4c83-8d54-42243117730a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:28.368050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-6f52d4cd-da0e-4c83-8d54-42243117730a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:28.369197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-6f52d4cd-da0e-4c83-8d54-42243117730a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:28.388904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:28.432326 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1288/2578] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:28.441556 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a89c8-fa35-47b7-a163-dbbe7e121b17 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:28.441949 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a89c8-fa35-47b7-a163-dbbe7e121b17 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:28.442228 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a89c8-fa35-47b7-a163-dbbe7e121b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:28.456771 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:28.463851 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-148a89c8-fa35-47b7-a163-dbbe7e121b17 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:28.465777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-148a89c8-fa35-47b7-a163-dbbe7e121b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:28.475069 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1291/2579] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:28.479448 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52d4cd-da0e-4c83-8d54-42243117730a None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:28.489428 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52d4cd-da0e-4c83-8d54-42243117730a None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:28.494078 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9d4fa-e716-4562-9007-bd37d71987b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:28.494810 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9d4fa-e716-4562-9007-bd37d71987b3 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:28.495092 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9d4fa-e716-4562-9007-bd37d71987b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:28.495375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9d4fa-e716-4562-9007-bd37d71987b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:28.496035 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9d4fa-e716-4562-9007-bd37d71987b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:59:28.496340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9d4fa-e716-4562-9007-bd37d71987b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:28.497995 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9d4fa-e716-4562-9007-bd37d71987b3 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:28.510210 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1289/2580] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:59:28.514574 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a89c8-fa35-47b7-a163-dbbe7e121b17 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:28.524373 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a89c8-fa35-47b7-a163-dbbe7e121b17 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:28.529180 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f0ff9-7fdc-4280-86d6-e6ccb709e164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:28.529806 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f0ff9-7fdc-4280-86d6-e6ccb709e164 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:28.530085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f0ff9-7fdc-4280-86d6-e6ccb709e164 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:28.530359 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f0ff9-7fdc-4280-86d6-e6ccb709e164 admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:28.530994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f0ff9-7fdc-4280-86d6-e6ccb709e164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:28.532867 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f0ff9-7fdc-4280-86d6-e6ccb709e164 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:28.562043 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1292/2581] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:59:28 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:59:28.566587 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9d4fa-e716-4562-9007-bd37d71987b3 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:28.577600 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9d4fa-e716-4562-9007-bd37d71987b3 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:28.639350 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29401bc7-1ca9-4218-a5f7-4a78336e2f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:28.639923 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29401bc7-1ca9-4218-a5f7-4a78336e2f5a admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:28.640202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29401bc7-1ca9-4218-a5f7-4a78336e2f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:28.640472 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29401bc7-1ca9-4218-a5f7-4a78336e2f5a admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:28.641112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29401bc7-1ca9-4218-a5f7-4a78336e2f5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:28.643145 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29401bc7-1ca9-4218-a5f7-4a78336e2f5a admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:28.665791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1290/2582] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:59:28 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:59:28.669810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f0ff9-7fdc-4280-86d6-e6ccb709e164 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:28.680729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f0ff9-7fdc-4280-86d6-e6ccb709e164 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:28.685496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623d20f-fb42-4e03-8e12-d103445ee310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:28.687934 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623d20f-fb42-4e03-8e12-d103445ee310 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:28.688220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623d20f-fb42-4e03-8e12-d103445ee310 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:28.688497 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623d20f-fb42-4e03-8e12-d103445ee310 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:28.689155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7623d20f-fb42-4e03-8e12-d103445ee310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:28.690801 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7623d20f-fb42-4e03-8e12-d103445ee310 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:28.702703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1293/2583] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:59:28.708464 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29401bc7-1ca9-4218-a5f7-4a78336e2f5a admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:28.722024 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29401bc7-1ca9-4218-a5f7-4a78336e2f5a admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:28.727281 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68b374-5957-4c92-a55b-21c2bdb394d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:28.727902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68b374-5957-4c92-a55b-21c2bdb394d0 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:28.728184 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68b374-5957-4c92-a55b-21c2bdb394d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:28.728461 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68b374-5957-4c92-a55b-21c2bdb394d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:28.729117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68b374-5957-4c92-a55b-21c2bdb394d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:28.730807 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68b374-5957-4c92-a55b-21c2bdb394d0 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:28.743816 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1291/2584] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:59:28.748128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623d20f-fb42-4e03-8e12-d103445ee310 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:28.760290 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623d20f-fb42-4e03-8e12-d103445ee310 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:28.765216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e4711-3187-4bc2-b32f-b5bd756aff10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:28.765934 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e4711-3187-4bc2-b32f-b5bd756aff10 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:28.766213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e4711-3187-4bc2-b32f-b5bd756aff10 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:28.766493 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e4711-3187-4bc2-b32f-b5bd756aff10 admin admin] PATH_INFO: `/v3/projects/c9c272bae1a547f089f7fed1462e1282/users/fde458201a29468a9a7cd9322c5b7c53/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:28.783382 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e4711-3187-4bc2-b32f-b5bd756aff10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c272bae1a547f089f7fed1462e1282, user_id=fde458201a29468a9a7cd9322c5b7c53, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:28.786608 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e4711-3187-4bc2-b32f-b5bd756aff10 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:28.803063 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1294/2585] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:59:28 2022] PUT /identity/v3/projects/c9c272bae1a547f089f7fed1462e1282/users/fde458201a29468a9a7cd9322c5b7c53/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:59:28.808589 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026d2d9-9322-4b1b-a44a-209db0df3e91 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:28.808903 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026d2d9-9322-4b1b-a44a-209db0df3e91 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:28.809211 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026d2d9-9322-4b1b-a44a-209db0df3e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:28.831717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-2026d2d9-9322-4b1b-a44a-209db0df3e91 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:28.833596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-2026d2d9-9322-4b1b-a44a-209db0df3e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:28.901001 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1292/2586] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:28.910567 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e4711-3187-4bc2-b32f-b5bd756aff10 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:28.912320 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-1f0e4711-3187-4bc2-b32f-b5bd756aff10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:28.972284 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e4711-3187-4bc2-b32f-b5bd756aff10 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:28.976472 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae5d0c-f231-45bc-ab8e-ebd1152ab197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:28.977107 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae5d0c-f231-45bc-ab8e-ebd1152ab197 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:28.977391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae5d0c-f231-45bc-ab8e-ebd1152ab197 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:28.977692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae5d0c-f231-45bc-ab8e-ebd1152ab197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:28.987331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae5d0c-f231-45bc-ab8e-ebd1152ab197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:28.988924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae5d0c-f231-45bc-ab8e-ebd1152ab197 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:28.999471 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1295/2587] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:59:29.714637 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f2abd-6e20-4bc5-8669-d75fc93cdcb6 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:29.714922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f2abd-6e20-4bc5-8669-d75fc93cdcb6 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:29.715198 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f2abd-6e20-4bc5-8669-d75fc93cdcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:29.746332 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-9d1f2abd-6e20-4bc5-8669-d75fc93cdcb6 None None] MFA Rules not processed for user `fde458201a29468a9a7cd9322c5b7c53`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:29.747671 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-9d1f2abd-6e20-4bc5-8669-d75fc93cdcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:29.769026 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:29.828065 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1293/2588] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:29.842413 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae5d0c-f231-45bc-ab8e-ebd1152ab197 service neutron] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:29.843910 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-9eae5d0c-f231-45bc-ab8e-ebd1152ab197 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:29.920471 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae5d0c-f231-45bc-ab8e-ebd1152ab197 service neutron] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:29.924099 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66686092-9817-4744-ad76-3f52d2a3bfec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:29.924781 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66686092-9817-4744-ad76-3f52d2a3bfec service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:29.925127 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66686092-9817-4744-ad76-3f52d2a3bfec service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:29.925438 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66686092-9817-4744-ad76-3f52d2a3bfec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:29.935793 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66686092-9817-4744-ad76-3f52d2a3bfec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:29.937706 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66686092-9817-4744-ad76-3f52d2a3bfec service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:29.948340 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1296/2589] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:59:31.344379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82594b7-595d-4f83-84ec-93ea6e08279b None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:31.344962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82594b7-595d-4f83-84ec-93ea6e08279b None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:31.344962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82594b7-595d-4f83-84ec-93ea6e08279b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:31.363954 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-e82594b7-595d-4f83-84ec-93ea6e08279b None None] MFA Rules not processed for user `fde458201a29468a9a7cd9322c5b7c53`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:31.365851 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e82594b7-595d-4f83-84ec-93ea6e08279b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:31.375668 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1294/2590] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:31.566336 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974d008-37c4-42b4-bde9-46c6c3c9a96c None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:31.566829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974d008-37c4-42b4-bde9-46c6c3c9a96c None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:31.566924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974d008-37c4-42b4-bde9-46c6c3c9a96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:31.591612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-e974d008-37c4-42b4-bde9-46c6c3c9a96c None None] MFA Rules not processed for user `7caa973c63e64d639cc2fb55a4955542`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:31.593110 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-e974d008-37c4-42b4-bde9-46c6c3c9a96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:31.652213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:31.672828 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1297/2591] 10.222.0.94 () {58 vars in 967 bytes} [Wed Aug 24 04:59:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:31.689872 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82594b7-595d-4f83-84ec-93ea6e08279b None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:31.691651 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e82594b7-595d-4f83-84ec-93ea6e08279b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:31.790415 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82594b7-595d-4f83-84ec-93ea6e08279b None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:31.796474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8e540-67b8-48ea-852e-0ac1db41210d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40d2202203204b06a41e57b9d1a300fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:31.797238 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8e540-67b8-48ea-852e-0ac1db41210d service swift] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:31.797544 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8e540-67b8-48ea-852e-0ac1db41210d service swift] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:31.797818 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8e540-67b8-48ea-852e-0ac1db41210d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:31.811125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8e540-67b8-48ea-852e-0ac1db41210d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:31.813365 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8e540-67b8-48ea-852e-0ac1db41210d service swift] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:31.827478 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1295/2592] 10.222.0.94 () {60 vars in 1384 bytes} [Wed Aug 24 04:59:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:59:41.666628 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:41.823202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=53 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:47.427087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974d008-37c4-42b4-bde9-46c6c3c9a96c None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:47.428903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-e974d008-37c4-42b4-bde9-46c6c3c9a96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:47.442314 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974d008-37c4-42b4-bde9-46c6c3c9a96c None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:47.446093 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad98ed-85a8-4642-bfdf-16534e42ba2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:47.446710 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad98ed-85a8-4642-bfdf-16534e42ba2b service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:47.446987 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad98ed-85a8-4642-bfdf-16534e42ba2b service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:47.447258 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad98ed-85a8-4642-bfdf-16534e42ba2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:47.449125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-a9ad98ed-85a8-4642-bfdf-16534e42ba2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:47.461804 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad98ed-85a8-4642-bfdf-16534e42ba2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:47.463292 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad98ed-85a8-4642-bfdf-16534e42ba2b service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:47.474098 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1298/2593] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:59:51.215793 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8e540-67b8-48ea-852e-0ac1db41210d service swift] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:51.218157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-71d8e540-67b8-48ea-852e-0ac1db41210d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:51.235277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8e540-67b8-48ea-852e-0ac1db41210d service swift] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:51.239965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d566fc7-1b02-431f-bc4c-71e3d90239e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:51.240620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d566fc7-1b02-431f-bc4c-71e3d90239e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:51.240902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d566fc7-1b02-431f-bc4c-71e3d90239e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:51.241214 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d566fc7-1b02-431f-bc4c-71e3d90239e0 admin admin] PATH_INFO: `/v3/users/052e427fb0b84fe7b31705fbfb708533` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:51.242483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d566fc7-1b02-431f-bc4c-71e3d90239e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=052e427fb0b84fe7b31705fbfb708533)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:51.244612 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d566fc7-1b02-431f-bc4c-71e3d90239e0 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:51.298398 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-9d566fc7-1b02-431f-bc4c-71e3d90239e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '052e427fb0b84fe7b31705fbfb708533'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:51.299001 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-9d566fc7-1b02-431f-bc4c-71e3d90239e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '052e427fb0b84fe7b31705fbfb708533'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:51.307345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-9d566fc7-1b02-431f-bc4c-71e3d90239e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '052e427fb0b84fe7b31705fbfb708533'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:51.323907 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-9d566fc7-1b02-431f-bc4c-71e3d90239e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '052e427fb0b84fe7b31705fbfb708533'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:51.333356 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-9d566fc7-1b02-431f-bc4c-71e3d90239e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '052e427fb0b84fe7b31705fbfb708533'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:51.340426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1296/2594] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 04:59:51 2022] DELETE /identity/v3/users/052e427fb0b84fe7b31705fbfb708533 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:51.551099 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad98ed-85a8-4642-bfdf-16534e42ba2b service neutron] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:51.563560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad98ed-85a8-4642-bfdf-16534e42ba2b service neutron] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:51.639923 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bded38-cb74-4eb8-afe7-4cbb18617e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:51.641232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bded38-cb74-4eb8-afe7-4cbb18617e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:51.642178 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bded38-cb74-4eb8-afe7-4cbb18617e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:51.642849 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bded38-cb74-4eb8-afe7-4cbb18617e22 admin admin] PATH_INFO: `/v3/projects/e1914f809a2a4dc996bc768050cef17b` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:51.644949 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bded38-cb74-4eb8-afe7-4cbb18617e22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1914f809a2a4dc996bc768050cef17b)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:51.648175 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bded38-cb74-4eb8-afe7-4cbb18617e22 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:51.706045 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-46bded38-cb74-4eb8-afe7-4cbb18617e22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1914f809a2a4dc996bc768050cef17b', 'request_id': 'req-46bded38-cb74-4eb8-afe7-4cbb18617e22'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:51.718507 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-46bded38-cb74-4eb8-afe7-4cbb18617e22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1914f809a2a4dc996bc768050cef17b', 'request_id': 'req-46bded38-cb74-4eb8-afe7-4cbb18617e22'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:51.723503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-46bded38-cb74-4eb8-afe7-4cbb18617e22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1914f809a2a4dc996bc768050cef17b', 'request_id': 'req-46bded38-cb74-4eb8-afe7-4cbb18617e22'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:51.738888 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-46bded38-cb74-4eb8-afe7-4cbb18617e22 admin admin] The token cache is being invalidate because project e1914f809a2a4dc996bc768050cef17b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:59:51.739181 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-46bded38-cb74-4eb8-afe7-4cbb18617e22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:51.739875 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-46bded38-cb74-4eb8-afe7-4cbb18617e22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:51.741424 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1299/2595] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 04:59:51 2022] DELETE /identity/v3/projects/e1914f809a2a4dc996bc768050cef17b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:59:51.746643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e8751-f8f2-469b-8963-229423d83bad None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:51.746948 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e8751-f8f2-469b-8963-229423d83bad None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:51.747224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e8751-f8f2-469b-8963-229423d83bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:51.771345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-e85e8751-f8f2-469b-8963-229423d83bad None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:51.772573 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e85e8751-f8f2-469b-8963-229423d83bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:51.843636 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1297/2596] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:51.851652 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed349eba-5efb-4fa9-9733-3e1058e7c1df None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:51.851944 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed349eba-5efb-4fa9-9733-3e1058e7c1df None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:51.852730 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed349eba-5efb-4fa9-9733-3e1058e7c1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:51.874100 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-ed349eba-5efb-4fa9-9733-3e1058e7c1df None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:51.875326 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ed349eba-5efb-4fa9-9733-3e1058e7c1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:51.884595 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1300/2597] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:51.889219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e8751-f8f2-469b-8963-229423d83bad None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:51.902707 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e8751-f8f2-469b-8963-229423d83bad None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:51.907586 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b619a-b3c3-428c-bfcf-90ee63bc1443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:51.908231 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b619a-b3c3-428c-bfcf-90ee63bc1443 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:51.908527 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b619a-b3c3-428c-bfcf-90ee63bc1443 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:51.908799 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b619a-b3c3-428c-bfcf-90ee63bc1443 admin admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:51.909510 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b619a-b3c3-428c-bfcf-90ee63bc1443 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:59:51.910128 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b619a-b3c3-428c-bfcf-90ee63bc1443 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:51.911880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b619a-b3c3-428c-bfcf-90ee63bc1443 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:51.924754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1298/2598] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 04:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:59:51.930765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed349eba-5efb-4fa9-9733-3e1058e7c1df None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:51.942313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed349eba-5efb-4fa9-9733-3e1058e7c1df None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:51.948372 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45c152-7cf1-4791-a4b4-612ccaa98d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:51.949824 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45c152-7cf1-4791-a4b4-612ccaa98d9b admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:51.950124 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45c152-7cf1-4791-a4b4-612ccaa98d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:51.950405 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45c152-7cf1-4791-a4b4-612ccaa98d9b admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:51.951408 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45c152-7cf1-4791-a4b4-612ccaa98d9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:51.954219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45c152-7cf1-4791-a4b4-612ccaa98d9b admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:51.988699 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1301/2599] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 04:59:51 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:59:51.993825 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b619a-b3c3-428c-bfcf-90ee63bc1443 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:52.004477 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b619a-b3c3-428c-bfcf-90ee63bc1443 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:52.067843 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df73f1f-6d08-4e8e-aca6-a2f42629a8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:52.068385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df73f1f-6d08-4e8e-aca6-a2f42629a8b3 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:52.068664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df73f1f-6d08-4e8e-aca6-a2f42629a8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:52.068942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df73f1f-6d08-4e8e-aca6-a2f42629a8b3 admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:52.069629 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df73f1f-6d08-4e8e-aca6-a2f42629a8b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:52.072131 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df73f1f-6d08-4e8e-aca6-a2f42629a8b3 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:52.081539 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:52.107223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1299/2600] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 04:59:51 2022] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:59:52.112127 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45c152-7cf1-4791-a4b4-612ccaa98d9b admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:52.131161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45c152-7cf1-4791-a4b4-612ccaa98d9b admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:52.139810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55714be4-3890-420a-8000-79f2700d12b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:52.140850 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55714be4-3890-420a-8000-79f2700d12b6 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:52.141322 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55714be4-3890-420a-8000-79f2700d12b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:52.141837 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55714be4-3890-420a-8000-79f2700d12b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:52.143045 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55714be4-3890-420a-8000-79f2700d12b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:52.146161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55714be4-3890-420a-8000-79f2700d12b6 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:52.167157 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1302/2601] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:59:52.171465 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df73f1f-6d08-4e8e-aca6-a2f42629a8b3 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:52.184238 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df73f1f-6d08-4e8e-aca6-a2f42629a8b3 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:52.189780 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4cb4e-b8b1-4a94-8164-1667c621ef2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:52.190412 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4cb4e-b8b1-4a94-8164-1667c621ef2c admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:52.190695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4cb4e-b8b1-4a94-8164-1667c621ef2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:52.190969 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4cb4e-b8b1-4a94-8164-1667c621ef2c admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:52.191630 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4cb4e-b8b1-4a94-8164-1667c621ef2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:52.193260 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4cb4e-b8b1-4a94-8164-1667c621ef2c admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:52.206196 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1300/2602] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 04:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:59:52.211259 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55714be4-3890-420a-8000-79f2700d12b6 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:52.223677 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55714be4-3890-420a-8000-79f2700d12b6 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:52.229241 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116b65c-5b60-4f9f-9004-3c919287ad6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:52.230068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116b65c-5b60-4f9f-9004-3c919287ad6b admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:52.230428 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116b65c-5b60-4f9f-9004-3c919287ad6b admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:52.230817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116b65c-5b60-4f9f-9004-3c919287ad6b admin admin] PATH_INFO: `/v3/projects/42be0724878b434290e242d88253e721/users/7b7b7fd14609472d94ad6dc4c0d31977/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:52.248286 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116b65c-5b60-4f9f-9004-3c919287ad6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=42be0724878b434290e242d88253e721, user_id=7b7b7fd14609472d94ad6dc4c0d31977, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:52.251064 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116b65c-5b60-4f9f-9004-3c919287ad6b admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:52.266493 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1303/2603] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 04:59:52 2022] PUT /identity/v3/projects/42be0724878b434290e242d88253e721/users/7b7b7fd14609472d94ad6dc4c0d31977/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:52.280183 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395899a6-85ab-45f6-9856-07121b4eaba0 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:52.280868 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395899a6-85ab-45f6-9856-07121b4eaba0 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:52.280868 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395899a6-85ab-45f6-9856-07121b4eaba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:52.313959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-395899a6-85ab-45f6-9856-07121b4eaba0 None None] MFA Rules not processed for user `7b7b7fd14609472d94ad6dc4c0d31977`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:52.315224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-395899a6-85ab-45f6-9856-07121b4eaba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:52.398378 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1301/2604] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 04:59:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:52.410447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116b65c-5b60-4f9f-9004-3c919287ad6b admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:52.412208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-a116b65c-5b60-4f9f-9004-3c919287ad6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:52.429804 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:52.487334 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116b65c-5b60-4f9f-9004-3c919287ad6b admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:52.491215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb6c8c-4cdc-4761-91a8-1120a87ae094 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:52.491835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb6c8c-4cdc-4761-91a8-1120a87ae094 service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:52.492120 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb6c8c-4cdc-4761-91a8-1120a87ae094 service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:52.492395 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb6c8c-4cdc-4761-91a8-1120a87ae094 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:52.506138 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb6c8c-4cdc-4761-91a8-1120a87ae094 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:52.508181 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb6c8c-4cdc-4761-91a8-1120a87ae094 service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:52.519528 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1304/2605] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:02.330569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395899a6-85ab-45f6-9856-07121b4eaba0 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:02.396167 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395899a6-85ab-45f6-9856-07121b4eaba0 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:02.401142 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727a2a7-dbed-4076-aa04-04ef1ecb776a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:02.401815 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727a2a7-dbed-4076-aa04-04ef1ecb776a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:02.402095 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727a2a7-dbed-4076-aa04-04ef1ecb776a admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:02.402365 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727a2a7-dbed-4076-aa04-04ef1ecb776a admin admin] PATH_INFO: `/v3/users/7b7b7fd14609472d94ad6dc4c0d31977` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:02.403541 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727a2a7-dbed-4076-aa04-04ef1ecb776a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b7b7fd14609472d94ad6dc4c0d31977)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:02.405469 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727a2a7-dbed-4076-aa04-04ef1ecb776a admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:02.457109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-5727a2a7-dbed-4076-aa04-04ef1ecb776a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b7b7fd14609472d94ad6dc4c0d31977'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:02.457796 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-5727a2a7-dbed-4076-aa04-04ef1ecb776a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b7b7fd14609472d94ad6dc4c0d31977'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:02.467125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-5727a2a7-dbed-4076-aa04-04ef1ecb776a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b7b7fd14609472d94ad6dc4c0d31977'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:02.480030 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:02.481346 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-5727a2a7-dbed-4076-aa04-04ef1ecb776a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b7b7fd14609472d94ad6dc4c0d31977'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:02.491324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-5727a2a7-dbed-4076-aa04-04ef1ecb776a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b7b7fd14609472d94ad6dc4c0d31977'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:02.503628 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1302/2606] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 05:00:02 2022] DELETE /identity/v3/users/7b7b7fd14609472d94ad6dc4c0d31977 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:02.510661 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a346b-25aa-4304-adad-c28934ff2944 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:02.511239 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a346b-25aa-4304-adad-c28934ff2944 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:02.511239 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a346b-25aa-4304-adad-c28934ff2944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:02.514652 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=20 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:02.532765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-1b8a346b-25aa-4304-adad-c28934ff2944 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:02.533820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-1b8a346b-25aa-4304-adad-c28934ff2944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:02.600029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1305/2607] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:02.611100 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727a2a7-dbed-4076-aa04-04ef1ecb776a admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:02.612769 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-5727a2a7-dbed-4076-aa04-04ef1ecb776a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:02.675401 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727a2a7-dbed-4076-aa04-04ef1ecb776a admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:02.679449 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5e642-7701-42fb-b5ca-a66923a7bd63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:02.680102 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5e642-7701-42fb-b5ca-a66923a7bd63 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:02.680418 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5e642-7701-42fb-b5ca-a66923a7bd63 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:02.680817 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5e642-7701-42fb-b5ca-a66923a7bd63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:02.692870 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5e642-7701-42fb-b5ca-a66923a7bd63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:02.694352 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5e642-7701-42fb-b5ca-a66923a7bd63 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:02.705093 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1303/2608] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:02.998138 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a346b-25aa-4304-adad-c28934ff2944 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:02.999751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-1b8a346b-25aa-4304-adad-c28934ff2944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:03.013825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a346b-25aa-4304-adad-c28934ff2944 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:03.019465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34b6f9-7383-43a0-b431-087273574c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:03.020230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34b6f9-7383-43a0-b431-087273574c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:03.020609 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34b6f9-7383-43a0-b431-087273574c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:03.020924 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34b6f9-7383-43a0-b431-087273574c5d admin admin] PATH_INFO: `/v3/projects/42be0724878b434290e242d88253e721` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:03.022186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34b6f9-7383-43a0-b431-087273574c5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=42be0724878b434290e242d88253e721)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:03.024551 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34b6f9-7383-43a0-b431-087273574c5d admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:03.075236 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ea34b6f9-7383-43a0-b431-087273574c5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42be0724878b434290e242d88253e721', 'request_id': 'req-ea34b6f9-7383-43a0-b431-087273574c5d'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:03.081852 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ea34b6f9-7383-43a0-b431-087273574c5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42be0724878b434290e242d88253e721', 'request_id': 'req-ea34b6f9-7383-43a0-b431-087273574c5d'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:03.091088 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ea34b6f9-7383-43a0-b431-087273574c5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42be0724878b434290e242d88253e721', 'request_id': 'req-ea34b6f9-7383-43a0-b431-087273574c5d'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:03.102156 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ea34b6f9-7383-43a0-b431-087273574c5d admin admin] The token cache is being invalidate because project 42be0724878b434290e242d88253e721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:00:03.102445 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ea34b6f9-7383-43a0-b431-087273574c5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:03.103295 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ea34b6f9-7383-43a0-b431-087273574c5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:03.104817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1306/2609] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 05:00:02 2022] DELETE /identity/v3/projects/42be0724878b434290e242d88253e721 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:03.109842 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bbcf2-7496-4357-8e92-686568195ed1 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:03.110108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bbcf2-7496-4357-8e92-686568195ed1 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:03.110384 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bbcf2-7496-4357-8e92-686568195ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:03.130175 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-bc0bbcf2-7496-4357-8e92-686568195ed1 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:03.131378 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-bc0bbcf2-7496-4357-8e92-686568195ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:03.194593 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1304/2610] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:03.206025 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43793dd3-22e9-40a3-96bb-e43e3ccce156 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:03.206312 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43793dd3-22e9-40a3-96bb-e43e3ccce156 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:03.206584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43793dd3-22e9-40a3-96bb-e43e3ccce156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:03.227270 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-43793dd3-22e9-40a3-96bb-e43e3ccce156 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:03.228534 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-43793dd3-22e9-40a3-96bb-e43e3ccce156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:03.236681 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1307/2611] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:03.241117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bbcf2-7496-4357-8e92-686568195ed1 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:03.251838 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bbcf2-7496-4357-8e92-686568195ed1 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:03.256855 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72496188-3fb8-421d-bbcd-edf24a51bff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:03.257484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72496188-3fb8-421d-bbcd-edf24a51bff2 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:03.257764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72496188-3fb8-421d-bbcd-edf24a51bff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:03.258035 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72496188-3fb8-421d-bbcd-edf24a51bff2 admin admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:03.258712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72496188-3fb8-421d-bbcd-edf24a51bff2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:00:03.259020 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72496188-3fb8-421d-bbcd-edf24a51bff2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:03.261377 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72496188-3fb8-421d-bbcd-edf24a51bff2 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:03.273500 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1305/2612] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 05:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:00:03.278569 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43793dd3-22e9-40a3-96bb-e43e3ccce156 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:03.288040 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43793dd3-22e9-40a3-96bb-e43e3ccce156 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:03.292775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312315c-1637-4d86-98e7-8525094799f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:03.293394 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312315c-1637-4d86-98e7-8525094799f9 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:03.293697 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312315c-1637-4d86-98e7-8525094799f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:03.293969 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312315c-1637-4d86-98e7-8525094799f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:03.294627 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312315c-1637-4d86-98e7-8525094799f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:03.296524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312315c-1637-4d86-98e7-8525094799f9 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:03.339099 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1308/2613] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 05:00:03 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:00:03.343556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72496188-3fb8-421d-bbcd-edf24a51bff2 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:03.354742 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72496188-3fb8-421d-bbcd-edf24a51bff2 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:03.418922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9313e-c473-42f8-a09a-ae0e2ab1b979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:03.419548 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9313e-c473-42f8-a09a-ae0e2ab1b979 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:03.419827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9313e-c473-42f8-a09a-ae0e2ab1b979 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:03.420102 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9313e-c473-42f8-a09a-ae0e2ab1b979 admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:03.420753 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9313e-c473-42f8-a09a-ae0e2ab1b979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:03.422700 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9313e-c473-42f8-a09a-ae0e2ab1b979 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:03.446500 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1306/2614] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 05:00:03 2022] POST /identity/v3/users => generated 284 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:00:03.451608 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312315c-1637-4d86-98e7-8525094799f9 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:03.462428 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312315c-1637-4d86-98e7-8525094799f9 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:03.467244 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7eded3-0cd3-46dc-aa52-48b165776875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:03.467856 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7eded3-0cd3-46dc-aa52-48b165776875 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:03.468135 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7eded3-0cd3-46dc-aa52-48b165776875 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:03.468407 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7eded3-0cd3-46dc-aa52-48b165776875 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:03.469056 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7eded3-0cd3-46dc-aa52-48b165776875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:03.470684 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7eded3-0cd3-46dc-aa52-48b165776875 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:03.481221 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1309/2615] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:00:03.485486 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9313e-c473-42f8-a09a-ae0e2ab1b979 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:03.499799 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9313e-c473-42f8-a09a-ae0e2ab1b979 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:03.505177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53464482-4fec-4811-84c1-2da0bbb894be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:03.505809 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53464482-4fec-4811-84c1-2da0bbb894be admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:03.506107 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53464482-4fec-4811-84c1-2da0bbb894be admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:03.506379 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53464482-4fec-4811-84c1-2da0bbb894be admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:03.507048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53464482-4fec-4811-84c1-2da0bbb894be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:03.508663 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53464482-4fec-4811-84c1-2da0bbb894be admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:03.510832 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:03.526837 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1307/2616] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:00:03.528612 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7eded3-0cd3-46dc-aa52-48b165776875 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:03.539884 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7eded3-0cd3-46dc-aa52-48b165776875 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:03.545283 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03fc46-be60-4948-98dd-023937f269fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:03.546015 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03fc46-be60-4948-98dd-023937f269fc admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:03.546303 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03fc46-be60-4948-98dd-023937f269fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:03.546580 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03fc46-be60-4948-98dd-023937f269fc admin admin] PATH_INFO: `/v3/projects/5601ff57139e4f99bac9c13df82bacae/users/4e0e8361348041ada878515a25598157/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:03.565948 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03fc46-be60-4948-98dd-023937f269fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5601ff57139e4f99bac9c13df82bacae, user_id=4e0e8361348041ada878515a25598157, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:03.568897 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03fc46-be60-4948-98dd-023937f269fc admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:03.586158 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1310/2617] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:00:03 2022] PUT /identity/v3/projects/5601ff57139e4f99bac9c13df82bacae/users/4e0e8361348041ada878515a25598157/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:03.597356 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195d5cb-3ba5-430a-8fb7-ec396d601350 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:03.597677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195d5cb-3ba5-430a-8fb7-ec396d601350 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:03.597985 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195d5cb-3ba5-430a-8fb7-ec396d601350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:03.629454 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-a195d5cb-3ba5-430a-8fb7-ec396d601350 None None] MFA Rules not processed for user `4e0e8361348041ada878515a25598157`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:03.630709 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-a195d5cb-3ba5-430a-8fb7-ec396d601350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:03.704921 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1308/2618] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:03.709462 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03fc46-be60-4948-98dd-023937f269fc admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:03.724351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:03.784896 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03fc46-be60-4948-98dd-023937f269fc admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:03.789885 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e279b72-bdd1-42d3-902c-6f24ff4dfb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:03.790513 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e279b72-bdd1-42d3-902c-6f24ff4dfb66 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:03.790974 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e279b72-bdd1-42d3-902c-6f24ff4dfb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:03.791255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e279b72-bdd1-42d3-902c-6f24ff4dfb66 admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:03.791892 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e279b72-bdd1-42d3-902c-6f24ff4dfb66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:03.793825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e279b72-bdd1-42d3-902c-6f24ff4dfb66 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:03.826739 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1311/2619] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 05:00:03 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:00:03.831325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195d5cb-3ba5-430a-8fb7-ec396d601350 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:03.843637 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195d5cb-3ba5-430a-8fb7-ec396d601350 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:03.913733 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd138a-407f-4069-a13f-fcd628c81d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:03.914797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd138a-407f-4069-a13f-fcd628c81d61 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:03.915288 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd138a-407f-4069-a13f-fcd628c81d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:03.916257 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd138a-407f-4069-a13f-fcd628c81d61 admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:03.917317 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd138a-407f-4069-a13f-fcd628c81d61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:03.920220 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd138a-407f-4069-a13f-fcd628c81d61 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:03.943153 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1309/2620] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 05:00:03 2022] POST /identity/v3/users => generated 290 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:00:03.947892 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e279b72-bdd1-42d3-902c-6f24ff4dfb66 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:03.959066 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e279b72-bdd1-42d3-902c-6f24ff4dfb66 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:03.964602 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f3b30-a513-45c8-bfb5-357022ddaa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:03.965225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f3b30-a513-45c8-bfb5-357022ddaa26 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:03.965543 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f3b30-a513-45c8-bfb5-357022ddaa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:03.965820 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f3b30-a513-45c8-bfb5-357022ddaa26 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:03.966469 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f3b30-a513-45c8-bfb5-357022ddaa26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:03.968085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f3b30-a513-45c8-bfb5-357022ddaa26 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:03.980410 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1312/2621] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:00:03.984941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd138a-407f-4069-a13f-fcd628c81d61 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:03.997369 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd138a-407f-4069-a13f-fcd628c81d61 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:04.002106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2b13d-6210-4e5d-a499-8f75d8895a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:04.002771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2b13d-6210-4e5d-a499-8f75d8895a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:04.003051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2b13d-6210-4e5d-a499-8f75d8895a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:04.003321 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2b13d-6210-4e5d-a499-8f75d8895a2e admin admin] PATH_INFO: `/v3/projects/0d04f55940334d1e8e7b10dedf3892f8/users/9e491a8806354f57a3d91761c2d817cc/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:04.024944 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2b13d-6210-4e5d-a499-8f75d8895a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d04f55940334d1e8e7b10dedf3892f8, user_id=9e491a8806354f57a3d91761c2d817cc, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:04.027675 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2b13d-6210-4e5d-a499-8f75d8895a2e admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:04.042452 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1310/2622] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:00:03 2022] PUT /identity/v3/projects/0d04f55940334d1e8e7b10dedf3892f8/users/9e491a8806354f57a3d91761c2d817cc/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:04.047878 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f3b30-a513-45c8-bfb5-357022ddaa26 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:04.059429 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f3b30-a513-45c8-bfb5-357022ddaa26 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:04.118442 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e9abf-5e87-4a6e-a035-26cfacd83d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:04.120278 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e9abf-5e87-4a6e-a035-26cfacd83d1c admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:04.120429 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e9abf-5e87-4a6e-a035-26cfacd83d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:04.120705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e9abf-5e87-4a6e-a035-26cfacd83d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:04.121363 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e9abf-5e87-4a6e-a035-26cfacd83d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:04.123028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e9abf-5e87-4a6e-a035-26cfacd83d1c admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:04.134398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1313/2623] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:00:04.139095 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2b13d-6210-4e5d-a499-8f75d8895a2e admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:04.150019 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2b13d-6210-4e5d-a499-8f75d8895a2e admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:04.155806 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66010859-98c2-4439-9109-7dc79a33ddcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:04.156521 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66010859-98c2-4439-9109-7dc79a33ddcc admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:04.156868 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66010859-98c2-4439-9109-7dc79a33ddcc admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:04.157181 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66010859-98c2-4439-9109-7dc79a33ddcc admin admin] PATH_INFO: `/v3/projects/0d04f55940334d1e8e7b10dedf3892f8/users/9e491a8806354f57a3d91761c2d817cc/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:04.159599 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66010859-98c2-4439-9109-7dc79a33ddcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d04f55940334d1e8e7b10dedf3892f8, user_id=9e491a8806354f57a3d91761c2d817cc, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:04.162350 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66010859-98c2-4439-9109-7dc79a33ddcc admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:04.174317 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1311/2624] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:00:04 2022] PUT /identity/v3/projects/0d04f55940334d1e8e7b10dedf3892f8/users/9e491a8806354f57a3d91761c2d817cc/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:00:04.185792 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192c4a4-da6a-41b2-94d6-1f79db649203 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:04.186068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192c4a4-da6a-41b2-94d6-1f79db649203 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:04.186334 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192c4a4-da6a-41b2-94d6-1f79db649203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:04.217353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-2192c4a4-da6a-41b2-94d6-1f79db649203 None None] MFA Rules not processed for user `9e491a8806354f57a3d91761c2d817cc`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:04.218630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-2192c4a4-da6a-41b2-94d6-1f79db649203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:04.304122 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1314/2625] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:04.318199 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66010859-98c2-4439-9109-7dc79a33ddcc admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:04.320562 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-66010859-98c2-4439-9109-7dc79a33ddcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:04.370669 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:04.389243 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66010859-98c2-4439-9109-7dc79a33ddcc admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:04.393122 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a27aec-ff6e-4468-af37-f1519b929945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:04.393777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a27aec-ff6e-4468-af37-f1519b929945 service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:04.394061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a27aec-ff6e-4468-af37-f1519b929945 service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:04.394325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a27aec-ff6e-4468-af37-f1519b929945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:04.406791 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a27aec-ff6e-4468-af37-f1519b929945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:04.409613 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a27aec-ff6e-4468-af37-f1519b929945 service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:04.428407 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1312/2626] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:05.997373 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192c4a4-da6a-41b2-94d6-1f79db649203 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:06.010054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:06.066894 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192c4a4-da6a-41b2-94d6-1f79db649203 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:06.071479 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ee823-8fd1-4256-8c3e-6fc04c50b691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:06.072610 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ee823-8fd1-4256-8c3e-6fc04c50b691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:06.072887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ee823-8fd1-4256-8c3e-6fc04c50b691 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:06.073160 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ee823-8fd1-4256-8c3e-6fc04c50b691 admin admin] PATH_INFO: `/v3/users/4e0e8361348041ada878515a25598157` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:06.074360 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ee823-8fd1-4256-8c3e-6fc04c50b691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e0e8361348041ada878515a25598157)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:06.076275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ee823-8fd1-4256-8c3e-6fc04c50b691 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:06.126012 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-553ee823-8fd1-4256-8c3e-6fc04c50b691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e0e8361348041ada878515a25598157'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:06.135287 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-553ee823-8fd1-4256-8c3e-6fc04c50b691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e0e8361348041ada878515a25598157'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:06.142831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-553ee823-8fd1-4256-8c3e-6fc04c50b691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e0e8361348041ada878515a25598157'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:06.143703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-553ee823-8fd1-4256-8c3e-6fc04c50b691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e0e8361348041ada878515a25598157'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:06.156608 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-553ee823-8fd1-4256-8c3e-6fc04c50b691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e0e8361348041ada878515a25598157'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:06.162819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1315/2627] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 05:00:05 2022] DELETE /identity/v3/users/4e0e8361348041ada878515a25598157 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:06.167472 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653d4b5-84f0-4065-9632-851789d6732a None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:06.168011 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653d4b5-84f0-4065-9632-851789d6732a None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:06.168109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653d4b5-84f0-4065-9632-851789d6732a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:06.188687 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-4653d4b5-84f0-4065-9632-851789d6732a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:06.189990 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-4653d4b5-84f0-4065-9632-851789d6732a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:06.270012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1313/2628] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:06.281058 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ee823-8fd1-4256-8c3e-6fc04c50b691 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:06.282567 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-553ee823-8fd1-4256-8c3e-6fc04c50b691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:06.349291 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ee823-8fd1-4256-8c3e-6fc04c50b691 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:06.355702 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac327a-57a8-400e-9643-c74b255e36be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:06.356578 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac327a-57a8-400e-9643-c74b255e36be service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:06.357048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac327a-57a8-400e-9643-c74b255e36be service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:06.357625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac327a-57a8-400e-9643-c74b255e36be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:06.373681 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac327a-57a8-400e-9643-c74b255e36be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:06.376241 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac327a-57a8-400e-9643-c74b255e36be service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:06.394194 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1316/2629] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:06.670040 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653d4b5-84f0-4065-9632-851789d6732a None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:06.671542 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-4653d4b5-84f0-4065-9632-851789d6732a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:06.689433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653d4b5-84f0-4065-9632-851789d6732a None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:06.694762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b825d-94ce-4910-be6b-bcc63e00ac30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:06.695290 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b825d-94ce-4910-be6b-bcc63e00ac30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:06.695570 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b825d-94ce-4910-be6b-bcc63e00ac30 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:06.695843 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b825d-94ce-4910-be6b-bcc63e00ac30 admin admin] PATH_INFO: `/v3/projects/5601ff57139e4f99bac9c13df82bacae` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:06.697074 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b825d-94ce-4910-be6b-bcc63e00ac30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5601ff57139e4f99bac9c13df82bacae)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:06.700169 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b825d-94ce-4910-be6b-bcc63e00ac30 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:06.748905 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-4b8b825d-94ce-4910-be6b-bcc63e00ac30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5601ff57139e4f99bac9c13df82bacae', 'request_id': 'req-4b8b825d-94ce-4910-be6b-bcc63e00ac30'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:06.754588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-4b8b825d-94ce-4910-be6b-bcc63e00ac30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5601ff57139e4f99bac9c13df82bacae', 'request_id': 'req-4b8b825d-94ce-4910-be6b-bcc63e00ac30'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:06.762556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-4b8b825d-94ce-4910-be6b-bcc63e00ac30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5601ff57139e4f99bac9c13df82bacae', 'request_id': 'req-4b8b825d-94ce-4910-be6b-bcc63e00ac30'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:06.773958 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-4b8b825d-94ce-4910-be6b-bcc63e00ac30 admin admin] The token cache is being invalidate because project 5601ff57139e4f99bac9c13df82bacae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:00:06.774241 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-4b8b825d-94ce-4910-be6b-bcc63e00ac30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:06.774881 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-4b8b825d-94ce-4910-be6b-bcc63e00ac30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:06.776605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1314/2630] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 05:00:06 2022] DELETE /identity/v3/projects/5601ff57139e4f99bac9c13df82bacae => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:06.780533 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac327a-57a8-400e-9643-c74b255e36be service neutron] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:06.790245 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac327a-57a8-400e-9643-c74b255e36be service neutron] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:06.816544 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:06.851804 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca4cfc-5a47-41e5-aebc-f47dda64eb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:06.852735 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca4cfc-5a47-41e5-aebc-f47dda64eb3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:06.853015 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca4cfc-5a47-41e5-aebc-f47dda64eb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:06.853835 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca4cfc-5a47-41e5-aebc-f47dda64eb3f admin admin] PATH_INFO: `/v3/users/9e491a8806354f57a3d91761c2d817cc` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:06.854994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca4cfc-5a47-41e5-aebc-f47dda64eb3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e491a8806354f57a3d91761c2d817cc)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:06.857460 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca4cfc-5a47-41e5-aebc-f47dda64eb3f admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:06.907368 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-a8ca4cfc-5a47-41e5-aebc-f47dda64eb3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e491a8806354f57a3d91761c2d817cc'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:06.914960 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-a8ca4cfc-5a47-41e5-aebc-f47dda64eb3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e491a8806354f57a3d91761c2d817cc'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:06.922705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-a8ca4cfc-5a47-41e5-aebc-f47dda64eb3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e491a8806354f57a3d91761c2d817cc'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:06.923350 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-a8ca4cfc-5a47-41e5-aebc-f47dda64eb3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e491a8806354f57a3d91761c2d817cc'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:06.935829 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-a8ca4cfc-5a47-41e5-aebc-f47dda64eb3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e491a8806354f57a3d91761c2d817cc'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:06.941629 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1317/2631] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 05:00:06 2022] DELETE /identity/v3/users/9e491a8806354f57a3d91761c2d817cc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:07.216555 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b825d-94ce-4910-be6b-bcc63e00ac30 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:07.219980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-4b8b825d-94ce-4910-be6b-bcc63e00ac30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:07.234470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b825d-94ce-4910-be6b-bcc63e00ac30 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:07.292751 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27928ed4-a02e-44df-95f5-c06095dd9e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:07.293285 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27928ed4-a02e-44df-95f5-c06095dd9e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:07.293605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27928ed4-a02e-44df-95f5-c06095dd9e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:07.293877 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27928ed4-a02e-44df-95f5-c06095dd9e28 admin admin] PATH_INFO: `/v3/projects/0d04f55940334d1e8e7b10dedf3892f8` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:07.294990 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27928ed4-a02e-44df-95f5-c06095dd9e28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d04f55940334d1e8e7b10dedf3892f8)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:07.296873 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27928ed4-a02e-44df-95f5-c06095dd9e28 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:07.303304 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:07.346988 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-27928ed4-a02e-44df-95f5-c06095dd9e28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d04f55940334d1e8e7b10dedf3892f8', 'request_id': 'req-27928ed4-a02e-44df-95f5-c06095dd9e28'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:07.352480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-27928ed4-a02e-44df-95f5-c06095dd9e28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d04f55940334d1e8e7b10dedf3892f8', 'request_id': 'req-27928ed4-a02e-44df-95f5-c06095dd9e28'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:07.360428 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-27928ed4-a02e-44df-95f5-c06095dd9e28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d04f55940334d1e8e7b10dedf3892f8', 'request_id': 'req-27928ed4-a02e-44df-95f5-c06095dd9e28'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:07.371782 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-27928ed4-a02e-44df-95f5-c06095dd9e28 admin admin] The token cache is being invalidate because project 0d04f55940334d1e8e7b10dedf3892f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:00:07.372068 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-27928ed4-a02e-44df-95f5-c06095dd9e28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:07.372699 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-27928ed4-a02e-44df-95f5-c06095dd9e28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:07.374216 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1315/2632] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 05:00:07 2022] DELETE /identity/v3/projects/0d04f55940334d1e8e7b10dedf3892f8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:07.379069 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3866e4f-5cac-42eb-96cb-a8f02de8796b None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:07.379808 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3866e4f-5cac-42eb-96cb-a8f02de8796b None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:07.379921 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3866e4f-5cac-42eb-96cb-a8f02de8796b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:07.399585 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-d3866e4f-5cac-42eb-96cb-a8f02de8796b None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:07.401515 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-d3866e4f-5cac-42eb-96cb-a8f02de8796b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:07.464214 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1318/2633] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:07.474340 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293d9eb-c849-46d6-8f8c-25a4e83aeae3 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:07.474768 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293d9eb-c849-46d6-8f8c-25a4e83aeae3 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:07.475050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293d9eb-c849-46d6-8f8c-25a4e83aeae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:07.495571 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-9293d9eb-c849-46d6-8f8c-25a4e83aeae3 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:07.496785 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-9293d9eb-c849-46d6-8f8c-25a4e83aeae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:07.505057 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1316/2634] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:07.509185 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3866e4f-5cac-42eb-96cb-a8f02de8796b None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:07.519282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3866e4f-5cac-42eb-96cb-a8f02de8796b None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:07.523792 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb69f4-20a8-4a0d-8114-8a4735586505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:07.524424 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb69f4-20a8-4a0d-8114-8a4735586505 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:07.524703 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb69f4-20a8-4a0d-8114-8a4735586505 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:07.524972 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb69f4-20a8-4a0d-8114-8a4735586505 admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:07.526245 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb69f4-20a8-4a0d-8114-8a4735586505 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:00:07.526544 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb69f4-20a8-4a0d-8114-8a4735586505 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:07.528143 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb69f4-20a8-4a0d-8114-8a4735586505 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:07.540125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1319/2635] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 05:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:00:07.545443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293d9eb-c849-46d6-8f8c-25a4e83aeae3 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:07.554764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293d9eb-c849-46d6-8f8c-25a4e83aeae3 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:07.559775 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984dc1e-d01b-4551-ad2e-b8fd95d6669a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:07.560368 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984dc1e-d01b-4551-ad2e-b8fd95d6669a admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:07.560651 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984dc1e-d01b-4551-ad2e-b8fd95d6669a admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:07.560923 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984dc1e-d01b-4551-ad2e-b8fd95d6669a admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:07.561580 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984dc1e-d01b-4551-ad2e-b8fd95d6669a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:07.563503 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984dc1e-d01b-4551-ad2e-b8fd95d6669a admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:07.591734 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1317/2636] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 05:00:07 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:00:07.596249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb69f4-20a8-4a0d-8114-8a4735586505 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:07.606496 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb69f4-20a8-4a0d-8114-8a4735586505 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:07.639341 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:07.668184 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d92a5-4a74-4b7e-97b2-52fbf9d690f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:07.668788 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d92a5-4a74-4b7e-97b2-52fbf9d690f8 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:07.669065 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d92a5-4a74-4b7e-97b2-52fbf9d690f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:07.669335 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d92a5-4a74-4b7e-97b2-52fbf9d690f8 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:07.670000 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d92a5-4a74-4b7e-97b2-52fbf9d690f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:07.671893 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d92a5-4a74-4b7e-97b2-52fbf9d690f8 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:07.693501 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1320/2637] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 05:00:07 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:00:07.698204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984dc1e-d01b-4551-ad2e-b8fd95d6669a admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:07.708722 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984dc1e-d01b-4551-ad2e-b8fd95d6669a admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:07.714536 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec2d63-d5b4-404a-aad0-413c089e8354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:07.715178 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec2d63-d5b4-404a-aad0-413c089e8354 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:07.715590 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec2d63-d5b4-404a-aad0-413c089e8354 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:07.715874 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec2d63-d5b4-404a-aad0-413c089e8354 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:07.716539 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec2d63-d5b4-404a-aad0-413c089e8354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:07.718221 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec2d63-d5b4-404a-aad0-413c089e8354 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:07.729683 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1318/2638] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:00:07.733608 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d92a5-4a74-4b7e-97b2-52fbf9d690f8 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:07.743759 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d92a5-4a74-4b7e-97b2-52fbf9d690f8 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:07.748519 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1361d53-7dc9-4eec-b01e-4e3a8c46f2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:07.749115 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1361d53-7dc9-4eec-b01e-4e3a8c46f2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:07.749412 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1361d53-7dc9-4eec-b01e-4e3a8c46f2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:07.749700 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1361d53-7dc9-4eec-b01e-4e3a8c46f2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:07.750338 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1361d53-7dc9-4eec-b01e-4e3a8c46f2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:07.751899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1361d53-7dc9-4eec-b01e-4e3a8c46f2e4 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:07.762520 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1321/2639] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:00:07.766797 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec2d63-d5b4-404a-aad0-413c089e8354 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:07.777321 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec2d63-d5b4-404a-aad0-413c089e8354 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:07.782003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7387e8-990a-47e8-9d60-69cfb44ce372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:07.782575 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7387e8-990a-47e8-9d60-69cfb44ce372 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:07.782853 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7387e8-990a-47e8-9d60-69cfb44ce372 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:07.783125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7387e8-990a-47e8-9d60-69cfb44ce372 admin admin] PATH_INFO: `/v3/projects/8eeb8c4c1c24474fbac682a5f14aef15/users/0d89e357989142008de8f4b87de94fbd/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:07.797613 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7387e8-990a-47e8-9d60-69cfb44ce372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eeb8c4c1c24474fbac682a5f14aef15, user_id=0d89e357989142008de8f4b87de94fbd, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:07.800266 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7387e8-990a-47e8-9d60-69cfb44ce372 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:07.815136 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1319/2640] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:00:07 2022] PUT /identity/v3/projects/8eeb8c4c1c24474fbac682a5f14aef15/users/0d89e357989142008de8f4b87de94fbd/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:07.825998 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13faf8ab-ddae-4bbb-9516-37bff50d5089 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:07.826292 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13faf8ab-ddae-4bbb-9516-37bff50d5089 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:07.826571 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13faf8ab-ddae-4bbb-9516-37bff50d5089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:07.855118 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-13faf8ab-ddae-4bbb-9516-37bff50d5089 None None] MFA Rules not processed for user `0d89e357989142008de8f4b87de94fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:07.856343 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-13faf8ab-ddae-4bbb-9516-37bff50d5089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:07.921127 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1322/2641] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:07.925743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7387e8-990a-47e8-9d60-69cfb44ce372 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:07.987254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7387e8-990a-47e8-9d60-69cfb44ce372 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:07.992023 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62a93c-17ff-4ec3-b408-86ac8435ed7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:07.992621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62a93c-17ff-4ec3-b408-86ac8435ed7e admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:07.992907 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62a93c-17ff-4ec3-b408-86ac8435ed7e admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:07.993182 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62a93c-17ff-4ec3-b408-86ac8435ed7e admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:07.994372 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62a93c-17ff-4ec3-b408-86ac8435ed7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:07.996281 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62a93c-17ff-4ec3-b408-86ac8435ed7e admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:08.023608 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1320/2642] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 05:00:07 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:00:08.028014 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13faf8ab-ddae-4bbb-9516-37bff50d5089 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:08.038891 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13faf8ab-ddae-4bbb-9516-37bff50d5089 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:08.096648 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e329214-ea2d-4f9a-bf2a-ef3344692d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:08.097191 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e329214-ea2d-4f9a-bf2a-ef3344692d3a admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:08.097505 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e329214-ea2d-4f9a-bf2a-ef3344692d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:08.097786 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e329214-ea2d-4f9a-bf2a-ef3344692d3a admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:08.098435 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e329214-ea2d-4f9a-bf2a-ef3344692d3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:08.100391 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e329214-ea2d-4f9a-bf2a-ef3344692d3a admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:08.122067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1323/2643] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 05:00:08 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:00:08.126160 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62a93c-17ff-4ec3-b408-86ac8435ed7e admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:08.137693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62a93c-17ff-4ec3-b408-86ac8435ed7e admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:08.142373 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d0866-308b-4151-8840-aa16caa6d857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:08.142968 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d0866-308b-4151-8840-aa16caa6d857 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:08.143249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d0866-308b-4151-8840-aa16caa6d857 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:08.143524 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d0866-308b-4151-8840-aa16caa6d857 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:08.144161 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d0866-308b-4151-8840-aa16caa6d857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:08.145804 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d0866-308b-4151-8840-aa16caa6d857 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:08.157840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1321/2644] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:00:08.162502 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e329214-ea2d-4f9a-bf2a-ef3344692d3a admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:08.172707 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e329214-ea2d-4f9a-bf2a-ef3344692d3a admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:08.177693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989f884-9ad1-4bdc-a221-0650dc66e09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:08.178346 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989f884-9ad1-4bdc-a221-0650dc66e09c admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:08.178628 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989f884-9ad1-4bdc-a221-0650dc66e09c admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:08.178904 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989f884-9ad1-4bdc-a221-0650dc66e09c admin admin] PATH_INFO: `/v3/projects/e7508cb2029444f1897ce7d4566d8413/users/5dc70f9b61bd4a4a8d67ca75f7602eab/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:08.199023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989f884-9ad1-4bdc-a221-0650dc66e09c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7508cb2029444f1897ce7d4566d8413, user_id=5dc70f9b61bd4a4a8d67ca75f7602eab, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:08.201706 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989f884-9ad1-4bdc-a221-0650dc66e09c admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:08.214791 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1324/2645] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:00:08 2022] PUT /identity/v3/projects/e7508cb2029444f1897ce7d4566d8413/users/5dc70f9b61bd4a4a8d67ca75f7602eab/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:08.218782 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d0866-308b-4151-8840-aa16caa6d857 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:08.225296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:08.229511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d0866-308b-4151-8840-aa16caa6d857 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:08.288458 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f33c4-2c26-4400-864a-fbfcce956504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:08.289062 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f33c4-2c26-4400-864a-fbfcce956504 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:08.289342 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f33c4-2c26-4400-864a-fbfcce956504 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:08.289643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f33c4-2c26-4400-864a-fbfcce956504 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:08.290285 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f33c4-2c26-4400-864a-fbfcce956504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:08.292110 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f33c4-2c26-4400-864a-fbfcce956504 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:08.301790 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1322/2646] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:00:08.306176 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989f884-9ad1-4bdc-a221-0650dc66e09c admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:08.317638 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989f884-9ad1-4bdc-a221-0650dc66e09c admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:08.323061 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2884e7-c60c-4547-9c7d-d0c919ba9fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:08.323719 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2884e7-c60c-4547-9c7d-d0c919ba9fd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:08.324001 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2884e7-c60c-4547-9c7d-d0c919ba9fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:08.324274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2884e7-c60c-4547-9c7d-d0c919ba9fd9 admin admin] PATH_INFO: `/v3/projects/e7508cb2029444f1897ce7d4566d8413/users/5dc70f9b61bd4a4a8d67ca75f7602eab/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:08.326242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2884e7-c60c-4547-9c7d-d0c919ba9fd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7508cb2029444f1897ce7d4566d8413, user_id=5dc70f9b61bd4a4a8d67ca75f7602eab, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:08.328863 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2884e7-c60c-4547-9c7d-d0c919ba9fd9 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:08.332015 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:08.341609 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1325/2647] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:00:08 2022] PUT /identity/v3/projects/e7508cb2029444f1897ce7d4566d8413/users/5dc70f9b61bd4a4a8d67ca75f7602eab/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:00:08.352893 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f63b18-02b8-4687-ae3f-d1257234694d None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:08.353106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f63b18-02b8-4687-ae3f-d1257234694d None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:08.353997 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f63b18-02b8-4687-ae3f-d1257234694d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:08.382044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-d5f63b18-02b8-4687-ae3f-d1257234694d None None] MFA Rules not processed for user `5dc70f9b61bd4a4a8d67ca75f7602eab`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:08.383242 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-d5f63b18-02b8-4687-ae3f-d1257234694d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:08.450627 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1323/2648] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:08.461992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2884e7-c60c-4547-9c7d-d0c919ba9fd9 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:08.464762 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-2c2884e7-c60c-4547-9c7d-d0c919ba9fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:08.529894 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2884e7-c60c-4547-9c7d-d0c919ba9fd9 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:08.533658 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fb9c7-4948-4984-8c73-28a91d46cf32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:08.534277 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fb9c7-4948-4984-8c73-28a91d46cf32 service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:08.534560 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fb9c7-4948-4984-8c73-28a91d46cf32 service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:08.534857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fb9c7-4948-4984-8c73-28a91d46cf32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:08.544918 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fb9c7-4948-4984-8c73-28a91d46cf32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:08.546387 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fb9c7-4948-4984-8c73-28a91d46cf32 service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:08.555728 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1326/2649] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:08.601060 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f63b18-02b8-4687-ae3f-d1257234694d None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:08.602488 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-d5f63b18-02b8-4687-ae3f-d1257234694d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:08.614937 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f63b18-02b8-4687-ae3f-d1257234694d None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:08.618501 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539b297-c4a2-443b-879b-a3f44eb030d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:08.619297 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539b297-c4a2-443b-879b-a3f44eb030d6 service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:08.619547 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539b297-c4a2-443b-879b-a3f44eb030d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:08.619845 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539b297-c4a2-443b-879b-a3f44eb030d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:08.677817 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539b297-c4a2-443b-879b-a3f44eb030d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:08.679247 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539b297-c4a2-443b-879b-a3f44eb030d6 service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:08.689231 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1324/2650] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:09.644219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fb9c7-4948-4984-8c73-28a91d46cf32 service cinder] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:09.653044 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fb9c7-4948-4984-8c73-28a91d46cf32 service cinder] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:09.657273 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514b236-ddab-4c3c-84d5-8b0d3b43891e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:09.657904 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514b236-ddab-4c3c-84d5-8b0d3b43891e service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:09.658189 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514b236-ddab-4c3c-84d5-8b0d3b43891e service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:09.658463 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514b236-ddab-4c3c-84d5-8b0d3b43891e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:09.660199 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-a514b236-ddab-4c3c-84d5-8b0d3b43891e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:09.730903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514b236-ddab-4c3c-84d5-8b0d3b43891e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:09.732876 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514b236-ddab-4c3c-84d5-8b0d3b43891e service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:09.743759 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1327/2651] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:12.020345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539b297-c4a2-443b-879b-a3f44eb030d6 service cinder] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:12.048754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=100 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:12.085490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539b297-c4a2-443b-879b-a3f44eb030d6 service cinder] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:12.090064 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c3e08-34d8-4514-b47e-21840e6109aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:12.090684 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c3e08-34d8-4514-b47e-21840e6109aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:12.090963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c3e08-34d8-4514-b47e-21840e6109aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:12.091235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c3e08-34d8-4514-b47e-21840e6109aa admin admin] PATH_INFO: `/v3/users/0d89e357989142008de8f4b87de94fbd` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:12.093220 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c3e08-34d8-4514-b47e-21840e6109aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d89e357989142008de8f4b87de94fbd)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:12.095177 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c3e08-34d8-4514-b47e-21840e6109aa admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:12.144786 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-629c3e08-34d8-4514-b47e-21840e6109aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d89e357989142008de8f4b87de94fbd'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:12.145462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-629c3e08-34d8-4514-b47e-21840e6109aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d89e357989142008de8f4b87de94fbd'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:12.153757 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-629c3e08-34d8-4514-b47e-21840e6109aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d89e357989142008de8f4b87de94fbd'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:12.166164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-629c3e08-34d8-4514-b47e-21840e6109aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d89e357989142008de8f4b87de94fbd'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:12.174258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-629c3e08-34d8-4514-b47e-21840e6109aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d89e357989142008de8f4b87de94fbd'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:12.180292 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1325/2652] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 05:00:12 2022] DELETE /identity/v3/users/0d89e357989142008de8f4b87de94fbd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:12.184929 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ec577-4fa7-445b-bc06-1b31d156105b None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:12.186116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ec577-4fa7-445b-bc06-1b31d156105b None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:12.186233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ec577-4fa7-445b-bc06-1b31d156105b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:12.204880 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-bd5ec577-4fa7-445b-bc06-1b31d156105b None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:12.206053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-bd5ec577-4fa7-445b-bc06-1b31d156105b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:12.268799 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1328/2653] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:12.278683 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c3e08-34d8-4514-b47e-21840e6109aa admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:12.280562 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-629c3e08-34d8-4514-b47e-21840e6109aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:12.345536 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c3e08-34d8-4514-b47e-21840e6109aa admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:12.349702 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9856a7-9b2a-4042-afef-1ea177f0cf78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:12.350351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9856a7-9b2a-4042-afef-1ea177f0cf78 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:12.350636 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9856a7-9b2a-4042-afef-1ea177f0cf78 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:12.350907 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9856a7-9b2a-4042-afef-1ea177f0cf78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:12.362757 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9856a7-9b2a-4042-afef-1ea177f0cf78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:12.364329 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9856a7-9b2a-4042-afef-1ea177f0cf78 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:12.381910 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1326/2654] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:12.669588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ec577-4fa7-445b-bc06-1b31d156105b None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:12.672147 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-bd5ec577-4fa7-445b-bc06-1b31d156105b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:12.686528 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ec577-4fa7-445b-bc06-1b31d156105b None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:12.691657 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be363a79-f562-4812-9ecf-efbeea04b5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:12.692308 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be363a79-f562-4812-9ecf-efbeea04b5aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:12.692624 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be363a79-f562-4812-9ecf-efbeea04b5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:12.692868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be363a79-f562-4812-9ecf-efbeea04b5aa admin admin] PATH_INFO: `/v3/projects/8eeb8c4c1c24474fbac682a5f14aef15` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:12.694037 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be363a79-f562-4812-9ecf-efbeea04b5aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eeb8c4c1c24474fbac682a5f14aef15)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:12.695954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be363a79-f562-4812-9ecf-efbeea04b5aa admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:12.718248 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aeaf7-79ff-442d-8cbc-af612e329bf1 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:12.718567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aeaf7-79ff-442d-8cbc-af612e329bf1 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:12.718904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aeaf7-79ff-442d-8cbc-af612e329bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:12.738537 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=100 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:12.750445 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-f75aeaf7-79ff-442d-8cbc-af612e329bf1 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:12.751772 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-f75aeaf7-79ff-442d-8cbc-af612e329bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:12.761259 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1327/2655] 10.222.0.84 () {58 vars in 1016 bytes} [Wed Aug 24 05:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:00:12.770510 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-be363a79-f562-4812-9ecf-efbeea04b5aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eeb8c4c1c24474fbac682a5f14aef15', 'request_id': 'req-be363a79-f562-4812-9ecf-efbeea04b5aa'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:12.780278 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-be363a79-f562-4812-9ecf-efbeea04b5aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eeb8c4c1c24474fbac682a5f14aef15', 'request_id': 'req-be363a79-f562-4812-9ecf-efbeea04b5aa'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:12.787443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75aeaf7-79ff-442d-8cbc-af612e329bf1 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:12.788893 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-f75aeaf7-79ff-442d-8cbc-af612e329bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:12.790617 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-be363a79-f562-4812-9ecf-efbeea04b5aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eeb8c4c1c24474fbac682a5f14aef15', 'request_id': 'req-be363a79-f562-4812-9ecf-efbeea04b5aa'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:12.803190 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-be363a79-f562-4812-9ecf-efbeea04b5aa admin admin] The token cache is being invalidate because project 8eeb8c4c1c24474fbac682a5f14aef15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:00:12.803478 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-be363a79-f562-4812-9ecf-efbeea04b5aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:12.804109 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-be363a79-f562-4812-9ecf-efbeea04b5aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:12.805638 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1329/2656] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 05:00:12 2022] DELETE /identity/v3/projects/8eeb8c4c1c24474fbac682a5f14aef15 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:12.809481 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be363a79-f562-4812-9ecf-efbeea04b5aa admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:12.811505 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-be363a79-f562-4812-9ecf-efbeea04b5aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:12.837505 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:12.871644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75aeaf7-79ff-442d-8cbc-af612e329bf1 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:12.877476 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be363a79-f562-4812-9ecf-efbeea04b5aa admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:12.882590 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a3d5d-9acc-469f-9953-c5a322d19479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:12.883229 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a3d5d-9acc-469f-9953-c5a322d19479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:12.883517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a3d5d-9acc-469f-9953-c5a322d19479 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:12.883796 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a3d5d-9acc-469f-9953-c5a322d19479 admin admin] PATH_INFO: `/v3/users/5dc70f9b61bd4a4a8d67ca75f7602eab` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:12.884977 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a3d5d-9acc-469f-9953-c5a322d19479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dc70f9b61bd4a4a8d67ca75f7602eab)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:12.886937 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a3d5d-9acc-469f-9953-c5a322d19479 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:12.937057 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-616a3d5d-9acc-469f-9953-c5a322d19479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dc70f9b61bd4a4a8d67ca75f7602eab'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:12.937976 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0edfa-262a-47c5-bd31-1bf801ae5796 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:12.938636 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0edfa-262a-47c5-bd31-1bf801ae5796 service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:12.938927 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0edfa-262a-47c5-bd31-1bf801ae5796 service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:12.939193 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0edfa-262a-47c5-bd31-1bf801ae5796 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:12.941146 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-38c0edfa-262a-47c5-bd31-1bf801ae5796 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:12.945105 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-616a3d5d-9acc-469f-9953-c5a322d19479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dc70f9b61bd4a4a8d67ca75f7602eab'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:12.953355 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-616a3d5d-9acc-469f-9953-c5a322d19479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dc70f9b61bd4a4a8d67ca75f7602eab'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:12.953573 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0edfa-262a-47c5-bd31-1bf801ae5796 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:12.954141 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-616a3d5d-9acc-469f-9953-c5a322d19479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dc70f9b61bd4a4a8d67ca75f7602eab'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:12.955044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0edfa-262a-47c5-bd31-1bf801ae5796 service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:12.965173 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1328/2657] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:12.966457 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-616a3d5d-9acc-469f-9953-c5a322d19479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dc70f9b61bd4a4a8d67ca75f7602eab'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:12.974206 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1330/2658] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 05:00:12 2022] DELETE /identity/v3/users/5dc70f9b61bd4a4a8d67ca75f7602eab => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:00:13.258249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0edfa-262a-47c5-bd31-1bf801ae5796 service nova] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:13.268814 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0edfa-262a-47c5-bd31-1bf801ae5796 service nova] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:13.327538 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36271efd-683f-4573-8293-3cd49af84259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:13.328179 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36271efd-683f-4573-8293-3cd49af84259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:13.328482 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36271efd-683f-4573-8293-3cd49af84259 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:13.328759 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36271efd-683f-4573-8293-3cd49af84259 admin admin] PATH_INFO: `/v3/projects/e7508cb2029444f1897ce7d4566d8413` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:13.329947 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36271efd-683f-4573-8293-3cd49af84259 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7508cb2029444f1897ce7d4566d8413)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:13.331902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36271efd-683f-4573-8293-3cd49af84259 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:13.385264 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-36271efd-683f-4573-8293-3cd49af84259 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7508cb2029444f1897ce7d4566d8413', 'request_id': 'req-36271efd-683f-4573-8293-3cd49af84259'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:13.391413 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-36271efd-683f-4573-8293-3cd49af84259 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7508cb2029444f1897ce7d4566d8413', 'request_id': 'req-36271efd-683f-4573-8293-3cd49af84259'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:13.398980 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-36271efd-683f-4573-8293-3cd49af84259 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7508cb2029444f1897ce7d4566d8413', 'request_id': 'req-36271efd-683f-4573-8293-3cd49af84259'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:13.400119 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:13.414440 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-36271efd-683f-4573-8293-3cd49af84259 admin admin] The token cache is being invalidate because project e7508cb2029444f1897ce7d4566d8413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:00:13.414734 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-36271efd-683f-4573-8293-3cd49af84259 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:13.415393 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-36271efd-683f-4573-8293-3cd49af84259 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:13.416918 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1329/2659] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 05:00:13 2022] DELETE /identity/v3/projects/e7508cb2029444f1897ce7d4566d8413 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:00:13.422105 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b6f22-0317-444b-8929-c6c9e6faf978 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:13.422933 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b6f22-0317-444b-8929-c6c9e6faf978 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:13.423207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b6f22-0317-444b-8929-c6c9e6faf978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:13.444182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-f67b6f22-0317-444b-8929-c6c9e6faf978 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:13.445372 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-f67b6f22-0317-444b-8929-c6c9e6faf978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:13.466119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:13.507414 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1331/2660] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:13.515157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ba1b7-26b8-4ccb-9320-90d17ee3d6f5 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:13.515439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ba1b7-26b8-4ccb-9320-90d17ee3d6f5 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:13.515735 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ba1b7-26b8-4ccb-9320-90d17ee3d6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:13.535357 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-ee4ba1b7-26b8-4ccb-9320-90d17ee3d6f5 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:13.536578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-ee4ba1b7-26b8-4ccb-9320-90d17ee3d6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:13.544471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1330/2661] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:00:13.549310 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b6f22-0317-444b-8929-c6c9e6faf978 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:13.559208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b6f22-0317-444b-8929-c6c9e6faf978 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:13.564426 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d791930-20d6-4b47-8b8c-72dc9998608a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:13.565027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d791930-20d6-4b47-8b8c-72dc9998608a admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:13.565306 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d791930-20d6-4b47-8b8c-72dc9998608a admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:13.565603 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d791930-20d6-4b47-8b8c-72dc9998608a admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:13.566250 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d791930-20d6-4b47-8b8c-72dc9998608a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:00:13.566555 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d791930-20d6-4b47-8b8c-72dc9998608a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:13.568153 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d791930-20d6-4b47-8b8c-72dc9998608a admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:13.579584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1332/2662] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 05:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:00:13.584024 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ba1b7-26b8-4ccb-9320-90d17ee3d6f5 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:13.593780 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ba1b7-26b8-4ccb-9320-90d17ee3d6f5 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:13.598437 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb07524-d37d-4707-bf7c-247990fcba88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:13.599030 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb07524-d37d-4707-bf7c-247990fcba88 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:13.599305 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb07524-d37d-4707-bf7c-247990fcba88 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:13.599577 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb07524-d37d-4707-bf7c-247990fcba88 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:13.600192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb07524-d37d-4707-bf7c-247990fcba88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:13.602090 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb07524-d37d-4707-bf7c-247990fcba88 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:13.630576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1331/2663] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 05:00:13 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:00:13.634892 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d791930-20d6-4b47-8b8c-72dc9998608a admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:13.645529 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d791930-20d6-4b47-8b8c-72dc9998608a admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:13.709048 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef10504-37c7-429a-9364-b4897f29b2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:13.709926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef10504-37c7-429a-9364-b4897f29b2c0 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:13.710207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef10504-37c7-429a-9364-b4897f29b2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:13.710510 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef10504-37c7-429a-9364-b4897f29b2c0 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:13.711306 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef10504-37c7-429a-9364-b4897f29b2c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:13.713707 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef10504-37c7-429a-9364-b4897f29b2c0 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:13.738631 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1333/2664] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 05:00:13 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:00:13.743038 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb07524-d37d-4707-bf7c-247990fcba88 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:13.754207 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb07524-d37d-4707-bf7c-247990fcba88 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:13.759186 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70b5e5-0dd6-4fd9-a3cd-6793d60220ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:13.759773 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70b5e5-0dd6-4fd9-a3cd-6793d60220ce admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:13.760048 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70b5e5-0dd6-4fd9-a3cd-6793d60220ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:13.760317 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70b5e5-0dd6-4fd9-a3cd-6793d60220ce admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:13.760960 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70b5e5-0dd6-4fd9-a3cd-6793d60220ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:13.762576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70b5e5-0dd6-4fd9-a3cd-6793d60220ce admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:13.772700 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1332/2665] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:00:13.777390 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef10504-37c7-429a-9364-b4897f29b2c0 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:13.787645 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef10504-37c7-429a-9364-b4897f29b2c0 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:13.792397 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f264a-e76d-4ae2-9619-c92d03500648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:13.792996 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f264a-e76d-4ae2-9619-c92d03500648 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:13.793283 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f264a-e76d-4ae2-9619-c92d03500648 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:13.793604 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f264a-e76d-4ae2-9619-c92d03500648 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:13.794249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f264a-e76d-4ae2-9619-c92d03500648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:13.796331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f264a-e76d-4ae2-9619-c92d03500648 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:13.806962 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1334/2666] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:00:13.811767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70b5e5-0dd6-4fd9-a3cd-6793d60220ce admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:13.821963 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70b5e5-0dd6-4fd9-a3cd-6793d60220ce admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:13.827012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d607d-e08d-4bbf-9905-f34031cc681e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:13.827651 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d607d-e08d-4bbf-9905-f34031cc681e admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:13.827929 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d607d-e08d-4bbf-9905-f34031cc681e admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:13.828200 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d607d-e08d-4bbf-9905-f34031cc681e admin admin] PATH_INFO: `/v3/projects/35b82ccb5a794d8c87c2bda43b1879b0/users/0e7715e681f3454cbc752c1bdd22e020/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:13.843113 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d607d-e08d-4bbf-9905-f34031cc681e admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b82ccb5a794d8c87c2bda43b1879b0, user_id=0e7715e681f3454cbc752c1bdd22e020, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:13.845848 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d607d-e08d-4bbf-9905-f34031cc681e admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:13.859279 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1333/2667] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:00:13 2022] PUT /identity/v3/projects/35b82ccb5a794d8c87c2bda43b1879b0/users/0e7715e681f3454cbc752c1bdd22e020/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:13.869524 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b79650-ff33-4d65-98b9-ab2b01fd8e5e None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:13.869836 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b79650-ff33-4d65-98b9-ab2b01fd8e5e None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:13.870114 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b79650-ff33-4d65-98b9-ab2b01fd8e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:13.898831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-98b79650-ff33-4d65-98b9-ab2b01fd8e5e None None] MFA Rules not processed for user `0e7715e681f3454cbc752c1bdd22e020`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:13.900036 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-98b79650-ff33-4d65-98b9-ab2b01fd8e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:13.964484 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1335/2668] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:13.969880 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d607d-e08d-4bbf-9905-f34031cc681e admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:14.034013 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d607d-e08d-4bbf-9905-f34031cc681e admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:14.038935 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d46a5d-d7fd-4307-b828-068d7aff5c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:14.039565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d46a5d-d7fd-4307-b828-068d7aff5c3b admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:14.039848 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d46a5d-d7fd-4307-b828-068d7aff5c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:14.040117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d46a5d-d7fd-4307-b828-068d7aff5c3b admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:14.040742 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d46a5d-d7fd-4307-b828-068d7aff5c3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:14.042653 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d46a5d-d7fd-4307-b828-068d7aff5c3b admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:14.069706 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1334/2669] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 05:00:13 2022] POST /identity/v3/projects => generated 389 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:00:14.073795 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b79650-ff33-4d65-98b9-ab2b01fd8e5e None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:14.084527 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b79650-ff33-4d65-98b9-ab2b01fd8e5e None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:14.103350 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:14.144170 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccb26c-3784-45da-a8a1-7cc23d13cf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:14.145016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccb26c-3784-45da-a8a1-7cc23d13cf63 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:14.145332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccb26c-3784-45da-a8a1-7cc23d13cf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:14.145684 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccb26c-3784-45da-a8a1-7cc23d13cf63 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:14.146404 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bccb26c-3784-45da-a8a1-7cc23d13cf63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:14.148392 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bccb26c-3784-45da-a8a1-7cc23d13cf63 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:14.171203 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1336/2670] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 05:00:14 2022] POST /identity/v3/users => generated 301 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:00:14.175510 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d46a5d-d7fd-4307-b828-068d7aff5c3b admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:14.186030 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d46a5d-d7fd-4307-b828-068d7aff5c3b admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:14.190961 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c2c04-877f-4b58-925f-1ef93c61abd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:14.191588 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c2c04-877f-4b58-925f-1ef93c61abd5 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:14.191872 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c2c04-877f-4b58-925f-1ef93c61abd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:14.192143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c2c04-877f-4b58-925f-1ef93c61abd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:14.192792 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c2c04-877f-4b58-925f-1ef93c61abd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:14.194417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c2c04-877f-4b58-925f-1ef93c61abd5 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:14.205413 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1335/2671] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:00:14.209549 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccb26c-3784-45da-a8a1-7cc23d13cf63 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:14.220513 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccb26c-3784-45da-a8a1-7cc23d13cf63 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:14.225133 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15d171-71a6-4826-9e80-4e991702fc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:14.225822 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15d171-71a6-4826-9e80-4e991702fc2a admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:14.226164 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15d171-71a6-4826-9e80-4e991702fc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:14.226373 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15d171-71a6-4826-9e80-4e991702fc2a admin admin] PATH_INFO: `/v3/projects/859cb98af3b144c7a90a5ba894054e36/users/3d8b530647934795b459b860999e3e5b/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:14.242232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15d171-71a6-4826-9e80-4e991702fc2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=859cb98af3b144c7a90a5ba894054e36, user_id=3d8b530647934795b459b860999e3e5b, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:14.244913 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15d171-71a6-4826-9e80-4e991702fc2a admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:14.258698 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1337/2672] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:00:14 2022] PUT /identity/v3/projects/859cb98af3b144c7a90a5ba894054e36/users/3d8b530647934795b459b860999e3e5b/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:14.262745 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c2c04-877f-4b58-925f-1ef93c61abd5 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:14.273605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c2c04-877f-4b58-925f-1ef93c61abd5 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:14.333950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5724f-51d9-4ffe-b3e7-846dd1e6a403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:14.334556 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5724f-51d9-4ffe-b3e7-846dd1e6a403 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:14.334838 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5724f-51d9-4ffe-b3e7-846dd1e6a403 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:14.335113 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5724f-51d9-4ffe-b3e7-846dd1e6a403 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:14.335755 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5724f-51d9-4ffe-b3e7-846dd1e6a403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:14.337334 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5724f-51d9-4ffe-b3e7-846dd1e6a403 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:14.343201 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:14.349552 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1336/2673] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:00:14.352827 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15d171-71a6-4826-9e80-4e991702fc2a admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:14.363734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15d171-71a6-4826-9e80-4e991702fc2a admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:14.368516 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec128e0-107d-404c-8067-38d92304619b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:14.369228 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec128e0-107d-404c-8067-38d92304619b admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:14.369543 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec128e0-107d-404c-8067-38d92304619b admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:14.369817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec128e0-107d-404c-8067-38d92304619b admin admin] PATH_INFO: `/v3/projects/859cb98af3b144c7a90a5ba894054e36/users/3d8b530647934795b459b860999e3e5b/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:14.371730 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec128e0-107d-404c-8067-38d92304619b admin admin] RBAC: Authorizing `identity:create_grant(project_id=859cb98af3b144c7a90a5ba894054e36, user_id=3d8b530647934795b459b860999e3e5b, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:14.374473 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec128e0-107d-404c-8067-38d92304619b admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:14.384821 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1338/2674] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:00:14 2022] PUT /identity/v3/projects/859cb98af3b144c7a90a5ba894054e36/users/3d8b530647934795b459b860999e3e5b/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:14.396475 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb20f9-6065-4499-93e5-8f5e9718b04d None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:14.396758 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb20f9-6065-4499-93e5-8f5e9718b04d None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:14.397031 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb20f9-6065-4499-93e5-8f5e9718b04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:14.426052 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-b0cb20f9-6065-4499-93e5-8f5e9718b04d None None] MFA Rules not processed for user `3d8b530647934795b459b860999e3e5b`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:14.427274 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-b0cb20f9-6065-4499-93e5-8f5e9718b04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:14.498072 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1337/2675] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:14 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:14.508948 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec128e0-107d-404c-8067-38d92304619b admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:14.510662 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-8ec128e0-107d-404c-8067-38d92304619b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:14.569764 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec128e0-107d-404c-8067-38d92304619b admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:14.573272 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f3e9b-f0f0-47cc-8b5f-2271ee17a804 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:14.573903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f3e9b-f0f0-47cc-8b5f-2271ee17a804 service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:14.574181 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f3e9b-f0f0-47cc-8b5f-2271ee17a804 service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:14.574474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f3e9b-f0f0-47cc-8b5f-2271ee17a804 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:14.584347 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f3e9b-f0f0-47cc-8b5f-2271ee17a804 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:14.585930 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f3e9b-f0f0-47cc-8b5f-2271ee17a804 service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:14.596258 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1339/2676] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:14 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:14.736716 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb20f9-6065-4499-93e5-8f5e9718b04d None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:14.802515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb20f9-6065-4499-93e5-8f5e9718b04d None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:14.807452 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502ad7a-623c-4590-9db4-51dbb4edda14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:14.808122 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502ad7a-623c-4590-9db4-51dbb4edda14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:14.808402 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502ad7a-623c-4590-9db4-51dbb4edda14 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:14.808676 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502ad7a-623c-4590-9db4-51dbb4edda14 admin admin] PATH_INFO: `/v3/users/0e7715e681f3454cbc752c1bdd22e020` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:14.809876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502ad7a-623c-4590-9db4-51dbb4edda14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e7715e681f3454cbc752c1bdd22e020)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:14.812676 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502ad7a-623c-4590-9db4-51dbb4edda14 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:14.867256 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-d502ad7a-623c-4590-9db4-51dbb4edda14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e7715e681f3454cbc752c1bdd22e020'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:14.868005 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-d502ad7a-623c-4590-9db4-51dbb4edda14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e7715e681f3454cbc752c1bdd22e020'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:14.876861 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-d502ad7a-623c-4590-9db4-51dbb4edda14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e7715e681f3454cbc752c1bdd22e020'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:14.890657 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-d502ad7a-623c-4590-9db4-51dbb4edda14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e7715e681f3454cbc752c1bdd22e020'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:14.897833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-d502ad7a-623c-4590-9db4-51dbb4edda14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e7715e681f3454cbc752c1bdd22e020'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:14.903995 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1338/2677] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 05:00:14 2022] DELETE /identity/v3/users/0e7715e681f3454cbc752c1bdd22e020 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:14.908896 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b28ee3-add5-4cc0-a8ca-79d5561ebcb3 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:14.909184 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b28ee3-add5-4cc0-a8ca-79d5561ebcb3 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:14.909510 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b28ee3-add5-4cc0-a8ca-79d5561ebcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:14.928584 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-39b28ee3-add5-4cc0-a8ca-79d5561ebcb3 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:14.929865 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-39b28ee3-add5-4cc0-a8ca-79d5561ebcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:14.988928 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1340/2678] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:14.999355 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502ad7a-623c-4590-9db4-51dbb4edda14 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:15.000753 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-d502ad7a-623c-4590-9db4-51dbb4edda14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:15.007591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:15.065478 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502ad7a-623c-4590-9db4-51dbb4edda14 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:15.069357 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c43d09-f086-41fd-879c-9dd5ac0beceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:15.070011 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c43d09-f086-41fd-879c-9dd5ac0beceb service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:15.070317 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c43d09-f086-41fd-879c-9dd5ac0beceb service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:15.070591 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c43d09-f086-41fd-879c-9dd5ac0beceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:15.080234 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c43d09-f086-41fd-879c-9dd5ac0beceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:15.081691 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c43d09-f086-41fd-879c-9dd5ac0beceb service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:15.091058 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1339/2679] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:00:15.366972 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b28ee3-add5-4cc0-a8ca-79d5561ebcb3 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:15.368491 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-39b28ee3-add5-4cc0-a8ca-79d5561ebcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:15.393895 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b28ee3-add5-4cc0-a8ca-79d5561ebcb3 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:15.399316 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921be29-acef-4ff1-9804-f9abc7ce317b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:15.400056 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921be29-acef-4ff1-9804-f9abc7ce317b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:15.400450 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921be29-acef-4ff1-9804-f9abc7ce317b admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:15.400787 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921be29-acef-4ff1-9804-f9abc7ce317b admin admin] PATH_INFO: `/v3/projects/35b82ccb5a794d8c87c2bda43b1879b0` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:15.402132 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921be29-acef-4ff1-9804-f9abc7ce317b admin admin] RBAC: Authorizing `identity:delete_project(project_id=35b82ccb5a794d8c87c2bda43b1879b0)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:15.404606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921be29-acef-4ff1-9804-f9abc7ce317b admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:15.418031 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:15.454671 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e921be29-acef-4ff1-9804-f9abc7ce317b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35b82ccb5a794d8c87c2bda43b1879b0', 'request_id': 'req-e921be29-acef-4ff1-9804-f9abc7ce317b'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:15.461243 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e921be29-acef-4ff1-9804-f9abc7ce317b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35b82ccb5a794d8c87c2bda43b1879b0', 'request_id': 'req-e921be29-acef-4ff1-9804-f9abc7ce317b'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:15.469651 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e921be29-acef-4ff1-9804-f9abc7ce317b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35b82ccb5a794d8c87c2bda43b1879b0', 'request_id': 'req-e921be29-acef-4ff1-9804-f9abc7ce317b'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:15.480686 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e921be29-acef-4ff1-9804-f9abc7ce317b admin admin] The token cache is being invalidate because project 35b82ccb5a794d8c87c2bda43b1879b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:00:15.480878 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e921be29-acef-4ff1-9804-f9abc7ce317b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:15.482031 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e921be29-acef-4ff1-9804-f9abc7ce317b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:15.484148 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1341/2680] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 05:00:15 2022] DELETE /identity/v3/projects/35b82ccb5a794d8c87c2bda43b1879b0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:15.488110 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c43d09-f086-41fd-879c-9dd5ac0beceb service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:15.498171 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c43d09-f086-41fd-879c-9dd5ac0beceb service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:15.557253 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c87ba-0134-4e3b-9bb6-fbf76dacc5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:15.557912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c87ba-0134-4e3b-9bb6-fbf76dacc5d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:15.558194 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c87ba-0134-4e3b-9bb6-fbf76dacc5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:15.558453 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c87ba-0134-4e3b-9bb6-fbf76dacc5d3 admin admin] PATH_INFO: `/v3/users/3d8b530647934795b459b860999e3e5b` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:15.559567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c87ba-0134-4e3b-9bb6-fbf76dacc5d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d8b530647934795b459b860999e3e5b)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:15.561681 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c87ba-0134-4e3b-9bb6-fbf76dacc5d3 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:15.608937 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-259c87ba-0134-4e3b-9bb6-fbf76dacc5d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d8b530647934795b459b860999e3e5b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:15.609622 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-259c87ba-0134-4e3b-9bb6-fbf76dacc5d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d8b530647934795b459b860999e3e5b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:15.616841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-259c87ba-0134-4e3b-9bb6-fbf76dacc5d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d8b530647934795b459b860999e3e5b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:15.629106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-259c87ba-0134-4e3b-9bb6-fbf76dacc5d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d8b530647934795b459b860999e3e5b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:15.636133 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-259c87ba-0134-4e3b-9bb6-fbf76dacc5d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d8b530647934795b459b860999e3e5b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:15.643267 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1340/2681] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 05:00:15 2022] DELETE /identity/v3/users/3d8b530647934795b459b860999e3e5b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:15.929671 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921be29-acef-4ff1-9804-f9abc7ce317b admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:15.931175 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-e921be29-acef-4ff1-9804-f9abc7ce317b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:15.944840 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921be29-acef-4ff1-9804-f9abc7ce317b admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:16.004806 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6df2b1-9070-45f5-8962-417ed594e73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:16.005658 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6df2b1-9070-45f5-8962-417ed594e73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:16.005989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6df2b1-9070-45f5-8962-417ed594e73b admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:16.006265 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6df2b1-9070-45f5-8962-417ed594e73b admin admin] PATH_INFO: `/v3/projects/859cb98af3b144c7a90a5ba894054e36` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:16.007373 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6df2b1-9070-45f5-8962-417ed594e73b admin admin] RBAC: Authorizing `identity:delete_project(project_id=859cb98af3b144c7a90a5ba894054e36)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:16.009259 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6df2b1-9070-45f5-8962-417ed594e73b admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:16.056830 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-bb6df2b1-9070-45f5-8962-417ed594e73b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '859cb98af3b144c7a90a5ba894054e36', 'request_id': 'req-bb6df2b1-9070-45f5-8962-417ed594e73b'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:16.063625 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-bb6df2b1-9070-45f5-8962-417ed594e73b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '859cb98af3b144c7a90a5ba894054e36', 'request_id': 'req-bb6df2b1-9070-45f5-8962-417ed594e73b'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:16.071923 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-bb6df2b1-9070-45f5-8962-417ed594e73b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '859cb98af3b144c7a90a5ba894054e36', 'request_id': 'req-bb6df2b1-9070-45f5-8962-417ed594e73b'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:16.083673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-bb6df2b1-9070-45f5-8962-417ed594e73b admin admin] The token cache is being invalidate because project 859cb98af3b144c7a90a5ba894054e36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:00:16.083963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-bb6df2b1-9070-45f5-8962-417ed594e73b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:16.084591 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-bb6df2b1-9070-45f5-8962-417ed594e73b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:16.086108 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1342/2682] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 05:00:15 2022] DELETE /identity/v3/projects/859cb98af3b144c7a90a5ba894054e36 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:00:16.090989 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06267b23-e3cc-4755-9891-c2501f79dbeb None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:16.091268 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06267b23-e3cc-4755-9891-c2501f79dbeb None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:16.091539 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06267b23-e3cc-4755-9891-c2501f79dbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:16.111994 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-06267b23-e3cc-4755-9891-c2501f79dbeb None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:16.113258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-06267b23-e3cc-4755-9891-c2501f79dbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:16.135176 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:16.177525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1341/2683] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:16.185435 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01875f9e-bff5-47c0-b16c-ac53dbb2f25c None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:16.185749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01875f9e-bff5-47c0-b16c-ac53dbb2f25c None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:16.186031 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01875f9e-bff5-47c0-b16c-ac53dbb2f25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:16.207091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-01875f9e-bff5-47c0-b16c-ac53dbb2f25c None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:16.208385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-01875f9e-bff5-47c0-b16c-ac53dbb2f25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:16.218028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1343/2684] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:16.224749 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06267b23-e3cc-4755-9891-c2501f79dbeb None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:16.238909 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06267b23-e3cc-4755-9891-c2501f79dbeb None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:16.244471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c2cb9-4cee-4266-a845-9297d688376c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:16.245097 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c2cb9-4cee-4266-a845-9297d688376c admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:16.245510 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c2cb9-4cee-4266-a845-9297d688376c admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:16.245786 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c2cb9-4cee-4266-a845-9297d688376c admin admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:16.246676 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c2cb9-4cee-4266-a845-9297d688376c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:00:16.246984 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c2cb9-4cee-4266-a845-9297d688376c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:16.248833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c2cb9-4cee-4266-a845-9297d688376c admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:16.263100 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1342/2685] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 05:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:00:16.268879 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01875f9e-bff5-47c0-b16c-ac53dbb2f25c None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:16.278540 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01875f9e-bff5-47c0-b16c-ac53dbb2f25c None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:16.284363 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2beb527-9a49-419f-b9eb-979f4968d29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:16.284975 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beb527-9a49-419f-b9eb-979f4968d29c admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:16.285259 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beb527-9a49-419f-b9eb-979f4968d29c admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:16.285581 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beb527-9a49-419f-b9eb-979f4968d29c admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:16.286229 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2beb527-9a49-419f-b9eb-979f4968d29c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:16.288102 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2beb527-9a49-419f-b9eb-979f4968d29c admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:16.317329 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1344/2686] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 05:00:16 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:00:16.321491 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c2cb9-4cee-4266-a845-9297d688376c admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:16.331826 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c2cb9-4cee-4266-a845-9297d688376c admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:16.391392 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c84150-3642-4608-bf4f-18cacb2893ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:16.392002 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c84150-3642-4608-bf4f-18cacb2893ab admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:16.392283 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c84150-3642-4608-bf4f-18cacb2893ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:16.392609 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c84150-3642-4608-bf4f-18cacb2893ab admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:16.393257 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c84150-3642-4608-bf4f-18cacb2893ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:16.395231 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c84150-3642-4608-bf4f-18cacb2893ab admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:16.420443 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1343/2687] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 05:00:16 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:00:16.422096 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2beb527-9a49-419f-b9eb-979f4968d29c admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:16.427711 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:16.434618 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2beb527-9a49-419f-b9eb-979f4968d29c admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:16.440622 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc0d03-9baa-471c-b216-d120d71f1fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:16.441228 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc0d03-9baa-471c-b216-d120d71f1fbc admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:16.441556 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc0d03-9baa-471c-b216-d120d71f1fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:16.441831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc0d03-9baa-471c-b216-d120d71f1fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:16.442480 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc0d03-9baa-471c-b216-d120d71f1fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:16.444055 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc0d03-9baa-471c-b216-d120d71f1fbc admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:16.454139 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1345/2688] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:00:16.458770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c84150-3642-4608-bf4f-18cacb2893ab admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:16.470754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c84150-3642-4608-bf4f-18cacb2893ab admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:16.475463 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22658638-5e08-4dc7-ae23-0cf95297081f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:16.476069 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22658638-5e08-4dc7-ae23-0cf95297081f admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:16.476346 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22658638-5e08-4dc7-ae23-0cf95297081f admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:16.476615 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22658638-5e08-4dc7-ae23-0cf95297081f admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:16.477251 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22658638-5e08-4dc7-ae23-0cf95297081f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:16.478868 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22658638-5e08-4dc7-ae23-0cf95297081f admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:16.490218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1344/2689] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:00:16.494438 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc0d03-9baa-471c-b216-d120d71f1fbc admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:16.504715 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc0d03-9baa-471c-b216-d120d71f1fbc admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:16.510101 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d6fdc-eeb2-4edb-a6f4-3766b6d1c386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:16.510698 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d6fdc-eeb2-4edb-a6f4-3766b6d1c386 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:16.510981 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d6fdc-eeb2-4edb-a6f4-3766b6d1c386 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:16.511254 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d6fdc-eeb2-4edb-a6f4-3766b6d1c386 admin admin] PATH_INFO: `/v3/projects/e649964d263f4d85994f7b676247c9bb/users/7bec091756cd47d3981415a8a6105f1f/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:16.527605 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d6fdc-eeb2-4edb-a6f4-3766b6d1c386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e649964d263f4d85994f7b676247c9bb, user_id=7bec091756cd47d3981415a8a6105f1f, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:16.531031 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d6fdc-eeb2-4edb-a6f4-3766b6d1c386 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:16.546983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1346/2690] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:00:16 2022] PUT /identity/v3/projects/e649964d263f4d85994f7b676247c9bb/users/7bec091756cd47d3981415a8a6105f1f/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:16.558401 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bf701-7671-4497-80b0-b3a4423db1c0 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:16.558683 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bf701-7671-4497-80b0-b3a4423db1c0 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:16.558956 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bf701-7671-4497-80b0-b3a4423db1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:16.587857 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-bd9bf701-7671-4497-80b0-b3a4423db1c0 None None] MFA Rules not processed for user `7bec091756cd47d3981415a8a6105f1f`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:16.589444 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-bd9bf701-7671-4497-80b0-b3a4423db1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:16.663748 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1345/2691] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:16.675970 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d6fdc-eeb2-4edb-a6f4-3766b6d1c386 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:16.677747 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-dc7d6fdc-eeb2-4edb-a6f4-3766b6d1c386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:16.746187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d6fdc-eeb2-4edb-a6f4-3766b6d1c386 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:16.750139 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9495f22-ee9b-4599-b967-2221c05e7f01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:16.750744 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9495f22-ee9b-4599-b967-2221c05e7f01 service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:16.751023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9495f22-ee9b-4599-b967-2221c05e7f01 service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:16.751295 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9495f22-ee9b-4599-b967-2221c05e7f01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:16.762758 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9495f22-ee9b-4599-b967-2221c05e7f01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:16.764956 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9495f22-ee9b-4599-b967-2221c05e7f01 service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:16.774492 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1347/2692] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:16.794287 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bf701-7671-4497-80b0-b3a4423db1c0 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:16.820317 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:16.839047 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb91ae-858f-43cd-ae4a-1b7f9d976b17 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:16.839355 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb91ae-858f-43cd-ae4a-1b7f9d976b17 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:16.839632 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb91ae-858f-43cd-ae4a-1b7f9d976b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:16.859864 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-94eb91ae-858f-43cd-ae4a-1b7f9d976b17 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:16.861087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-94eb91ae-858f-43cd-ae4a-1b7f9d976b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:16.861368 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bf701-7671-4497-80b0-b3a4423db1c0 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:16.866138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102066c0-02c2-418d-8a9e-fdf91ff15d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:16.866770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102066c0-02c2-418d-8a9e-fdf91ff15d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:16.867042 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102066c0-02c2-418d-8a9e-fdf91ff15d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:16.867319 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102066c0-02c2-418d-8a9e-fdf91ff15d7d admin admin] PATH_INFO: `/v3/users/7bec091756cd47d3981415a8a6105f1f` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:16.868469 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102066c0-02c2-418d-8a9e-fdf91ff15d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bec091756cd47d3981415a8a6105f1f)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:16.869706 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1348/2693] 10.222.0.84 () {58 vars in 1016 bytes} [Wed Aug 24 05:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:00:16.870636 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102066c0-02c2-418d-8a9e-fdf91ff15d7d admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:16.910298 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb91ae-858f-43cd-ae4a-1b7f9d976b17 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:16.911772 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-94eb91ae-858f-43cd-ae4a-1b7f9d976b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:16.920713 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-102066c0-02c2-418d-8a9e-fdf91ff15d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bec091756cd47d3981415a8a6105f1f'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:16.921429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-102066c0-02c2-418d-8a9e-fdf91ff15d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bec091756cd47d3981415a8a6105f1f'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:16.929517 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-102066c0-02c2-418d-8a9e-fdf91ff15d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bec091756cd47d3981415a8a6105f1f'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:16.945493 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-102066c0-02c2-418d-8a9e-fdf91ff15d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bec091756cd47d3981415a8a6105f1f'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:16.952805 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-102066c0-02c2-418d-8a9e-fdf91ff15d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bec091756cd47d3981415a8a6105f1f'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:16.958870 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1346/2694] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 05:00:16 2022] DELETE /identity/v3/users/7bec091756cd47d3981415a8a6105f1f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:16.963692 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b741f-bb17-4b39-ba8f-925ddefcd41d None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:16.964172 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b741f-bb17-4b39-ba8f-925ddefcd41d None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:16.964452 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b741f-bb17-4b39-ba8f-925ddefcd41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:16.984640 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-ab5b741f-bb17-4b39-ba8f-925ddefcd41d None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:16.985902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-ab5b741f-bb17-4b39-ba8f-925ddefcd41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:16.993889 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb91ae-858f-43cd-ae4a-1b7f9d976b17 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:17.052840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1347/2695] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:00:17.056718 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:17.064435 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b741f-bb17-4b39-ba8f-925ddefcd41d None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:17.065949 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-ab5b741f-bb17-4b39-ba8f-925ddefcd41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:17.069937 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067561a-205b-4013-a31d-1e5355d25db4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:17.070555 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067561a-205b-4013-a31d-1e5355d25db4 service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:17.071339 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067561a-205b-4013-a31d-1e5355d25db4 service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:17.071620 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067561a-205b-4013-a31d-1e5355d25db4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:17.073397 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-8067561a-205b-4013-a31d-1e5355d25db4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:17.086127 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067561a-205b-4013-a31d-1e5355d25db4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:17.087717 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067561a-205b-4013-a31d-1e5355d25db4 service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:17.099494 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1349/2696] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:00:17.120492 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:17.135869 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b741f-bb17-4b39-ba8f-925ddefcd41d None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:17.140677 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f98046-255f-4e67-a131-4c493127343d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:17.141343 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f98046-255f-4e67-a131-4c493127343d service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:17.141649 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f98046-255f-4e67-a131-4c493127343d service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:17.141916 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f98046-255f-4e67-a131-4c493127343d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:17.151240 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f98046-255f-4e67-a131-4c493127343d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:17.152665 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f98046-255f-4e67-a131-4c493127343d service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:17.163511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1348/2697] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:00:17.443823 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067561a-205b-4013-a31d-1e5355d25db4 service nova] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:17.445286 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-8067561a-205b-4013-a31d-1e5355d25db4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:17.458170 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067561a-205b-4013-a31d-1e5355d25db4 service nova] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:17.463084 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783f0da-effa-4c55-b75a-4a0604d96fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:17.463810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783f0da-effa-4c55-b75a-4a0604d96fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:17.464158 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783f0da-effa-4c55-b75a-4a0604d96fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:17.464500 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783f0da-effa-4c55-b75a-4a0604d96fdb admin admin] PATH_INFO: `/v3/projects/e649964d263f4d85994f7b676247c9bb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:17.465823 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783f0da-effa-4c55-b75a-4a0604d96fdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e649964d263f4d85994f7b676247c9bb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:17.467859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783f0da-effa-4c55-b75a-4a0604d96fdb admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:17.516688 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-f783f0da-effa-4c55-b75a-4a0604d96fdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e649964d263f4d85994f7b676247c9bb', 'request_id': 'req-f783f0da-effa-4c55-b75a-4a0604d96fdb'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:17.523148 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-f783f0da-effa-4c55-b75a-4a0604d96fdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e649964d263f4d85994f7b676247c9bb', 'request_id': 'req-f783f0da-effa-4c55-b75a-4a0604d96fdb'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:17.531677 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-f783f0da-effa-4c55-b75a-4a0604d96fdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e649964d263f4d85994f7b676247c9bb', 'request_id': 'req-f783f0da-effa-4c55-b75a-4a0604d96fdb'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:17.542849 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-f783f0da-effa-4c55-b75a-4a0604d96fdb admin admin] The token cache is being invalidate because project e649964d263f4d85994f7b676247c9bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:00:17.543141 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-f783f0da-effa-4c55-b75a-4a0604d96fdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:17.543811 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-f783f0da-effa-4c55-b75a-4a0604d96fdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:17.546082 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1350/2698] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 05:00:17 2022] DELETE /identity/v3/projects/e649964d263f4d85994f7b676247c9bb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:17.551060 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd7610-75d9-4b77-8562-591d3f8695f1 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:17.551564 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd7610-75d9-4b77-8562-591d3f8695f1 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:17.551679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd7610-75d9-4b77-8562-591d3f8695f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:17.571570 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-44fd7610-75d9-4b77-8562-591d3f8695f1 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:17.572711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-44fd7610-75d9-4b77-8562-591d3f8695f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:17.633568 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1349/2699] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:17.643213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cbfda-1bd4-415f-8199-a6d027a2f137 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:17.643505 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cbfda-1bd4-415f-8199-a6d027a2f137 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:17.643878 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cbfda-1bd4-415f-8199-a6d027a2f137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:17.665146 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-247cbfda-1bd4-415f-8199-a6d027a2f137 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:17.666459 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-247cbfda-1bd4-415f-8199-a6d027a2f137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:17.675394 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1351/2700] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:00:17.679698 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd7610-75d9-4b77-8562-591d3f8695f1 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:17.690218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd7610-75d9-4b77-8562-591d3f8695f1 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:17.694898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4deba-f3f3-44bb-b7de-b4428170210e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:17.695495 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4deba-f3f3-44bb-b7de-b4428170210e admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:17.695770 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4deba-f3f3-44bb-b7de-b4428170210e admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:17.696039 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4deba-f3f3-44bb-b7de-b4428170210e admin admin] PATH_INFO: `/v3/domains` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:17.696684 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4deba-f3f3-44bb-b7de-b4428170210e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:00:17.696984 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4deba-f3f3-44bb-b7de-b4428170210e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:17.698582 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4deba-f3f3-44bb-b7de-b4428170210e admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:17.710142 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1350/2701] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 05:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:00:17.715044 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cbfda-1bd4-415f-8199-a6d027a2f137 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:17.726643 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cbfda-1bd4-415f-8199-a6d027a2f137 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:17.732174 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ee797-4a1f-4c01-b279-063989f887cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:17.733526 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ee797-4a1f-4c01-b279-063989f887cb admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:17.733843 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ee797-4a1f-4c01-b279-063989f887cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:17.734108 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ee797-4a1f-4c01-b279-063989f887cb admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:17.734974 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ee797-4a1f-4c01-b279-063989f887cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:17.736621 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ee797-4a1f-4c01-b279-063989f887cb admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:17.766025 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1352/2702] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 05:00:17 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:00:17.770183 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4deba-f3f3-44bb-b7de-b4428170210e admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:17.780975 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4deba-f3f3-44bb-b7de-b4428170210e admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:17.836657 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33ee7b-68e5-42a2-8fe3-3c920cc1fa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:17.837176 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33ee7b-68e5-42a2-8fe3-3c920cc1fa45 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:17.837484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33ee7b-68e5-42a2-8fe3-3c920cc1fa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:17.837759 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33ee7b-68e5-42a2-8fe3-3c920cc1fa45 admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:17.838390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33ee7b-68e5-42a2-8fe3-3c920cc1fa45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:17.840282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33ee7b-68e5-42a2-8fe3-3c920cc1fa45 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:17.862481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1351/2703] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 05:00:17 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:00:17.866586 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ee797-4a1f-4c01-b279-063989f887cb admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:17.877371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ee797-4a1f-4c01-b279-063989f887cb admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:17.882218 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6d220-8b6b-4982-9173-81828a001460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:17.882836 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6d220-8b6b-4982-9173-81828a001460 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:17.883113 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6d220-8b6b-4982-9173-81828a001460 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:17.883384 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6d220-8b6b-4982-9173-81828a001460 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:17.884014 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6d220-8b6b-4982-9173-81828a001460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:17.885608 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6d220-8b6b-4982-9173-81828a001460 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:17.895673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1353/2704] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:00:17.899808 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33ee7b-68e5-42a2-8fe3-3c920cc1fa45 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:17.910783 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33ee7b-68e5-42a2-8fe3-3c920cc1fa45 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:17.916052 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f13d3d-2ed6-4513-9841-f6bd34ddb120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:17.916734 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f13d3d-2ed6-4513-9841-f6bd34ddb120 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:17.917100 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f13d3d-2ed6-4513-9841-f6bd34ddb120 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:17.917626 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f13d3d-2ed6-4513-9841-f6bd34ddb120 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:17.918275 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f13d3d-2ed6-4513-9841-f6bd34ddb120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:17.920613 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f13d3d-2ed6-4513-9841-f6bd34ddb120 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:17.931693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1352/2705] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:00:17.936035 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6d220-8b6b-4982-9173-81828a001460 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:17.946387 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6d220-8b6b-4982-9173-81828a001460 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:17.950925 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9b98e-6bca-4d63-a442-1a82cc334780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:17.951832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9b98e-6bca-4d63-a442-1a82cc334780 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:17.952120 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9b98e-6bca-4d63-a442-1a82cc334780 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:17.952398 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9b98e-6bca-4d63-a442-1a82cc334780 admin admin] PATH_INFO: `/v3/projects/1c3bc4ec78174d28a0bf4a64351a97d4/users/a9c19e0f498d4702a7aa2be3dd573bbc/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:17.967491 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9b98e-6bca-4d63-a442-1a82cc334780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c3bc4ec78174d28a0bf4a64351a97d4, user_id=a9c19e0f498d4702a7aa2be3dd573bbc, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:17.970169 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9b98e-6bca-4d63-a442-1a82cc334780 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:17.984632 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1354/2706] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:00:17 2022] PUT /identity/v3/projects/1c3bc4ec78174d28a0bf4a64351a97d4/users/a9c19e0f498d4702a7aa2be3dd573bbc/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:17.995045 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fbf61-2b1c-4cc9-a22a-fca71be7952d None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:17.995336 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fbf61-2b1c-4cc9-a22a-fca71be7952d None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:17.995614 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fbf61-2b1c-4cc9-a22a-fca71be7952d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:18.024399 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-577fbf61-2b1c-4cc9-a22a-fca71be7952d None None] MFA Rules not processed for user `a9c19e0f498d4702a7aa2be3dd573bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:18.025699 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-577fbf61-2b1c-4cc9-a22a-fca71be7952d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:18.066913 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:18.092904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1353/2707] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:18.097557 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9b98e-6bca-4d63-a442-1a82cc334780 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:18.159872 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9b98e-6bca-4d63-a442-1a82cc334780 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:18.164656 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaae0e6-32cc-4b20-b715-ba74d29081b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:18.165256 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaae0e6-32cc-4b20-b715-ba74d29081b6 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:18.165570 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaae0e6-32cc-4b20-b715-ba74d29081b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:18.165844 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaae0e6-32cc-4b20-b715-ba74d29081b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:18.166466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaae0e6-32cc-4b20-b715-ba74d29081b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:18.168355 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaae0e6-32cc-4b20-b715-ba74d29081b6 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:18.180246 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:18.197645 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1355/2708] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 05:00:18 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:00:18.201715 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577fbf61-2b1c-4cc9-a22a-fca71be7952d None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:18.212239 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577fbf61-2b1c-4cc9-a22a-fca71be7952d None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:18.268324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813b996-a697-432f-a791-f671066e1cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:18.268926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813b996-a697-432f-a791-f671066e1cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:18.269200 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813b996-a697-432f-a791-f671066e1cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:18.269497 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813b996-a697-432f-a791-f671066e1cc5 admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:18.270113 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813b996-a697-432f-a791-f671066e1cc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:18.271995 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813b996-a697-432f-a791-f671066e1cc5 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:18.293275 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1354/2709] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 05:00:18 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:00:18.297999 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaae0e6-32cc-4b20-b715-ba74d29081b6 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:18.308282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaae0e6-32cc-4b20-b715-ba74d29081b6 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:18.313498 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99d9c2-e208-45f6-8f31-1b41afe02fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:18.314094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99d9c2-e208-45f6-8f31-1b41afe02fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:18.314374 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99d9c2-e208-45f6-8f31-1b41afe02fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:18.314646 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99d9c2-e208-45f6-8f31-1b41afe02fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:18.315620 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99d9c2-e208-45f6-8f31-1b41afe02fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:18.317194 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99d9c2-e208-45f6-8f31-1b41afe02fa3 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:18.327823 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1356/2710] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:00:18.331775 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813b996-a697-432f-a791-f671066e1cc5 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:18.341776 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813b996-a697-432f-a791-f671066e1cc5 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:18.346470 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77297a-c649-462a-965a-ed16461dbcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:18.346993 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77297a-c649-462a-965a-ed16461dbcc3 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:18.347268 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77297a-c649-462a-965a-ed16461dbcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:18.347539 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77297a-c649-462a-965a-ed16461dbcc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:18.348174 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77297a-c649-462a-965a-ed16461dbcc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:18.349784 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77297a-c649-462a-965a-ed16461dbcc3 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:18.361968 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1355/2711] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:00:18.366065 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99d9c2-e208-45f6-8f31-1b41afe02fa3 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:18.377032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99d9c2-e208-45f6-8f31-1b41afe02fa3 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:18.381920 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e7e31-0768-4cc5-877a-866c2b01089e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:18.382608 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e7e31-0768-4cc5-877a-866c2b01089e admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:18.382892 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e7e31-0768-4cc5-877a-866c2b01089e admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:18.383170 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e7e31-0768-4cc5-877a-866c2b01089e admin admin] PATH_INFO: `/v3/projects/de8e32211d5b49fd8b3b0a4322e1ab81/users/d2da972f3b1e4545a6411c4fea63b18a/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:18.397847 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e7e31-0768-4cc5-877a-866c2b01089e admin admin] RBAC: Authorizing `identity:create_grant(project_id=de8e32211d5b49fd8b3b0a4322e1ab81, user_id=d2da972f3b1e4545a6411c4fea63b18a, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:18.400538 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e7e31-0768-4cc5-877a-866c2b01089e admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:18.413977 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1357/2712] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:00:18 2022] PUT /identity/v3/projects/de8e32211d5b49fd8b3b0a4322e1ab81/users/d2da972f3b1e4545a6411c4fea63b18a/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:18.480203 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548631f3-b065-4cd9-b7f8-5e869850d769 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:18.480483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548631f3-b065-4cd9-b7f8-5e869850d769 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:18.480895 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548631f3-b065-4cd9-b7f8-5e869850d769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:18.510759 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-548631f3-b065-4cd9-b7f8-5e869850d769 None None] MFA Rules not processed for user `d2da972f3b1e4545a6411c4fea63b18a`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:18.511989 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-548631f3-b065-4cd9-b7f8-5e869850d769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:18.583734 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1356/2713] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:18.588213 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e7e31-0768-4cc5-877a-866c2b01089e admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:18.651897 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e7e31-0768-4cc5-877a-866c2b01089e admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:18.656613 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb647a-2e9d-4882-a2c8-a193c41017ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:18.657217 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb647a-2e9d-4882-a2c8-a193c41017ec admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:18.657534 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb647a-2e9d-4882-a2c8-a193c41017ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:18.657810 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb647a-2e9d-4882-a2c8-a193c41017ec admin admin] PATH_INFO: `/v3/projects` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:18.658442 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb647a-2e9d-4882-a2c8-a193c41017ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:18.660327 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb647a-2e9d-4882-a2c8-a193c41017ec admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:18.688479 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1358/2714] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 05:00:18 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:00:18.692548 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548631f3-b065-4cd9-b7f8-5e869850d769 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:18.704662 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548631f3-b065-4cd9-b7f8-5e869850d769 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:18.750133 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:18.775995 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e9645-2893-4f70-acf8-e125fc04e794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:18.776881 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e9645-2893-4f70-acf8-e125fc04e794 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:18.777095 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e9645-2893-4f70-acf8-e125fc04e794 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:18.777457 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e9645-2893-4f70-acf8-e125fc04e794 admin admin] PATH_INFO: `/v3/users` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:18.778241 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e9645-2893-4f70-acf8-e125fc04e794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:18.781479 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e9645-2893-4f70-acf8-e125fc04e794 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:18.807102 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1357/2715] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 05:00:18 2022] POST /identity/v3/users => generated 295 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:00:18.811514 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb647a-2e9d-4882-a2c8-a193c41017ec admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:18.823907 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb647a-2e9d-4882-a2c8-a193c41017ec admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:18.830421 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec7026-91ff-4b4a-93c1-62b5e487cf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:18.831301 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec7026-91ff-4b4a-93c1-62b5e487cf2d admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:18.831748 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec7026-91ff-4b4a-93c1-62b5e487cf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:18.832054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec7026-91ff-4b4a-93c1-62b5e487cf2d admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:18.832704 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec7026-91ff-4b4a-93c1-62b5e487cf2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:18.834330 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec7026-91ff-4b4a-93c1-62b5e487cf2d admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:18.846189 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1359/2716] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:00:18.850378 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e9645-2893-4f70-acf8-e125fc04e794 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:18.860512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e9645-2893-4f70-acf8-e125fc04e794 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:18.865194 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b15b0-17b9-4ea4-ac18-72dd1e20f32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:18.865878 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b15b0-17b9-4ea4-ac18-72dd1e20f32f admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:18.866160 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b15b0-17b9-4ea4-ac18-72dd1e20f32f admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:18.866438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b15b0-17b9-4ea4-ac18-72dd1e20f32f admin admin] PATH_INFO: `/v3/projects/df74dd80c9c94eb99cb25b202e9a250d/users/c1848cc58f8a42e09013dd4901053f8e/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:18.881573 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b15b0-17b9-4ea4-ac18-72dd1e20f32f admin admin] RBAC: Authorizing `identity:create_grant(project_id=df74dd80c9c94eb99cb25b202e9a250d, user_id=c1848cc58f8a42e09013dd4901053f8e, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:18.884205 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b15b0-17b9-4ea4-ac18-72dd1e20f32f admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:18.900644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1358/2717] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:00:18 2022] PUT /identity/v3/projects/df74dd80c9c94eb99cb25b202e9a250d/users/c1848cc58f8a42e09013dd4901053f8e/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:18.904719 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec7026-91ff-4b4a-93c1-62b5e487cf2d admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:18.915126 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec7026-91ff-4b4a-93c1-62b5e487cf2d admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:18.973427 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54ed21-fe3e-4523-b456-1fc7fc2c6642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:18.974184 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54ed21-fe3e-4523-b456-1fc7fc2c6642 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:18.974884 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54ed21-fe3e-4523-b456-1fc7fc2c6642 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:18.974884 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54ed21-fe3e-4523-b456-1fc7fc2c6642 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:18.975528 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54ed21-fe3e-4523-b456-1fc7fc2c6642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:18.977137 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54ed21-fe3e-4523-b456-1fc7fc2c6642 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:18.988085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1360/2718] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:00:18.992285 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b15b0-17b9-4ea4-ac18-72dd1e20f32f admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:19.003198 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b15b0-17b9-4ea4-ac18-72dd1e20f32f admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:19.008811 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d498fb2-3deb-4de1-a56e-0fae6e3d45c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:19.009323 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d498fb2-3deb-4de1-a56e-0fae6e3d45c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:19.009699 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d498fb2-3deb-4de1-a56e-0fae6e3d45c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:19.009891 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d498fb2-3deb-4de1-a56e-0fae6e3d45c3 admin admin] PATH_INFO: `/v3/projects/df74dd80c9c94eb99cb25b202e9a250d/users/c1848cc58f8a42e09013dd4901053f8e/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:19.011856 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d498fb2-3deb-4de1-a56e-0fae6e3d45c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df74dd80c9c94eb99cb25b202e9a250d, user_id=c1848cc58f8a42e09013dd4901053f8e, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:19.015073 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d498fb2-3deb-4de1-a56e-0fae6e3d45c3 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:19.026524 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1359/2719] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:00:18 2022] PUT /identity/v3/projects/df74dd80c9c94eb99cb25b202e9a250d/users/c1848cc58f8a42e09013dd4901053f8e/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:19.038053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555c86a-2c77-4586-9e59-f2a75df17781 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:19.038441 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555c86a-2c77-4586-9e59-f2a75df17781 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:19.038727 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555c86a-2c77-4586-9e59-f2a75df17781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:19.066186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-6555c86a-2c77-4586-9e59-f2a75df17781 None None] MFA Rules not processed for user `c1848cc58f8a42e09013dd4901053f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:19.067389 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-6555c86a-2c77-4586-9e59-f2a75df17781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:19.080435 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:19.140207 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1361/2720] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:19.151350 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d498fb2-3deb-4de1-a56e-0fae6e3d45c3 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:19.153026 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-1d498fb2-3deb-4de1-a56e-0fae6e3d45c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:19.213233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d498fb2-3deb-4de1-a56e-0fae6e3d45c3 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:19.216821 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fc82d-f432-44f4-ad64-5d9b4d37d175 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:19.217460 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fc82d-f432-44f4-ad64-5d9b4d37d175 service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:19.217741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fc82d-f432-44f4-ad64-5d9b4d37d175 service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:19.218012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fc82d-f432-44f4-ad64-5d9b4d37d175 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:19.280873 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fc82d-f432-44f4-ad64-5d9b4d37d175 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:19.282322 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fc82d-f432-44f4-ad64-5d9b4d37d175 service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:19.292234 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1360/2721] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:20.807475 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555c86a-2c77-4586-9e59-f2a75df17781 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:20.817236 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555c86a-2c77-4586-9e59-f2a75df17781 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:20.820888 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff99eb6-89f6-41cc-8c85-8957bdfd88f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:20.821527 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff99eb6-89f6-41cc-8c85-8957bdfd88f6 service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:20.821908 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff99eb6-89f6-41cc-8c85-8957bdfd88f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:20.822067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff99eb6-89f6-41cc-8c85-8957bdfd88f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:20.882102 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff99eb6-89f6-41cc-8c85-8957bdfd88f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:20.883538 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff99eb6-89f6-41cc-8c85-8957bdfd88f6 service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:20.893268 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1362/2722] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:21.160698 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba28cdc-178e-4310-9c4f-87e680538940 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:21.161180 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba28cdc-178e-4310-9c4f-87e680538940 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:21.161300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba28cdc-178e-4310-9c4f-87e680538940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:21.180717 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-5ba28cdc-178e-4310-9c4f-87e680538940 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:21.181949 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-5ba28cdc-178e-4310-9c4f-87e680538940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:21.233922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:21.247894 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1361/2723] 10.222.0.84 () {58 vars in 1016 bytes} [Wed Aug 24 05:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:21.270187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff99eb6-89f6-41cc-8c85-8957bdfd88f6 service cinder] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:21.271853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-dff99eb6-89f6-41cc-8c85-8957bdfd88f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:21.353093 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff99eb6-89f6-41cc-8c85-8957bdfd88f6 service cinder] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:21.359474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa1174-9db2-4093-946a-7900740092fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:21.360087 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa1174-9db2-4093-946a-7900740092fc service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:21.360369 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa1174-9db2-4093-946a-7900740092fc service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:21.360642 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa1174-9db2-4093-946a-7900740092fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:21.372018 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa1174-9db2-4093-946a-7900740092fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:21.374356 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa1174-9db2-4093-946a-7900740092fc service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:21.384503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1363/2724] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:21.452998 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba28cdc-178e-4310-9c4f-87e680538940 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:21.463226 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba28cdc-178e-4310-9c4f-87e680538940 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:21.466813 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef60cec-55c1-4747-bf26-403cb9bc5b49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:21.467940 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef60cec-55c1-4747-bf26-403cb9bc5b49 service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:21.468220 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef60cec-55c1-4747-bf26-403cb9bc5b49 service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:21.468486 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef60cec-55c1-4747-bf26-403cb9bc5b49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:21.478373 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef60cec-55c1-4747-bf26-403cb9bc5b49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:21.479803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef60cec-55c1-4747-bf26-403cb9bc5b49 service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:21.490315 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1362/2725] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:25.270075 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e169895-f7d9-4ed7-a301-381115542051 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:25.270590 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e169895-f7d9-4ed7-a301-381115542051 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:25.270705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e169895-f7d9-4ed7-a301-381115542051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:25.290926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-4e169895-f7d9-4ed7-a301-381115542051 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:25.292150 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-4e169895-f7d9-4ed7-a301-381115542051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:25.300898 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1364/2726] 10.222.0.84 () {58 vars in 1016 bytes} [Wed Aug 24 05:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:25.322262 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef60cec-55c1-4747-bf26-403cb9bc5b49 service cinder] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:25.323695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-9ef60cec-55c1-4747-bf26-403cb9bc5b49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:25.340176 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef60cec-55c1-4747-bf26-403cb9bc5b49 service cinder] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:25.345914 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b848ce7-4ce0-4f03-9f59-011374f01265 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:25.346508 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b848ce7-4ce0-4f03-9f59-011374f01265 service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:25.346789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b848ce7-4ce0-4f03-9f59-011374f01265 service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:25.347066 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b848ce7-4ce0-4f03-9f59-011374f01265 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:25.355762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b848ce7-4ce0-4f03-9f59-011374f01265 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:25.357349 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b848ce7-4ce0-4f03-9f59-011374f01265 service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:25.363837 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e169895-f7d9-4ed7-a301-381115542051 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:25.368100 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1363/2727] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:25.374884 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e169895-f7d9-4ed7-a301-381115542051 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:25.379748 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18f9bd-d0d3-4efe-b177-a8e621fb7f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:25.380395 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18f9bd-d0d3-4efe-b177-a8e621fb7f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:25.380930 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18f9bd-d0d3-4efe-b177-a8e621fb7f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:25.381209 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18f9bd-d0d3-4efe-b177-a8e621fb7f27 admin admin] PATH_INFO: `/v3/users/a9c19e0f498d4702a7aa2be3dd573bbc` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:25.382526 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18f9bd-d0d3-4efe-b177-a8e621fb7f27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9c19e0f498d4702a7aa2be3dd573bbc)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:25.384435 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18f9bd-d0d3-4efe-b177-a8e621fb7f27 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:25.409053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:25.433536 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-af18f9bd-d0d3-4efe-b177-a8e621fb7f27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9c19e0f498d4702a7aa2be3dd573bbc'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:25.442092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-af18f9bd-d0d3-4efe-b177-a8e621fb7f27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9c19e0f498d4702a7aa2be3dd573bbc'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:25.449805 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-af18f9bd-d0d3-4efe-b177-a8e621fb7f27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9c19e0f498d4702a7aa2be3dd573bbc'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:25.450511 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-af18f9bd-d0d3-4efe-b177-a8e621fb7f27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9c19e0f498d4702a7aa2be3dd573bbc'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:25.465794 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-af18f9bd-d0d3-4efe-b177-a8e621fb7f27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9c19e0f498d4702a7aa2be3dd573bbc'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:25.473266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1365/2728] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 05:00:25 2022] DELETE /identity/v3/users/a9c19e0f498d4702a7aa2be3dd573bbc => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:00:25.477864 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd24cc1-59a9-4f19-bcf2-4c946d08d95d None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:25.478158 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd24cc1-59a9-4f19-bcf2-4c946d08d95d None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:25.478444 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd24cc1-59a9-4f19-bcf2-4c946d08d95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:25.499402 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-0dd24cc1-59a9-4f19-bcf2-4c946d08d95d None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:25.501374 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-0dd24cc1-59a9-4f19-bcf2-4c946d08d95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:25.561315 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1364/2729] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:25.571555 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18f9bd-d0d3-4efe-b177-a8e621fb7f27 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:25.572949 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-af18f9bd-d0d3-4efe-b177-a8e621fb7f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:25.630286 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18f9bd-d0d3-4efe-b177-a8e621fb7f27 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:25.634094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a83196-c24d-405f-83ad-a3ecf24f838f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:25.634697 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a83196-c24d-405f-83ad-a3ecf24f838f service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:25.634973 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a83196-c24d-405f-83ad-a3ecf24f838f service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:25.635239 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a83196-c24d-405f-83ad-a3ecf24f838f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:25.645473 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a83196-c24d-405f-83ad-a3ecf24f838f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:25.646884 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a83196-c24d-405f-83ad-a3ecf24f838f service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:25.658158 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1366/2730] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:25.933595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd24cc1-59a9-4f19-bcf2-4c946d08d95d None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:25.935016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-0dd24cc1-59a9-4f19-bcf2-4c946d08d95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:25.947776 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd24cc1-59a9-4f19-bcf2-4c946d08d95d None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:25.952381 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933fb7d-59de-4887-b9a7-4a134429e16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:25.953296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933fb7d-59de-4887-b9a7-4a134429e16f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:25.953706 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933fb7d-59de-4887-b9a7-4a134429e16f admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:25.953984 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933fb7d-59de-4887-b9a7-4a134429e16f admin admin] PATH_INFO: `/v3/projects/1c3bc4ec78174d28a0bf4a64351a97d4` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:25.955126 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933fb7d-59de-4887-b9a7-4a134429e16f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c3bc4ec78174d28a0bf4a64351a97d4)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:25.957009 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933fb7d-59de-4887-b9a7-4a134429e16f admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:26.004827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a933fb7d-59de-4887-b9a7-4a134429e16f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c3bc4ec78174d28a0bf4a64351a97d4', 'request_id': 'req-a933fb7d-59de-4887-b9a7-4a134429e16f'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:26.010544 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a933fb7d-59de-4887-b9a7-4a134429e16f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c3bc4ec78174d28a0bf4a64351a97d4', 'request_id': 'req-a933fb7d-59de-4887-b9a7-4a134429e16f'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:26.018370 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a933fb7d-59de-4887-b9a7-4a134429e16f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c3bc4ec78174d28a0bf4a64351a97d4', 'request_id': 'req-a933fb7d-59de-4887-b9a7-4a134429e16f'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:26.030002 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a933fb7d-59de-4887-b9a7-4a134429e16f admin admin] The token cache is being invalidate because project 1c3bc4ec78174d28a0bf4a64351a97d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:00:26.030289 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a933fb7d-59de-4887-b9a7-4a134429e16f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:26.031433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a933fb7d-59de-4887-b9a7-4a134429e16f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:26.032925 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1365/2731] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 05:00:25 2022] DELETE /identity/v3/projects/1c3bc4ec78174d28a0bf4a64351a97d4 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:26.037655 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a83196-c24d-405f-83ad-a3ecf24f838f service neutron] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:26.048212 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a83196-c24d-405f-83ad-a3ecf24f838f service neutron] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:26.103254 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d71648-87c7-4ab0-8bfd-eaf07017c901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:26.103884 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d71648-87c7-4ab0-8bfd-eaf07017c901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:26.104160 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d71648-87c7-4ab0-8bfd-eaf07017c901 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:26.104432 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d71648-87c7-4ab0-8bfd-eaf07017c901 admin admin] PATH_INFO: `/v3/users/d2da972f3b1e4545a6411c4fea63b18a` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:26.105579 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d71648-87c7-4ab0-8bfd-eaf07017c901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2da972f3b1e4545a6411c4fea63b18a)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:26.107472 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d71648-87c7-4ab0-8bfd-eaf07017c901 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:26.152170 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:26.153868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-39d71648-87c7-4ab0-8bfd-eaf07017c901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2da972f3b1e4545a6411c4fea63b18a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:26.162022 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-39d71648-87c7-4ab0-8bfd-eaf07017c901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2da972f3b1e4545a6411c4fea63b18a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:26.169480 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-39d71648-87c7-4ab0-8bfd-eaf07017c901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2da972f3b1e4545a6411c4fea63b18a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:26.170140 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-39d71648-87c7-4ab0-8bfd-eaf07017c901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2da972f3b1e4545a6411c4fea63b18a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:26.182778 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-39d71648-87c7-4ab0-8bfd-eaf07017c901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2da972f3b1e4545a6411c4fea63b18a'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:26.188840 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1367/2732] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 05:00:26 2022] DELETE /identity/v3/users/d2da972f3b1e4545a6411c4fea63b18a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:26.467728 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933fb7d-59de-4887-b9a7-4a134429e16f admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:26.469937 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-a933fb7d-59de-4887-b9a7-4a134429e16f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:26.486346 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933fb7d-59de-4887-b9a7-4a134429e16f admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:26.538087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:26.549429 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29659112-2963-4599-93cb-447e72e7c644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:26.550092 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29659112-2963-4599-93cb-447e72e7c644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:26.550369 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29659112-2963-4599-93cb-447e72e7c644 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:26.550646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29659112-2963-4599-93cb-447e72e7c644 admin admin] PATH_INFO: `/v3/projects/de8e32211d5b49fd8b3b0a4322e1ab81` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:26.551798 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29659112-2963-4599-93cb-447e72e7c644 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de8e32211d5b49fd8b3b0a4322e1ab81)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:26.553777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29659112-2963-4599-93cb-447e72e7c644 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:26.602091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-29659112-2963-4599-93cb-447e72e7c644 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de8e32211d5b49fd8b3b0a4322e1ab81', 'request_id': 'req-29659112-2963-4599-93cb-447e72e7c644'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:26.607605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-29659112-2963-4599-93cb-447e72e7c644 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de8e32211d5b49fd8b3b0a4322e1ab81', 'request_id': 'req-29659112-2963-4599-93cb-447e72e7c644'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:26.615393 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-29659112-2963-4599-93cb-447e72e7c644 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de8e32211d5b49fd8b3b0a4322e1ab81', 'request_id': 'req-29659112-2963-4599-93cb-447e72e7c644'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:26.627487 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-29659112-2963-4599-93cb-447e72e7c644 admin admin] The token cache is being invalidate because project de8e32211d5b49fd8b3b0a4322e1ab81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:00:26.627778 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-29659112-2963-4599-93cb-447e72e7c644 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:26.628446 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-29659112-2963-4599-93cb-447e72e7c644 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:26.629972 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1366/2733] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 05:00:26 2022] DELETE /identity/v3/projects/de8e32211d5b49fd8b3b0a4322e1ab81 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:26.634265 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d71648-87c7-4ab0-8bfd-eaf07017c901 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:26.635695 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-39d71648-87c7-4ab0-8bfd-eaf07017c901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:26.650178 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d71648-87c7-4ab0-8bfd-eaf07017c901 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:26.710078 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be333a-fd40-45c1-ad83-e3eac62bdbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:26.710780 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be333a-fd40-45c1-ad83-e3eac62bdbe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:26.710994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be333a-fd40-45c1-ad83-e3eac62bdbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:26.711270 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be333a-fd40-45c1-ad83-e3eac62bdbe0 admin admin] PATH_INFO: `/v3/users/c1848cc58f8a42e09013dd4901053f8e` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:26.712446 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be333a-fd40-45c1-ad83-e3eac62bdbe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1848cc58f8a42e09013dd4901053f8e)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:26.714435 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be333a-fd40-45c1-ad83-e3eac62bdbe0 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:26.764174 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-89be333a-fd40-45c1-ad83-e3eac62bdbe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1848cc58f8a42e09013dd4901053f8e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:26.772326 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-89be333a-fd40-45c1-ad83-e3eac62bdbe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1848cc58f8a42e09013dd4901053f8e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:26.779289 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-89be333a-fd40-45c1-ad83-e3eac62bdbe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1848cc58f8a42e09013dd4901053f8e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:26.779913 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-89be333a-fd40-45c1-ad83-e3eac62bdbe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1848cc58f8a42e09013dd4901053f8e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:26.791938 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-89be333a-fd40-45c1-ad83-e3eac62bdbe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1848cc58f8a42e09013dd4901053f8e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:26.798014 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1368/2734] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 05:00:26 2022] DELETE /identity/v3/users/c1848cc58f8a42e09013dd4901053f8e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:00:27.084113 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29659112-2963-4599-93cb-447e72e7c644 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:27.085597 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-29659112-2963-4599-93cb-447e72e7c644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:27.099448 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29659112-2963-4599-93cb-447e72e7c644 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:27.165618 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cc80d-669f-499e-8f12-83018fca72cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:27.166250 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cc80d-669f-499e-8f12-83018fca72cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:27.166529 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cc80d-669f-499e-8f12-83018fca72cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:27.166801 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cc80d-669f-499e-8f12-83018fca72cf admin admin] PATH_INFO: `/v3/projects/df74dd80c9c94eb99cb25b202e9a250d` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:27.167950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4cc80d-669f-499e-8f12-83018fca72cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=df74dd80c9c94eb99cb25b202e9a250d)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:27.169915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4cc80d-669f-499e-8f12-83018fca72cf admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:27.218979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-ed4cc80d-669f-499e-8f12-83018fca72cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df74dd80c9c94eb99cb25b202e9a250d', 'request_id': 'req-ed4cc80d-669f-499e-8f12-83018fca72cf'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:27.224731 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-ed4cc80d-669f-499e-8f12-83018fca72cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df74dd80c9c94eb99cb25b202e9a250d', 'request_id': 'req-ed4cc80d-669f-499e-8f12-83018fca72cf'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:27.232040 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-ed4cc80d-669f-499e-8f12-83018fca72cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df74dd80c9c94eb99cb25b202e9a250d', 'request_id': 'req-ed4cc80d-669f-499e-8f12-83018fca72cf'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:27.244345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-ed4cc80d-669f-499e-8f12-83018fca72cf admin admin] The token cache is being invalidate because project df74dd80c9c94eb99cb25b202e9a250d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:00:27.244633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-ed4cc80d-669f-499e-8f12-83018fca72cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:27.245300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-ed4cc80d-669f-499e-8f12-83018fca72cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:27.246904 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1367/2735] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 05:00:27 2022] DELETE /identity/v3/projects/df74dd80c9c94eb99cb25b202e9a250d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:29.457778 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59045f4-6a87-43d1-905c-f1a3b65ec394 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:29.458294 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59045f4-6a87-43d1-905c-f1a3b65ec394 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:29.458402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59045f4-6a87-43d1-905c-f1a3b65ec394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:29.477938 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-c59045f4-6a87-43d1-905c-f1a3b65ec394 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:29.479179 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-c59045f4-6a87-43d1-905c-f1a3b65ec394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:29.518128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:29.545503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1369/2736] 10.222.0.84 () {58 vars in 1016 bytes} [Wed Aug 24 05:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:29.569548 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cc80d-669f-499e-8f12-83018fca72cf admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:29.571058 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-ed4cc80d-669f-499e-8f12-83018fca72cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:29.585903 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:29.650540 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cc80d-669f-499e-8f12-83018fca72cf admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:29.656693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38e10f-4480-449a-a911-196b5e8b01f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:29.657498 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38e10f-4480-449a-a911-196b5e8b01f4 service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:29.657778 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38e10f-4480-449a-a911-196b5e8b01f4 service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:29.658051 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38e10f-4480-449a-a911-196b5e8b01f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:29.666560 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38e10f-4480-449a-a911-196b5e8b01f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:29.668137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38e10f-4480-449a-a911-196b5e8b01f4 service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:29.678386 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1368/2737] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:33.654205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915385f5-9da1-4847-967c-859603d78bbd None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:33.654971 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915385f5-9da1-4847-967c-859603d78bbd None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:33.655165 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915385f5-9da1-4847-967c-859603d78bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:33.676274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-915385f5-9da1-4847-967c-859603d78bbd None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:33.677529 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-915385f5-9da1-4847-967c-859603d78bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:33.686297 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1370/2738] 10.222.0.84 () {58 vars in 1016 bytes} [Wed Aug 24 05:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:33.709859 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38e10f-4480-449a-a911-196b5e8b01f4 service nova] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:33.711250 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-6c38e10f-4480-449a-a911-196b5e8b01f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:33.726031 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38e10f-4480-449a-a911-196b5e8b01f4 service nova] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:33.731482 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e784524-283c-4104-b019-4f1ee4a4b026 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:33.732070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e784524-283c-4104-b019-4f1ee4a4b026 service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:33.732345 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e784524-283c-4104-b019-4f1ee4a4b026 service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:33.732665 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e784524-283c-4104-b019-4f1ee4a4b026 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:33.741283 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e784524-283c-4104-b019-4f1ee4a4b026 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:33.742857 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e784524-283c-4104-b019-4f1ee4a4b026 service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:33.753041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1369/2739] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:37.784188 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915385f5-9da1-4847-967c-859603d78bbd None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:37.785608 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-915385f5-9da1-4847-967c-859603d78bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:37.842514 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915385f5-9da1-4847-967c-859603d78bbd None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:37.846811 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be667b-0521-48dc-b797-41ec0ad85b8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:37.847428 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be667b-0521-48dc-b797-41ec0ad85b8b service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:37.847701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be667b-0521-48dc-b797-41ec0ad85b8b service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:37.847971 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be667b-0521-48dc-b797-41ec0ad85b8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:37.849809 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-03be667b-0521-48dc-b797-41ec0ad85b8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:37.863773 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be667b-0521-48dc-b797-41ec0ad85b8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:37.865203 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be667b-0521-48dc-b797-41ec0ad85b8b service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:37.876831 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1371/2740] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:43.748072 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=34 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:47.871332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=37 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:49.900256 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07ba76-4c83-415f-b1aa-fd213ff3005f None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:49.900814 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07ba76-4c83-415f-b1aa-fd213ff3005f None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:49.900814 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07ba76-4c83-415f-b1aa-fd213ff3005f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:49.920400 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-4c07ba76-4c83-415f-b1aa-fd213ff3005f None None] MFA Rules not processed for user `fde458201a29468a9a7cd9322c5b7c53`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:49.921659 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-4c07ba76-4c83-415f-b1aa-fd213ff3005f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:49.977245 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1370/2741] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:00:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:54.232547 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be667b-0521-48dc-b797-41ec0ad85b8b service cinder] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:54.234079 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-03be667b-0521-48dc-b797-41ec0ad85b8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:54.302525 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be667b-0521-48dc-b797-41ec0ad85b8b service cinder] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:54.306103 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4decb-374a-4412-a4d1-0446dc911a5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:54.306753 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4decb-374a-4412-a4d1-0446dc911a5e service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:54.307032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4decb-374a-4412-a4d1-0446dc911a5e service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:54.307301 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4decb-374a-4412-a4d1-0446dc911a5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:54.309364 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-74c4decb-374a-4412-a4d1-0446dc911a5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:54.321065 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4decb-374a-4412-a4d1-0446dc911a5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:54.322548 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4decb-374a-4412-a4d1-0446dc911a5e service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:54.333001 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1372/2742] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:59.970192 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=25 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:01.113080 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174dc02-18d0-43e4-9b2e-68e92e47008b None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:01.113823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174dc02-18d0-43e4-9b2e-68e92e47008b None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:01.113823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174dc02-18d0-43e4-9b2e-68e92e47008b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:01.134057 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-5174dc02-18d0-43e4-9b2e-68e92e47008b None None] MFA Rules not processed for user `88c5fc903c704d1789180bdae4018787`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:01:01.135687 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-5174dc02-18d0-43e4-9b2e-68e92e47008b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:01:01.208075 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1371/2743] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:01:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:01:01.544650 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4decb-374a-4412-a4d1-0446dc911a5e service neutron] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:01:01.546218 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-74c4decb-374a-4412-a4d1-0446dc911a5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:01:01.557551 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4decb-374a-4412-a4d1-0446dc911a5e service neutron] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:01:01.561275 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e3a92-3f00-42b1-a378-df1c6cd931c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:01:01.561920 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e3a92-3f00-42b1-a378-df1c6cd931c6 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:01.562204 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e3a92-3f00-42b1-a378-df1c6cd931c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:01.562476 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e3a92-3f00-42b1-a378-df1c6cd931c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:01.564274 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-978e3a92-3f00-42b1-a378-df1c6cd931c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:01:01.575287 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e3a92-3f00-42b1-a378-df1c6cd931c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:01:01.576789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e3a92-3f00-42b1-a378-df1c6cd931c6 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:01:01.585249 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1373/2744] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:01:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:01:01.924138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174dc02-18d0-43e4-9b2e-68e92e47008b None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:01:01.926208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-5174dc02-18d0-43e4-9b2e-68e92e47008b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:01:02.000838 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174dc02-18d0-43e4-9b2e-68e92e47008b None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:01:02.006365 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5853153-63e2-4c19-bbfe-19586e7f7ebd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3274d404cb403bbf272ce023aa5e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:01:02.006971 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5853153-63e2-4c19-bbfe-19586e7f7ebd service placement] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:02.007252 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5853153-63e2-4c19-bbfe-19586e7f7ebd service placement] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:02.007529 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5853153-63e2-4c19-bbfe-19586e7f7ebd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:02.009551 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-c5853153-63e2-4c19-bbfe-19586e7f7ebd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:01:02.020907 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5853153-63e2-4c19-bbfe-19586e7f7ebd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:01:02.022504 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5853153-63e2-4c19-bbfe-19586e7f7ebd service placement] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:01:02.032394 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1372/2745] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:01:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:01:05.623251 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e3a92-3f00-42b1-a378-df1c6cd931c6 service neutron] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:01:05.639220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e3a92-3f00-42b1-a378-df1c6cd931c6 service neutron] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:01:05.648040 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f3747-1af4-4a87-a127-2b3636ae4051 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:01:05.649106 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f3747-1af4-4a87-a127-2b3636ae4051 service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:05.649437 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f3747-1af4-4a87-a127-2b3636ae4051 service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:05.650365 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f3747-1af4-4a87-a127-2b3636ae4051 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:05.653653 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-8e5f3747-1af4-4a87-a127-2b3636ae4051 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:01:05.667318 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f3747-1af4-4a87-a127-2b3636ae4051 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:01:05.669219 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f3747-1af4-4a87-a127-2b3636ae4051 service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:01:05.687491 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1374/2746] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:01:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:01:06.543346 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf13f4-7428-429b-a8e2-031639be26a8 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:06.543922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf13f4-7428-429b-a8e2-031639be26a8 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:06.543922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf13f4-7428-429b-a8e2-031639be26a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:06.564407 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-6bdf13f4-7428-429b-a8e2-031639be26a8 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:01:06.565643 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-6bdf13f4-7428-429b-a8e2-031639be26a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:01:06.574578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1373/2747] 10.222.0.84 () {58 vars in 1016 bytes} [Wed Aug 24 05:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:01:06.594838 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f3747-1af4-4a87-a127-2b3636ae4051 service nova] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:01:06.606792 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f3747-1af4-4a87-a127-2b3636ae4051 service nova] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:01:06.612176 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e58b6-4905-4d6a-b708-11e95d5b791f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:01:06.612774 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e58b6-4905-4d6a-b708-11e95d5b791f service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:06.613053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e58b6-4905-4d6a-b708-11e95d5b791f service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:06.613926 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e58b6-4905-4d6a-b708-11e95d5b791f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:06.622060 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e58b6-4905-4d6a-b708-11e95d5b791f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:01:06.623615 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e58b6-4905-4d6a-b708-11e95d5b791f service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:01:06.632859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1375/2748] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:01:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:01:11.344449 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf13f4-7428-429b-a8e2-031639be26a8 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:01:11.357903 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf13f4-7428-429b-a8e2-031639be26a8 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:01:11.365807 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23211280-a0f5-4abc-99b2-0c852a998eec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:01:11.366467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23211280-a0f5-4abc-99b2-0c852a998eec service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:11.366747 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23211280-a0f5-4abc-99b2-0c852a998eec service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:11.367022 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23211280-a0f5-4abc-99b2-0c852a998eec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:11.368799 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-23211280-a0f5-4abc-99b2-0c852a998eec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:01:11.382490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23211280-a0f5-4abc-99b2-0c852a998eec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:01:11.384350 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23211280-a0f5-4abc-99b2-0c852a998eec service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:01:11.395474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1374/2749] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:01:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:01:12.930547 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee473cf-248e-47dc-80ba-ddb4182ede98 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:12.931123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee473cf-248e-47dc-80ba-ddb4182ede98 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:12.931123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee473cf-248e-47dc-80ba-ddb4182ede98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:12.950899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-cee473cf-248e-47dc-80ba-ddb4182ede98 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:01:12.952032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-cee473cf-248e-47dc-80ba-ddb4182ede98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:01:12.960113 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1376/2750] 10.222.0.84 () {58 vars in 1016 bytes} [Wed Aug 24 05:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:01:12.982163 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23211280-a0f5-4abc-99b2-0c852a998eec service nova] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:01:12.994223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23211280-a0f5-4abc-99b2-0c852a998eec service nova] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:01:12.999772 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c065514-5171-418b-af69-f5b71e879c84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:01:13.000367 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c065514-5171-418b-af69-f5b71e879c84 service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:13.000645 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c065514-5171-418b-af69-f5b71e879c84 service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:13.000917 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c065514-5171-418b-af69-f5b71e879c84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:13.010576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c065514-5171-418b-af69-f5b71e879c84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:01:13.012185 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c065514-5171-418b-af69-f5b71e879c84 service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:01:13.022683 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1375/2751] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:01:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:01:15.906836 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee473cf-248e-47dc-80ba-ddb4182ede98 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:01:15.920455 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee473cf-248e-47dc-80ba-ddb4182ede98 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:01:15.925902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9d03e-619b-47e7-a5da-e6441b3294f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:01:15.926980 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9d03e-619b-47e7-a5da-e6441b3294f1 service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:15.927383 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9d03e-619b-47e7-a5da-e6441b3294f1 service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:15.927555 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9d03e-619b-47e7-a5da-e6441b3294f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:15.929253 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-63b9d03e-619b-47e7-a5da-e6441b3294f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:01:15.941755 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9d03e-619b-47e7-a5da-e6441b3294f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:01:15.943952 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9d03e-619b-47e7-a5da-e6441b3294f1 service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:01:15.954900 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1377/2752] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:01:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:01:17.026490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef9400-9499-4de8-87a1-25c750384bfc None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:17.027085 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef9400-9499-4de8-87a1-25c750384bfc None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:17.027085 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef9400-9499-4de8-87a1-25c750384bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:17.047704 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-58ef9400-9499-4de8-87a1-25c750384bfc None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:01:17.048913 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-58ef9400-9499-4de8-87a1-25c750384bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:01:17.057721 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1376/2753] 10.222.0.84 () {58 vars in 1016 bytes} [Wed Aug 24 05:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:01:17.080982 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9d03e-619b-47e7-a5da-e6441b3294f1 service nova] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:01:17.092978 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9d03e-619b-47e7-a5da-e6441b3294f1 service nova] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:01:17.099505 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318d30f-8d1a-4dc1-9ca4-f9ba65ff02ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:01:17.100128 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318d30f-8d1a-4dc1-9ca4-f9ba65ff02ca service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:17.100417 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318d30f-8d1a-4dc1-9ca4-f9ba65ff02ca service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:17.100698 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318d30f-8d1a-4dc1-9ca4-f9ba65ff02ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:17.109714 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318d30f-8d1a-4dc1-9ca4-f9ba65ff02ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:01:17.111285 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318d30f-8d1a-4dc1-9ca4-f9ba65ff02ca service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:01:17.123469 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1378/2754] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:01:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:01:21.213125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f1ffd-7066-40ff-b9c4-f557387362c4 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:21.213679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f1ffd-7066-40ff-b9c4-f557387362c4 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:21.213679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f1ffd-7066-40ff-b9c4-f557387362c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:21.233351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-1b7f1ffd-7066-40ff-b9c4-f557387362c4 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:01:21.234641 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-1b7f1ffd-7066-40ff-b9c4-f557387362c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:01:21.243372 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1377/2755] 10.222.0.84 () {58 vars in 1016 bytes} [Wed Aug 24 05:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:01:21.264859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318d30f-8d1a-4dc1-9ca4-f9ba65ff02ca service nova] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:01:21.270629 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=60 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:21.277091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318d30f-8d1a-4dc1-9ca4-f9ba65ff02ca service nova] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:01:21.282789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf6d78-0d05-4e0e-a151-4e811414711d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:01:21.283414 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf6d78-0d05-4e0e-a151-4e811414711d service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:21.283699 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf6d78-0d05-4e0e-a151-4e811414711d service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:21.283976 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf6d78-0d05-4e0e-a151-4e811414711d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:21.292705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf6d78-0d05-4e0e-a151-4e811414711d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:01:21.294310 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf6d78-0d05-4e0e-a151-4e811414711d service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:01:21.304546 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1379/2756] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:01:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:01:25.419142 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc0e0a-8895-465a-a9b1-0c0c52cddb00 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:25.419809 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc0e0a-8895-465a-a9b1-0c0c52cddb00 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:25.419809 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc0e0a-8895-465a-a9b1-0c0c52cddb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:25.439092 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-e4cc0e0a-8895-465a-a9b1-0c0c52cddb00 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:01:25.440280 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e4cc0e0a-8895-465a-a9b1-0c0c52cddb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:01:25.448503 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1378/2757] 10.222.0.84 () {58 vars in 1016 bytes} [Wed Aug 24 05:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:01:25.471850 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf6d78-0d05-4e0e-a151-4e811414711d service nova] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:01:25.483838 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf6d78-0d05-4e0e-a151-4e811414711d service nova] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:01:25.489466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022dca6-db2e-4da4-9d95-54ba55d70ae1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:01:25.490089 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022dca6-db2e-4da4-9d95-54ba55d70ae1 service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:25.490371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022dca6-db2e-4da4-9d95-54ba55d70ae1 service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:25.490641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022dca6-db2e-4da4-9d95-54ba55d70ae1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:25.498857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022dca6-db2e-4da4-9d95-54ba55d70ae1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:01:25.500412 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022dca6-db2e-4da4-9d95-54ba55d70ae1 service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:01:25.510397 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1380/2758] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:01:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:01:35.434000 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=81 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:35.505954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=11 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:57.963809 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc0e0a-8895-465a-a9b1-0c0c52cddb00 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:01:57.965290 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e4cc0e0a-8895-465a-a9b1-0c0c52cddb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:01:57.980365 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc0e0a-8895-465a-a9b1-0c0c52cddb00 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:01:57.985965 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20fb63-0c77-4555-94a2-8a1f39ee9ade service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3274d404cb403bbf272ce023aa5e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:01:57.986945 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20fb63-0c77-4555-94a2-8a1f39ee9ade service placement] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:57.987463 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20fb63-0c77-4555-94a2-8a1f39ee9ade service placement] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:57.987948 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20fb63-0c77-4555-94a2-8a1f39ee9ade service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:57.990087 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-bc20fb63-0c77-4555-94a2-8a1f39ee9ade service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:01:58.004250 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20fb63-0c77-4555-94a2-8a1f39ee9ade service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:01:58.006129 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20fb63-0c77-4555-94a2-8a1f39ee9ade service placement] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:01:58.022731 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1379/2759] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:01:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:01:58.023529 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022dca6-db2e-4da4-9d95-54ba55d70ae1 service nova] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:01:58.025226 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-3022dca6-db2e-4da4-9d95-54ba55d70ae1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:01:58.039147 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022dca6-db2e-4da4-9d95-54ba55d70ae1 service nova] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:01:58.044205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d95ba-ae44-46b4-b2c2-b7cdf487eb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:01:58.045187 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d95ba-ae44-46b4-b2c2-b7cdf487eb92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:58.045691 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d95ba-ae44-46b4-b2c2-b7cdf487eb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:58.046169 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d95ba-ae44-46b4-b2c2-b7cdf487eb92 admin admin] PATH_INFO: `/v3/users/fde458201a29468a9a7cd9322c5b7c53` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:58.047521 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d95ba-ae44-46b4-b2c2-b7cdf487eb92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fde458201a29468a9a7cd9322c5b7c53)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:01:58.049734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d95ba-ae44-46b4-b2c2-b7cdf487eb92 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:01:58.097026 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-702d95ba-ae44-46b4-b2c2-b7cdf487eb92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fde458201a29468a9a7cd9322c5b7c53'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:01:58.104988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-702d95ba-ae44-46b4-b2c2-b7cdf487eb92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fde458201a29468a9a7cd9322c5b7c53'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:01:58.112067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-702d95ba-ae44-46b4-b2c2-b7cdf487eb92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fde458201a29468a9a7cd9322c5b7c53'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:01:58.112749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-702d95ba-ae44-46b4-b2c2-b7cdf487eb92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fde458201a29468a9a7cd9322c5b7c53'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:01:58.125432 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-702d95ba-ae44-46b4-b2c2-b7cdf487eb92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fde458201a29468a9a7cd9322c5b7c53'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:01:58.131380 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1381/2760] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 05:01:58 2022] DELETE /identity/v3/users/fde458201a29468a9a7cd9322c5b7c53 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:01:58.320120 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20fb63-0c77-4555-94a2-8a1f39ee9ade service placement] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:01:58.332736 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20fb63-0c77-4555-94a2-8a1f39ee9ade service placement] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:01:58.400104 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e9b92-e15e-43ac-a578-468ac7a7f976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:01:58.400743 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e9b92-e15e-43ac-a578-468ac7a7f976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:58.401024 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e9b92-e15e-43ac-a578-468ac7a7f976 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:58.401313 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e9b92-e15e-43ac-a578-468ac7a7f976 admin admin] PATH_INFO: `/v3/projects/c9c272bae1a547f089f7fed1462e1282` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:58.402484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e9b92-e15e-43ac-a578-468ac7a7f976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9c272bae1a547f089f7fed1462e1282)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:01:58.404382 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e9b92-e15e-43ac-a578-468ac7a7f976 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:01:58.455088 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a88e9b92-e15e-43ac-a578-468ac7a7f976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c272bae1a547f089f7fed1462e1282', 'request_id': 'req-a88e9b92-e15e-43ac-a578-468ac7a7f976'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:01:58.461688 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a88e9b92-e15e-43ac-a578-468ac7a7f976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c272bae1a547f089f7fed1462e1282', 'request_id': 'req-a88e9b92-e15e-43ac-a578-468ac7a7f976'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:01:58.469983 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a88e9b92-e15e-43ac-a578-468ac7a7f976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c272bae1a547f089f7fed1462e1282', 'request_id': 'req-a88e9b92-e15e-43ac-a578-468ac7a7f976'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:01:58.482830 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a88e9b92-e15e-43ac-a578-468ac7a7f976 admin admin] The token cache is being invalidate because project c9c272bae1a547f089f7fed1462e1282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:01:58.483032 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a88e9b92-e15e-43ac-a578-468ac7a7f976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:01:58.483674 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a88e9b92-e15e-43ac-a578-468ac7a7f976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:01:58.485157 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1380/2761] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 05:01:58 2022] DELETE /identity/v3/projects/c9c272bae1a547f089f7fed1462e1282 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:01:58.490136 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bc495-cc57-4c00-a829-216e7cb26e7f None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:58.490425 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bc495-cc57-4c00-a829-216e7cb26e7f None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:58.490704 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bc495-cc57-4c00-a829-216e7cb26e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:58.510778 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-d34bc495-cc57-4c00-a829-216e7cb26e7f None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:01:58.512587 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-d34bc495-cc57-4c00-a829-216e7cb26e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:01:58.573931 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1382/2762] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:01:58.581786 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c584c-c507-488b-8912-111f541bdfd6 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:58.582077 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c584c-c507-488b-8912-111f541bdfd6 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:58.582357 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c584c-c507-488b-8912-111f541bdfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:58.605437 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-aa0c584c-c507-488b-8912-111f541bdfd6 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:01:58.606689 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-aa0c584c-c507-488b-8912-111f541bdfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:01:58.614708 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1381/2763] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:01:58.619576 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bc495-cc57-4c00-a829-216e7cb26e7f None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:01:58.629585 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bc495-cc57-4c00-a829-216e7cb26e7f None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:01:58.634800 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10756cbd-9b37-4362-9c96-7943de07bfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:01:58.635424 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10756cbd-9b37-4362-9c96-7943de07bfb9 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:58.635707 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10756cbd-9b37-4362-9c96-7943de07bfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:58.636230 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10756cbd-9b37-4362-9c96-7943de07bfb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:58.636888 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10756cbd-9b37-4362-9c96-7943de07bfb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:01:58.637238 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10756cbd-9b37-4362-9c96-7943de07bfb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:01:58.638954 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10756cbd-9b37-4362-9c96-7943de07bfb9 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:01:58.653803 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1383/2764] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 05:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:01:58.658255 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c584c-c507-488b-8912-111f541bdfd6 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:01:58.668428 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c584c-c507-488b-8912-111f541bdfd6 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:01:58.673153 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e5d55-d13c-4374-8932-ee65ee253c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:01:58.673787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e5d55-d13c-4374-8932-ee65ee253c59 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:58.674065 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e5d55-d13c-4374-8932-ee65ee253c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:58.674337 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e5d55-d13c-4374-8932-ee65ee253c59 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:58.674966 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e5d55-d13c-4374-8932-ee65ee253c59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:01:58.676860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e5d55-d13c-4374-8932-ee65ee253c59 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:01:58.706105 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1382/2765] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 05:01:58 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:01:58.711276 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10756cbd-9b37-4362-9c96-7943de07bfb9 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:01:58.722551 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10756cbd-9b37-4362-9c96-7943de07bfb9 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:01:58.781522 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599f1a8-1f3e-497f-b201-d557b60f2025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:01:58.782068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599f1a8-1f3e-497f-b201-d557b60f2025 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:58.782350 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599f1a8-1f3e-497f-b201-d557b60f2025 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:58.782627 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599f1a8-1f3e-497f-b201-d557b60f2025 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:58.783273 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599f1a8-1f3e-497f-b201-d557b60f2025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:01:58.785192 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599f1a8-1f3e-497f-b201-d557b60f2025 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:01:58.793542 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:58.809448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1384/2766] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 05:01:58 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:01:58.811868 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e5d55-d13c-4374-8932-ee65ee253c59 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:01:58.822860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e5d55-d13c-4374-8932-ee65ee253c59 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:01:58.827599 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d24e7d-feca-400f-bd12-94452d8750c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:01:58.828243 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d24e7d-feca-400f-bd12-94452d8750c5 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:58.828478 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d24e7d-feca-400f-bd12-94452d8750c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:58.828749 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d24e7d-feca-400f-bd12-94452d8750c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:58.829394 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d24e7d-feca-400f-bd12-94452d8750c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:01:58.831004 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d24e7d-feca-400f-bd12-94452d8750c5 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:01:58.967999 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1383/2767] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:01:58.972699 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599f1a8-1f3e-497f-b201-d557b60f2025 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:01:58.983474 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599f1a8-1f3e-497f-b201-d557b60f2025 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:01:58.988189 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6bec2-e466-436e-9f30-e1f62ebd507b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:01:58.988821 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6bec2-e466-436e-9f30-e1f62ebd507b admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:58.989099 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6bec2-e466-436e-9f30-e1f62ebd507b admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:58.989374 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6bec2-e466-436e-9f30-e1f62ebd507b admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:58.990097 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6bec2-e466-436e-9f30-e1f62ebd507b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:01:58.991953 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6bec2-e466-436e-9f30-e1f62ebd507b admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:01:59.003607 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1385/2768] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:01:59.008645 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d24e7d-feca-400f-bd12-94452d8750c5 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:01:59.019026 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d24e7d-feca-400f-bd12-94452d8750c5 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:01:59.024338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44bdfa-3cd4-4f83-83b2-f462f7f08de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:01:59.024991 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44bdfa-3cd4-4f83-83b2-f462f7f08de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:59.025269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44bdfa-3cd4-4f83-83b2-f462f7f08de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:59.025576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44bdfa-3cd4-4f83-83b2-f462f7f08de7 admin admin] PATH_INFO: `/v3/projects/d01b2a9f4e90498c972b267e969d1700/users/10d0b9d0213c42918c9575ddb0064d09/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:59.041733 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44bdfa-3cd4-4f83-83b2-f462f7f08de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d01b2a9f4e90498c972b267e969d1700, user_id=10d0b9d0213c42918c9575ddb0064d09, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:01:59.044396 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44bdfa-3cd4-4f83-83b2-f462f7f08de7 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:01:59.058230 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1384/2769] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:01:59 2022] PUT /identity/v3/projects/d01b2a9f4e90498c972b267e969d1700/users/10d0b9d0213c42918c9575ddb0064d09/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:01:59.068660 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8cba6-af1f-43f0-9fb5-53e295fb56ef None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:59.069819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8cba6-af1f-43f0-9fb5-53e295fb56ef None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:59.069819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8cba6-af1f-43f0-9fb5-53e295fb56ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:59.097688 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-9db8cba6-af1f-43f0-9fb5-53e295fb56ef None None] MFA Rules not processed for user `10d0b9d0213c42918c9575ddb0064d09`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:01:59.098895 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-9db8cba6-af1f-43f0-9fb5-53e295fb56ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:01:59.164641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1386/2770] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:01:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:01:59.175454 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44bdfa-3cd4-4f83-83b2-f462f7f08de7 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:01:59.177159 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-4c44bdfa-3cd4-4f83-83b2-f462f7f08de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:01:59.192149 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:59.238288 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44bdfa-3cd4-4f83-83b2-f462f7f08de7 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:01:59.242650 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3007b-55df-4778-a538-d898045ba559 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:01:59.243249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3007b-55df-4778-a538-d898045ba559 service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:59.243526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3007b-55df-4778-a538-d898045ba559 service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:59.243796 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3007b-55df-4778-a538-d898045ba559 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:59.252613 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3007b-55df-4778-a538-d898045ba559 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:01:59.254061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3007b-55df-4778-a538-d898045ba559 service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:01:59.263628 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1385/2771] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:01:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:02:09.161700 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:09.259417 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=20 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:09.370236 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db8cba6-af1f-43f0-9fb5-53e295fb56ef None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:09.433338 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db8cba6-af1f-43f0-9fb5-53e295fb56ef None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:09.437841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f715b7-14df-4df2-81f5-1faaddbe264b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:09.438477 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f715b7-14df-4df2-81f5-1faaddbe264b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:09.438761 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f715b7-14df-4df2-81f5-1faaddbe264b admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:09.439037 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f715b7-14df-4df2-81f5-1faaddbe264b admin admin] PATH_INFO: `/v3/users/10d0b9d0213c42918c9575ddb0064d09` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:09.440155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f715b7-14df-4df2-81f5-1faaddbe264b admin admin] RBAC: Authorizing `identity:delete_user(user_id=10d0b9d0213c42918c9575ddb0064d09)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:09.442119 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f715b7-14df-4df2-81f5-1faaddbe264b admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:09.489016 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e3f715b7-14df-4df2-81f5-1faaddbe264b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10d0b9d0213c42918c9575ddb0064d09'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:09.496950 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e3f715b7-14df-4df2-81f5-1faaddbe264b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10d0b9d0213c42918c9575ddb0064d09'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:09.503818 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e3f715b7-14df-4df2-81f5-1faaddbe264b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10d0b9d0213c42918c9575ddb0064d09'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:09.504436 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e3f715b7-14df-4df2-81f5-1faaddbe264b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10d0b9d0213c42918c9575ddb0064d09'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:09.516319 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-e3f715b7-14df-4df2-81f5-1faaddbe264b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10d0b9d0213c42918c9575ddb0064d09'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:09.522304 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1387/2772] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 05:02:09 2022] DELETE /identity/v3/users/10d0b9d0213c42918c9575ddb0064d09 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:09.527015 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f53d7-a803-46df-a09e-965ecd96413c None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:09.527306 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f53d7-a803-46df-a09e-965ecd96413c None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:09.527617 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f53d7-a803-46df-a09e-965ecd96413c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:09.549274 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-8b0f53d7-a803-46df-a09e-965ecd96413c None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:09.550548 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-8b0f53d7-a803-46df-a09e-965ecd96413c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:09.609280 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1386/2773] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:09.619690 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f715b7-14df-4df2-81f5-1faaddbe264b admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:09.621086 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-e3f715b7-14df-4df2-81f5-1faaddbe264b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:09.817390 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f715b7-14df-4df2-81f5-1faaddbe264b admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:09.821302 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452629e-4ee8-403d-879a-e972244c87aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:09.821975 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452629e-4ee8-403d-879a-e972244c87aa service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:09.822252 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452629e-4ee8-403d-879a-e972244c87aa service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:09.822522 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452629e-4ee8-403d-879a-e972244c87aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:09.832509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452629e-4ee8-403d-879a-e972244c87aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:09.833989 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452629e-4ee8-403d-879a-e972244c87aa service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:09.845727 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1388/2774] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:02:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:02:10.124634 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f53d7-a803-46df-a09e-965ecd96413c None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:10.126102 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-8b0f53d7-a803-46df-a09e-965ecd96413c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:10.140799 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f53d7-a803-46df-a09e-965ecd96413c None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:10.146268 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9f7a8-999e-4fa8-a407-562295fbb973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:10.146900 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9f7a8-999e-4fa8-a407-562295fbb973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:10.147183 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9f7a8-999e-4fa8-a407-562295fbb973 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:10.147457 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9f7a8-999e-4fa8-a407-562295fbb973 admin admin] PATH_INFO: `/v3/projects/d01b2a9f4e90498c972b267e969d1700` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:10.149290 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9f7a8-999e-4fa8-a407-562295fbb973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d01b2a9f4e90498c972b267e969d1700)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:10.151666 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9f7a8-999e-4fa8-a407-562295fbb973 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:10.199882 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-33d9f7a8-999e-4fa8-a407-562295fbb973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd01b2a9f4e90498c972b267e969d1700', 'request_id': 'req-33d9f7a8-999e-4fa8-a407-562295fbb973'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:10.205274 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-33d9f7a8-999e-4fa8-a407-562295fbb973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd01b2a9f4e90498c972b267e969d1700', 'request_id': 'req-33d9f7a8-999e-4fa8-a407-562295fbb973'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:10.213453 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-33d9f7a8-999e-4fa8-a407-562295fbb973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd01b2a9f4e90498c972b267e969d1700', 'request_id': 'req-33d9f7a8-999e-4fa8-a407-562295fbb973'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:10.225195 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-33d9f7a8-999e-4fa8-a407-562295fbb973 admin admin] The token cache is being invalidate because project d01b2a9f4e90498c972b267e969d1700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:02:10.225394 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-33d9f7a8-999e-4fa8-a407-562295fbb973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:10.226071 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-33d9f7a8-999e-4fa8-a407-562295fbb973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:10.227581 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1387/2775] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 05:02:10 2022] DELETE /identity/v3/projects/d01b2a9f4e90498c972b267e969d1700 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:10.232405 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88c1f4-b24e-4991-a685-254759674344 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:10.232927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88c1f4-b24e-4991-a685-254759674344 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:10.233030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88c1f4-b24e-4991-a685-254759674344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:10.251852 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-bf88c1f4-b24e-4991-a685-254759674344 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:10.253046 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-bf88c1f4-b24e-4991-a685-254759674344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:10.270318 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:10.314191 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1389/2776] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:10.322695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45a6e2-c281-46ca-bbf5-fa5dcba35f35 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:10.323217 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45a6e2-c281-46ca-bbf5-fa5dcba35f35 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:10.323217 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45a6e2-c281-46ca-bbf5-fa5dcba35f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:10.342619 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-ca45a6e2-c281-46ca-bbf5-fa5dcba35f35 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:10.343802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-ca45a6e2-c281-46ca-bbf5-fa5dcba35f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:10.351534 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1388/2777] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:10.355765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88c1f4-b24e-4991-a685-254759674344 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:10.365609 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88c1f4-b24e-4991-a685-254759674344 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:10.371121 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a679536-1bf1-4ae9-94be-1585288bb9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:10.371722 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a679536-1bf1-4ae9-94be-1585288bb9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:10.372003 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a679536-1bf1-4ae9-94be-1585288bb9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:10.372308 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a679536-1bf1-4ae9-94be-1585288bb9b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:10.372962 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a679536-1bf1-4ae9-94be-1585288bb9b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:02:10.373268 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a679536-1bf1-4ae9-94be-1585288bb9b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:10.374885 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a679536-1bf1-4ae9-94be-1585288bb9b0 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:10.387866 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1390/2778] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 05:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:02:10.392520 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45a6e2-c281-46ca-bbf5-fa5dcba35f35 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:10.402892 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45a6e2-c281-46ca-bbf5-fa5dcba35f35 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:10.407554 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf177a6b-bc84-4151-a3f5-ddbf81b3effa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:10.408147 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf177a6b-bc84-4151-a3f5-ddbf81b3effa admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:10.408426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf177a6b-bc84-4151-a3f5-ddbf81b3effa admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:10.408695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf177a6b-bc84-4151-a3f5-ddbf81b3effa admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:10.409317 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf177a6b-bc84-4151-a3f5-ddbf81b3effa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:10.411218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf177a6b-bc84-4151-a3f5-ddbf81b3effa admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:10.438852 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1389/2779] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 05:02:10 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:02:10.444093 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a679536-1bf1-4ae9-94be-1585288bb9b0 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:10.455266 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a679536-1bf1-4ae9-94be-1585288bb9b0 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:10.513685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e477e3b-5026-4541-b03e-2ed9192df83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:10.514273 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e477e3b-5026-4541-b03e-2ed9192df83f admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:10.514555 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e477e3b-5026-4541-b03e-2ed9192df83f admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:10.514828 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e477e3b-5026-4541-b03e-2ed9192df83f admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:10.515495 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e477e3b-5026-4541-b03e-2ed9192df83f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:10.517701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e477e3b-5026-4541-b03e-2ed9192df83f admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:10.541787 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1391/2780] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 05:02:10 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:02:10.546141 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf177a6b-bc84-4151-a3f5-ddbf81b3effa admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:10.556727 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf177a6b-bc84-4151-a3f5-ddbf81b3effa admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:10.561450 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f1e7a-ce26-4cb3-be9d-f00f8347d23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:10.562044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f1e7a-ce26-4cb3-be9d-f00f8347d23e admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:10.562322 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f1e7a-ce26-4cb3-be9d-f00f8347d23e admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:10.562594 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f1e7a-ce26-4cb3-be9d-f00f8347d23e admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:10.563265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f1e7a-ce26-4cb3-be9d-f00f8347d23e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:10.564836 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f1e7a-ce26-4cb3-be9d-f00f8347d23e admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:10.574851 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1390/2781] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:02:10.578711 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e477e3b-5026-4541-b03e-2ed9192df83f admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:10.589265 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e477e3b-5026-4541-b03e-2ed9192df83f admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:10.593962 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27198b38-7193-4fd6-8dda-e9d35ffc9bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:10.594558 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27198b38-7193-4fd6-8dda-e9d35ffc9bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:10.594841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27198b38-7193-4fd6-8dda-e9d35ffc9bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:10.595113 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27198b38-7193-4fd6-8dda-e9d35ffc9bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:10.595760 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27198b38-7193-4fd6-8dda-e9d35ffc9bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:10.597340 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27198b38-7193-4fd6-8dda-e9d35ffc9bc6 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:10.608465 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1392/2782] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:02:10.612616 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f1e7a-ce26-4cb3-be9d-f00f8347d23e admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:10.622696 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f1e7a-ce26-4cb3-be9d-f00f8347d23e admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:10.627358 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf60d8-71d1-489c-a040-1db9225bd434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:10.627997 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf60d8-71d1-489c-a040-1db9225bd434 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:10.628279 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf60d8-71d1-489c-a040-1db9225bd434 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:10.628557 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf60d8-71d1-489c-a040-1db9225bd434 admin admin] PATH_INFO: `/v3/projects/816703e3af104db7a4b08bdf9e067b54/users/f998c473b4994bc59bf75bb6088608a3/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:10.643489 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf60d8-71d1-489c-a040-1db9225bd434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=816703e3af104db7a4b08bdf9e067b54, user_id=f998c473b4994bc59bf75bb6088608a3, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:10.646368 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf60d8-71d1-489c-a040-1db9225bd434 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:10.660413 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1391/2783] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:02:10 2022] PUT /identity/v3/projects/816703e3af104db7a4b08bdf9e067b54/users/f998c473b4994bc59bf75bb6088608a3/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:10.671564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a798b-5b72-44d6-ac96-e6553be18bc2 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:10.671564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a798b-5b72-44d6-ac96-e6553be18bc2 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:10.672026 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a798b-5b72-44d6-ac96-e6553be18bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:10.701523 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-619a798b-5b72-44d6-ac96-e6553be18bc2 None None] MFA Rules not processed for user `f998c473b4994bc59bf75bb6088608a3`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:10.702742 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-619a798b-5b72-44d6-ac96-e6553be18bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:10.769919 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1393/2784] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:02:10 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:10.784896 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf60d8-71d1-489c-a040-1db9225bd434 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:10.787428 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-fabf60d8-71d1-489c-a040-1db9225bd434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:10.809099 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:10.846202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf60d8-71d1-489c-a040-1db9225bd434 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:10.849890 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b0e4f-c758-46fa-9c6f-41e8a18781a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:10.850483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b0e4f-c758-46fa-9c6f-41e8a18781a0 service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:10.850762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b0e4f-c758-46fa-9c6f-41e8a18781a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:10.851032 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b0e4f-c758-46fa-9c6f-41e8a18781a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:10.859370 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b0e4f-c758-46fa-9c6f-41e8a18781a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:10.860772 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b0e4f-c758-46fa-9c6f-41e8a18781a0 service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:10.869727 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1392/2785] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:02:10 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:02:15.902535 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a798b-5b72-44d6-ac96-e6553be18bc2 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:15.921052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:15.964767 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a798b-5b72-44d6-ac96-e6553be18bc2 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:15.969203 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fdf71-a54b-4bcd-bae6-125c012ca4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:15.969857 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fdf71-a54b-4bcd-bae6-125c012ca4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:15.970134 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fdf71-a54b-4bcd-bae6-125c012ca4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:15.970402 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fdf71-a54b-4bcd-bae6-125c012ca4c8 admin admin] PATH_INFO: `/v3/users/f998c473b4994bc59bf75bb6088608a3` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:15.971503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fdf71-a54b-4bcd-bae6-125c012ca4c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f998c473b4994bc59bf75bb6088608a3)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:15.973384 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fdf71-a54b-4bcd-bae6-125c012ca4c8 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:16.020652 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-849fdf71-a54b-4bcd-bae6-125c012ca4c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f998c473b4994bc59bf75bb6088608a3'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:16.029825 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-849fdf71-a54b-4bcd-bae6-125c012ca4c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f998c473b4994bc59bf75bb6088608a3'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:16.036819 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-849fdf71-a54b-4bcd-bae6-125c012ca4c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f998c473b4994bc59bf75bb6088608a3'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:16.037533 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-849fdf71-a54b-4bcd-bae6-125c012ca4c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f998c473b4994bc59bf75bb6088608a3'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:16.050632 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-849fdf71-a54b-4bcd-bae6-125c012ca4c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f998c473b4994bc59bf75bb6088608a3'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:16.057352 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1394/2786] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 05:02:15 2022] DELETE /identity/v3/users/f998c473b4994bc59bf75bb6088608a3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:02:16.061900 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9245de-8378-40c1-936a-d6ff3f905894 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:16.062368 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9245de-8378-40c1-936a-d6ff3f905894 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:16.062462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9245de-8378-40c1-936a-d6ff3f905894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:16.080748 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-6f9245de-8378-40c1-936a-d6ff3f905894 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:16.081987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-6f9245de-8378-40c1-936a-d6ff3f905894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:16.141187 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1393/2787] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:16.151821 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fdf71-a54b-4bcd-bae6-125c012ca4c8 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:16.153220 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-849fdf71-a54b-4bcd-bae6-125c012ca4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:16.213991 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fdf71-a54b-4bcd-bae6-125c012ca4c8 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:16.217693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16a7de-db07-4033-995d-43201deed7a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:16.218306 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16a7de-db07-4033-995d-43201deed7a7 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:16.218586 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16a7de-db07-4033-995d-43201deed7a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:16.218859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16a7de-db07-4033-995d-43201deed7a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:16.228186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16a7de-db07-4033-995d-43201deed7a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:16.229643 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16a7de-db07-4033-995d-43201deed7a7 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:16.239106 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1395/2788] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:02:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:02:16.519280 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9245de-8378-40c1-936a-d6ff3f905894 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:16.520751 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-6f9245de-8378-40c1-936a-d6ff3f905894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:16.535038 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9245de-8378-40c1-936a-d6ff3f905894 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:16.541995 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0c17c-c463-4fe9-8fdf-7ee6bfb684e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:16.542693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0c17c-c463-4fe9-8fdf-7ee6bfb684e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:16.542970 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0c17c-c463-4fe9-8fdf-7ee6bfb684e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:16.543318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0c17c-c463-4fe9-8fdf-7ee6bfb684e4 admin admin] PATH_INFO: `/v3/projects/816703e3af104db7a4b08bdf9e067b54` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:16.544561 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0c17c-c463-4fe9-8fdf-7ee6bfb684e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=816703e3af104db7a4b08bdf9e067b54)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:16.547156 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0c17c-c463-4fe9-8fdf-7ee6bfb684e4 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:16.595270 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-bde0c17c-c463-4fe9-8fdf-7ee6bfb684e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '816703e3af104db7a4b08bdf9e067b54', 'request_id': 'req-bde0c17c-c463-4fe9-8fdf-7ee6bfb684e4'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:16.600915 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-bde0c17c-c463-4fe9-8fdf-7ee6bfb684e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '816703e3af104db7a4b08bdf9e067b54', 'request_id': 'req-bde0c17c-c463-4fe9-8fdf-7ee6bfb684e4'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:16.609316 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-bde0c17c-c463-4fe9-8fdf-7ee6bfb684e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '816703e3af104db7a4b08bdf9e067b54', 'request_id': 'req-bde0c17c-c463-4fe9-8fdf-7ee6bfb684e4'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:16.620550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-bde0c17c-c463-4fe9-8fdf-7ee6bfb684e4 admin admin] The token cache is being invalidate because project 816703e3af104db7a4b08bdf9e067b54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:02:16.620831 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-bde0c17c-c463-4fe9-8fdf-7ee6bfb684e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:16.621511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-bde0c17c-c463-4fe9-8fdf-7ee6bfb684e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:16.622990 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1394/2789] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 05:02:16 2022] DELETE /identity/v3/projects/816703e3af104db7a4b08bdf9e067b54 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:26.234911 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:26.617514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:42.433039 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16a7de-db07-4033-995d-43201deed7a7 service neutron] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:42.435199 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-3f16a7de-db07-4033-995d-43201deed7a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:42.508075 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16a7de-db07-4033-995d-43201deed7a7 service neutron] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:42.571732 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b3bf5-b1c8-4449-99f9-4845f324a53b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:42.572343 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b3bf5-b1c8-4449-99f9-4845f324a53b service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:42.572626 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b3bf5-b1c8-4449-99f9-4845f324a53b service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:42.572899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b3bf5-b1c8-4449-99f9-4845f324a53b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:42.574796 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-108b3bf5-b1c8-4449-99f9-4845f324a53b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:42.632647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b3bf5-b1c8-4449-99f9-4845f324a53b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:42.634408 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b3bf5-b1c8-4449-99f9-4845f324a53b service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:42.643792 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1396/2790] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:02:42 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:02:52.640127 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=84 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:04.039208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6cba7-457a-4e33-89d1-6e3aea1376cb None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:04.039822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6cba7-457a-4e33-89d1-6e3aea1376cb None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:04.039822 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6cba7-457a-4e33-89d1-6e3aea1376cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:04.095031 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-e6d6cba7-457a-4e33-89d1-6e3aea1376cb None None] MFA Rules not processed for user `7caa973c63e64d639cc2fb55a4955542`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:03:04.097079 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e6d6cba7-457a-4e33-89d1-6e3aea1376cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:04.168860 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1395/2791] 10.222.0.94 () {58 vars in 1009 bytes} [Wed Aug 24 05:03:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:03:04.219777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b3bf5-b1c8-4449-99f9-4845f324a53b service nova] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:04.221850 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-108b3bf5-b1c8-4449-99f9-4845f324a53b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:04.316446 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b3bf5-b1c8-4449-99f9-4845f324a53b service nova] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:04.321849 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da832013-6c54-4998-bfe4-d91d73efec8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40d2202203204b06a41e57b9d1a300fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:04.322468 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da832013-6c54-4998-bfe4-d91d73efec8c service swift] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:04.322749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da832013-6c54-4998-bfe4-d91d73efec8c service swift] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:04.323021 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da832013-6c54-4998-bfe4-d91d73efec8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:04.338505 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da832013-6c54-4998-bfe4-d91d73efec8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:04.340085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da832013-6c54-4998-bfe4-d91d73efec8c service swift] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:04.349358 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1397/2792] 10.222.0.94 () {60 vars in 1384 bytes} [Wed Aug 24 05:03:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:03:14.166236 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=40 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:14.345608 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=41 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:22.164587 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fde3e4-0d21-44c4-82a1-9937f2aa9b74 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:22.165049 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fde3e4-0d21-44c4-82a1-9937f2aa9b74 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:22.165142 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fde3e4-0d21-44c4-82a1-9937f2aa9b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:22.184846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-f5fde3e4-0d21-44c4-82a1-9937f2aa9b74 None None] MFA Rules not processed for user `7caa973c63e64d639cc2fb55a4955542`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:03:22.186089 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-f5fde3e4-0d21-44c4-82a1-9937f2aa9b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:22.194100 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1396/2793] 10.222.0.94 () {58 vars in 1009 bytes} [Wed Aug 24 05:03:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:03:22.205970 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da832013-6c54-4998-bfe4-d91d73efec8c service swift] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:22.217017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da832013-6c54-4998-bfe4-d91d73efec8c service swift] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:22.222509 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431ac08-593c-4a74-9fbb-58efde3c27a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40d2202203204b06a41e57b9d1a300fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:22.223118 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431ac08-593c-4a74-9fbb-58efde3c27a5 service swift] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:22.223404 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431ac08-593c-4a74-9fbb-58efde3c27a5 service swift] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:22.223680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431ac08-593c-4a74-9fbb-58efde3c27a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:22.232116 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e431ac08-593c-4a74-9fbb-58efde3c27a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:22.233657 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e431ac08-593c-4a74-9fbb-58efde3c27a5 service swift] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:22.242692 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1398/2794] 10.222.0.94 () {60 vars in 1384 bytes} [Wed Aug 24 05:03:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:03:32.179687 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:32.239419 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=6 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:41.964044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf862ee-2567-45d0-b978-08960e06c361 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:41.964557 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf862ee-2567-45d0-b978-08960e06c361 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:41.964667 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf862ee-2567-45d0-b978-08960e06c361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:41.985143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-adf862ee-2567-45d0-b978-08960e06c361 None None] MFA Rules not processed for user `7caa973c63e64d639cc2fb55a4955542`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:03:41.986404 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-adf862ee-2567-45d0-b978-08960e06c361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:41.994582 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1397/2795] 10.222.0.94 () {58 vars in 967 bytes} [Wed Aug 24 05:03:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:03:42.009708 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431ac08-593c-4a74-9fbb-58efde3c27a5 service swift] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:42.021305 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431ac08-593c-4a74-9fbb-58efde3c27a5 service swift] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:42.027539 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc556d92-5503-449f-a3b5-3694146dc127 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40d2202203204b06a41e57b9d1a300fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:42.028165 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc556d92-5503-449f-a3b5-3694146dc127 service swift] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:42.028432 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc556d92-5503-449f-a3b5-3694146dc127 service swift] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:42.028705 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc556d92-5503-449f-a3b5-3694146dc127 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:42.038189 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc556d92-5503-449f-a3b5-3694146dc127 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:42.039779 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc556d92-5503-449f-a3b5-3694146dc127 service swift] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:42.049793 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1399/2796] 10.222.0.94 () {60 vars in 1384 bytes} [Wed Aug 24 05:03:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:03:51.979567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:52.045535 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=6 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:02.163468 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf862ee-2567-45d0-b978-08960e06c361 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:02.164919 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-adf862ee-2567-45d0-b978-08960e06c361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:02.233691 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf862ee-2567-45d0-b978-08960e06c361 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:02.238203 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc666be-e546-4bac-bec4-5081b370244a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3274d404cb403bbf272ce023aa5e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:02.238807 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc666be-e546-4bac-bec4-5081b370244a service placement] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:02.239084 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc666be-e546-4bac-bec4-5081b370244a service placement] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:02.239383 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc666be-e546-4bac-bec4-5081b370244a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:02.241234 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-2bc666be-e546-4bac-bec4-5081b370244a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:02.254370 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc666be-e546-4bac-bec4-5081b370244a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:02.256549 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc666be-e546-4bac-bec4-5081b370244a service placement] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:02.266917 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1398/2797] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:04:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:04:12.262145 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=32 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:46.538749 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc556d92-5503-449f-a3b5-3694146dc127 service swift] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:46.540246 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-dc556d92-5503-449f-a3b5-3694146dc127 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:46.597304 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc556d92-5503-449f-a3b5-3694146dc127 service swift] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:46.600878 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5b81c-70f5-44b4-88af-3a5fae6243b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:46.601507 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5b81c-70f5-44b4-88af-3a5fae6243b2 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:46.601788 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5b81c-70f5-44b4-88af-3a5fae6243b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:46.602060 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5b81c-70f5-44b4-88af-3a5fae6243b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:46.603759 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-48c5b81c-70f5-44b4-88af-3a5fae6243b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:46.665484 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5b81c-70f5-44b4-88af-3a5fae6243b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:46.666891 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5b81c-70f5-44b4-88af-3a5fae6243b2 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:46.676622 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1400/2798] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:04:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:04:49.740482 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc666be-e546-4bac-bec4-5081b370244a service placement] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:49.751978 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc666be-e546-4bac-bec4-5081b370244a service placement] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:49.757307 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468d9c9-16c7-464c-83a5-6706fe4681e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3274d404cb403bbf272ce023aa5e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:49.757878 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468d9c9-16c7-464c-83a5-6706fe4681e2 service placement] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:49.758483 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468d9c9-16c7-464c-83a5-6706fe4681e2 service placement] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:49.758758 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468d9c9-16c7-464c-83a5-6706fe4681e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:49.762665 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-9468d9c9-16c7-464c-83a5-6706fe4681e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:49.780966 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468d9c9-16c7-464c-83a5-6706fe4681e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:49.783646 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468d9c9-16c7-464c-83a5-6706fe4681e2 service placement] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:49.809729 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1399/2799] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:04:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:04:49.828814 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5b81c-70f5-44b4-88af-3a5fae6243b2 service neutron] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:49.830674 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-48c5b81c-70f5-44b4-88af-3a5fae6243b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:49.844769 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5b81c-70f5-44b4-88af-3a5fae6243b2 service neutron] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:49.850115 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46a595-0df0-4724-bdeb-5eb1db2389b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:49.850764 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46a595-0df0-4724-bdeb-5eb1db2389b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:49.851046 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46a595-0df0-4724-bdeb-5eb1db2389b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:49.851317 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46a595-0df0-4724-bdeb-5eb1db2389b5 admin admin] PATH_INFO: `/v3/users/88c5fc903c704d1789180bdae4018787` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:49.852454 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46a595-0df0-4724-bdeb-5eb1db2389b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88c5fc903c704d1789180bdae4018787)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:49.854395 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46a595-0df0-4724-bdeb-5eb1db2389b5 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:49.910841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ae46a595-0df0-4724-bdeb-5eb1db2389b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88c5fc903c704d1789180bdae4018787'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:49.919423 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ae46a595-0df0-4724-bdeb-5eb1db2389b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88c5fc903c704d1789180bdae4018787'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:49.927828 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ae46a595-0df0-4724-bdeb-5eb1db2389b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88c5fc903c704d1789180bdae4018787'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:49.928566 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ae46a595-0df0-4724-bdeb-5eb1db2389b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88c5fc903c704d1789180bdae4018787'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:49.942241 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-ae46a595-0df0-4724-bdeb-5eb1db2389b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88c5fc903c704d1789180bdae4018787'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:49.948374 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1401/2800] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 05:04:49 2022] DELETE /identity/v3/users/88c5fc903c704d1789180bdae4018787 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:04:50.133585 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468d9c9-16c7-464c-83a5-6706fe4681e2 service placement] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:50.146121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468d9c9-16c7-464c-83a5-6706fe4681e2 service placement] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:50.203436 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec540610-1975-4a86-89b6-7b0e214c8be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:50.204068 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec540610-1975-4a86-89b6-7b0e214c8be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:50.204350 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec540610-1975-4a86-89b6-7b0e214c8be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:50.204625 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec540610-1975-4a86-89b6-7b0e214c8be4 admin admin] PATH_INFO: `/v3/projects/e4921710e31240a58c7093f4f7216bbb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:50.205792 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec540610-1975-4a86-89b6-7b0e214c8be4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4921710e31240a58c7093f4f7216bbb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:50.207666 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec540610-1975-4a86-89b6-7b0e214c8be4 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:50.254092 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-ec540610-1975-4a86-89b6-7b0e214c8be4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4921710e31240a58c7093f4f7216bbb', 'request_id': 'req-ec540610-1975-4a86-89b6-7b0e214c8be4'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:50.259512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-ec540610-1975-4a86-89b6-7b0e214c8be4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4921710e31240a58c7093f4f7216bbb', 'request_id': 'req-ec540610-1975-4a86-89b6-7b0e214c8be4'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:50.268169 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-ec540610-1975-4a86-89b6-7b0e214c8be4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4921710e31240a58c7093f4f7216bbb', 'request_id': 'req-ec540610-1975-4a86-89b6-7b0e214c8be4'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:50.279932 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-ec540610-1975-4a86-89b6-7b0e214c8be4 admin admin] The token cache is being invalidate because project e4921710e31240a58c7093f4f7216bbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:04:50.280225 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-ec540610-1975-4a86-89b6-7b0e214c8be4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:50.280863 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-ec540610-1975-4a86-89b6-7b0e214c8be4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:50.282385 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1400/2801] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 05:04:50 2022] DELETE /identity/v3/projects/e4921710e31240a58c7093f4f7216bbb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:50.287433 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1b675-28bb-443f-b5b9-749b0833c5b2 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:50.287787 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1b675-28bb-443f-b5b9-749b0833c5b2 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:50.288068 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1b675-28bb-443f-b5b9-749b0833c5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:50.307338 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-54f1b675-28bb-443f-b5b9-749b0833c5b2 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:50.308540 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-54f1b675-28bb-443f-b5b9-749b0833c5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:50.327448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:50.370872 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1402/2802] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:50.379390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b957bd9-28e5-42c7-bf5c-ca820f09732e None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:50.379674 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b957bd9-28e5-42c7-bf5c-ca820f09732e None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:50.379947 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b957bd9-28e5-42c7-bf5c-ca820f09732e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:50.399941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-6b957bd9-28e5-42c7-bf5c-ca820f09732e None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:50.401131 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-6b957bd9-28e5-42c7-bf5c-ca820f09732e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:50.409088 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1401/2803] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:50.413302 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1b675-28bb-443f-b5b9-749b0833c5b2 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:50.424495 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1b675-28bb-443f-b5b9-749b0833c5b2 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:50.429864 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f02a4-57eb-4060-8df0-025bfa47480e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:50.430463 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f02a4-57eb-4060-8df0-025bfa47480e admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:50.430743 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f02a4-57eb-4060-8df0-025bfa47480e admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:50.431015 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f02a4-57eb-4060-8df0-025bfa47480e admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:50.431658 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f02a4-57eb-4060-8df0-025bfa47480e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:04:50.431957 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f02a4-57eb-4060-8df0-025bfa47480e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:50.433552 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f02a4-57eb-4060-8df0-025bfa47480e admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:50.445792 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1403/2804] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 05:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:04:50.451164 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b957bd9-28e5-42c7-bf5c-ca820f09732e None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:50.460439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b957bd9-28e5-42c7-bf5c-ca820f09732e None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:50.465053 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e91ac-f861-4a87-ab9d-ca20be4b1c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:50.465988 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e91ac-f861-4a87-ab9d-ca20be4b1c5d admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:50.466291 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e91ac-f861-4a87-ab9d-ca20be4b1c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:50.466569 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e91ac-f861-4a87-ab9d-ca20be4b1c5d admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:50.467202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e91ac-f861-4a87-ab9d-ca20be4b1c5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:50.469134 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e91ac-f861-4a87-ab9d-ca20be4b1c5d admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:50.498687 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1402/2805] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 05:04:50 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:04:50.502925 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f02a4-57eb-4060-8df0-025bfa47480e admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:50.513377 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f02a4-57eb-4060-8df0-025bfa47480e admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:50.569982 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40b544-c017-4bee-9cf1-2460ce9818b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:50.570609 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40b544-c017-4bee-9cf1-2460ce9818b1 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:50.570887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40b544-c017-4bee-9cf1-2460ce9818b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:50.571156 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40b544-c017-4bee-9cf1-2460ce9818b1 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:50.571775 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40b544-c017-4bee-9cf1-2460ce9818b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:50.573684 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40b544-c017-4bee-9cf1-2460ce9818b1 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:50.594724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1404/2806] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 05:04:50 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:04:50.598725 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e91ac-f861-4a87-ab9d-ca20be4b1c5d admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:50.609536 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e91ac-f861-4a87-ab9d-ca20be4b1c5d admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:50.614674 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a092db9-c64f-4f5b-8125-872e02cbdaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:50.615247 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a092db9-c64f-4f5b-8125-872e02cbdaad admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:50.615525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a092db9-c64f-4f5b-8125-872e02cbdaad admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:50.615798 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a092db9-c64f-4f5b-8125-872e02cbdaad admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:50.616439 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a092db9-c64f-4f5b-8125-872e02cbdaad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:50.618055 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a092db9-c64f-4f5b-8125-872e02cbdaad admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:50.628850 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1403/2807] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:04:50.632821 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40b544-c017-4bee-9cf1-2460ce9818b1 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:50.643278 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40b544-c017-4bee-9cf1-2460ce9818b1 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:50.647918 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cb091-a3c4-48d5-aeea-60860abdc961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:50.648521 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cb091-a3c4-48d5-aeea-60860abdc961 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:50.648802 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cb091-a3c4-48d5-aeea-60860abdc961 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:50.649073 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cb091-a3c4-48d5-aeea-60860abdc961 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:50.649748 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5cb091-a3c4-48d5-aeea-60860abdc961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:50.651321 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5cb091-a3c4-48d5-aeea-60860abdc961 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:50.663556 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1405/2808] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:04:50.668111 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a092db9-c64f-4f5b-8125-872e02cbdaad admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:50.679117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a092db9-c64f-4f5b-8125-872e02cbdaad admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:50.683925 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49774b48-0b98-4552-ac5d-ea825a5d5c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:50.685850 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49774b48-0b98-4552-ac5d-ea825a5d5c31 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:50.685850 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49774b48-0b98-4552-ac5d-ea825a5d5c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:50.685850 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49774b48-0b98-4552-ac5d-ea825a5d5c31 admin admin] PATH_INFO: `/v3/projects/0a9ff7a70560440c869d98bd843bcdd1/users/bcf37b04b1484148899a8e52db3e29d0/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:50.701683 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49774b48-0b98-4552-ac5d-ea825a5d5c31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a9ff7a70560440c869d98bd843bcdd1, user_id=bcf37b04b1484148899a8e52db3e29d0, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:50.704465 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49774b48-0b98-4552-ac5d-ea825a5d5c31 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:50.719515 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1404/2809] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:04:50 2022] PUT /identity/v3/projects/0a9ff7a70560440c869d98bd843bcdd1/users/bcf37b04b1484148899a8e52db3e29d0/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:50.730202 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60724361-0d64-43f6-ac38-4116f7cc727b None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:50.730491 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60724361-0d64-43f6-ac38-4116f7cc727b None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:50.730769 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60724361-0d64-43f6-ac38-4116f7cc727b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:50.759700 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-60724361-0d64-43f6-ac38-4116f7cc727b None None] MFA Rules not processed for user `bcf37b04b1484148899a8e52db3e29d0`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:50.760921 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-60724361-0d64-43f6-ac38-4116f7cc727b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:50.825679 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1406/2810] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:04:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:50.836848 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49774b48-0b98-4552-ac5d-ea825a5d5c31 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:50.838804 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-49774b48-0b98-4552-ac5d-ea825a5d5c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:50.853621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:50.916342 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49774b48-0b98-4552-ac5d-ea825a5d5c31 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:50.922674 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e3e18-00f8-499a-85f4-01fa8460808e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:50.923275 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e3e18-00f8-499a-85f4-01fa8460808e service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:50.923552 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e3e18-00f8-499a-85f4-01fa8460808e service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:50.923823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e3e18-00f8-499a-85f4-01fa8460808e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:50.931597 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e3e18-00f8-499a-85f4-01fa8460808e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:50.933153 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e3e18-00f8-499a-85f4-01fa8460808e service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:50.942258 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1405/2811] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:04:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:04:53.635999 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60724361-0d64-43f6-ac38-4116f7cc727b None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:53.653326 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:53.700659 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60724361-0d64-43f6-ac38-4116f7cc727b None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:53.705120 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b003e2c-80bf-4494-85b6-1a4a31e3e1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:53.705803 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b003e2c-80bf-4494-85b6-1a4a31e3e1b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:53.706081 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b003e2c-80bf-4494-85b6-1a4a31e3e1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:53.706348 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b003e2c-80bf-4494-85b6-1a4a31e3e1b9 admin admin] PATH_INFO: `/v3/users/bcf37b04b1484148899a8e52db3e29d0` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:53.707456 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b003e2c-80bf-4494-85b6-1a4a31e3e1b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcf37b04b1484148899a8e52db3e29d0)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:53.709346 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b003e2c-80bf-4494-85b6-1a4a31e3e1b9 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:53.757193 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6b003e2c-80bf-4494-85b6-1a4a31e3e1b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcf37b04b1484148899a8e52db3e29d0'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:53.764988 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6b003e2c-80bf-4494-85b6-1a4a31e3e1b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcf37b04b1484148899a8e52db3e29d0'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:53.771990 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6b003e2c-80bf-4494-85b6-1a4a31e3e1b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcf37b04b1484148899a8e52db3e29d0'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:53.772624 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6b003e2c-80bf-4494-85b6-1a4a31e3e1b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcf37b04b1484148899a8e52db3e29d0'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:53.785004 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6b003e2c-80bf-4494-85b6-1a4a31e3e1b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcf37b04b1484148899a8e52db3e29d0'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:53.790960 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1407/2812] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 05:04:53 2022] DELETE /identity/v3/users/bcf37b04b1484148899a8e52db3e29d0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:53.796024 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b3dd9-9629-48f1-bc9c-344f7da11470 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:53.796551 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b3dd9-9629-48f1-bc9c-344f7da11470 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:53.796551 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b3dd9-9629-48f1-bc9c-344f7da11470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:53.815862 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-bb0b3dd9-9629-48f1-bc9c-344f7da11470 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:53.817105 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-bb0b3dd9-9629-48f1-bc9c-344f7da11470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:53.876122 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1406/2813] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:04:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:53.885675 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b003e2c-80bf-4494-85b6-1a4a31e3e1b9 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:53.887118 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-6b003e2c-80bf-4494-85b6-1a4a31e3e1b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:53.943094 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b003e2c-80bf-4494-85b6-1a4a31e3e1b9 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:53.946718 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efe2f7-def4-4ea5-be99-985c02ea215b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:53.947312 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efe2f7-def4-4ea5-be99-985c02ea215b service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:53.947590 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efe2f7-def4-4ea5-be99-985c02ea215b service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:53.947859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efe2f7-def4-4ea5-be99-985c02ea215b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:53.956734 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efe2f7-def4-4ea5-be99-985c02ea215b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:53.958172 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efe2f7-def4-4ea5-be99-985c02ea215b service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:53.967983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1408/2814] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:04:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:04:54.249246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b3dd9-9629-48f1-bc9c-344f7da11470 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:54.251056 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-bb0b3dd9-9629-48f1-bc9c-344f7da11470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:54.263905 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b3dd9-9629-48f1-bc9c-344f7da11470 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:54.268620 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd506b-21d7-4666-8d21-303285c31672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:54.269254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd506b-21d7-4666-8d21-303285c31672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:54.269565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd506b-21d7-4666-8d21-303285c31672 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:54.269840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd506b-21d7-4666-8d21-303285c31672 admin admin] PATH_INFO: `/v3/projects/0a9ff7a70560440c869d98bd843bcdd1` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:54.270996 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd506b-21d7-4666-8d21-303285c31672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a9ff7a70560440c869d98bd843bcdd1)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:54.272876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd506b-21d7-4666-8d21-303285c31672 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:54.321064 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-afdd506b-21d7-4666-8d21-303285c31672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a9ff7a70560440c869d98bd843bcdd1', 'request_id': 'req-afdd506b-21d7-4666-8d21-303285c31672'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:54.327088 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-afdd506b-21d7-4666-8d21-303285c31672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a9ff7a70560440c869d98bd843bcdd1', 'request_id': 'req-afdd506b-21d7-4666-8d21-303285c31672'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:54.334421 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-afdd506b-21d7-4666-8d21-303285c31672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a9ff7a70560440c869d98bd843bcdd1', 'request_id': 'req-afdd506b-21d7-4666-8d21-303285c31672'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:54.346195 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-afdd506b-21d7-4666-8d21-303285c31672 admin admin] The token cache is being invalidate because project 0a9ff7a70560440c869d98bd843bcdd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:04:54.346484 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-afdd506b-21d7-4666-8d21-303285c31672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:54.347114 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-afdd506b-21d7-4666-8d21-303285c31672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:54.348583 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1407/2815] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 05:04:54 2022] DELETE /identity/v3/projects/0a9ff7a70560440c869d98bd843bcdd1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:54.353511 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82328324-3b55-4a5b-b4d9-7e782153599c None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:54.354170 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82328324-3b55-4a5b-b4d9-7e782153599c None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:54.354448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82328324-3b55-4a5b-b4d9-7e782153599c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:54.374189 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-82328324-3b55-4a5b-b4d9-7e782153599c None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:54.375390 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-82328324-3b55-4a5b-b4d9-7e782153599c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:54.410182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:54.438962 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1409/2816] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:54.448063 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f517426-d190-4cdc-b5d5-5fc811055c66 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:54.448342 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f517426-d190-4cdc-b5d5-5fc811055c66 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:54.448615 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f517426-d190-4cdc-b5d5-5fc811055c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:54.468878 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-7f517426-d190-4cdc-b5d5-5fc811055c66 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:54.470109 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-7f517426-d190-4cdc-b5d5-5fc811055c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:54.477972 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1408/2817] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:54.482359 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82328324-3b55-4a5b-b4d9-7e782153599c None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:54.492092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82328324-3b55-4a5b-b4d9-7e782153599c None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:54.496687 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485985b-de39-4b26-840b-3f487d15d09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:54.497256 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485985b-de39-4b26-840b-3f487d15d09d admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:54.497562 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485985b-de39-4b26-840b-3f487d15d09d admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:54.497834 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485985b-de39-4b26-840b-3f487d15d09d admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:54.498475 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485985b-de39-4b26-840b-3f487d15d09d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:04:54.498777 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485985b-de39-4b26-840b-3f487d15d09d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:54.500347 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485985b-de39-4b26-840b-3f487d15d09d admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:54.511636 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1410/2818] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 05:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:04:54.516861 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f517426-d190-4cdc-b5d5-5fc811055c66 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:54.526244 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f517426-d190-4cdc-b5d5-5fc811055c66 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:54.531604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831d58f-0ff4-4422-a430-9aa5bd6aa7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:54.532194 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831d58f-0ff4-4422-a430-9aa5bd6aa7b1 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:54.532474 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831d58f-0ff4-4422-a430-9aa5bd6aa7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:54.532744 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831d58f-0ff4-4422-a430-9aa5bd6aa7b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:54.533375 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831d58f-0ff4-4422-a430-9aa5bd6aa7b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:54.535290 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831d58f-0ff4-4422-a430-9aa5bd6aa7b1 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:54.551277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:54.565347 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1409/2819] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 05:04:54 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:04:54.569641 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485985b-de39-4b26-840b-3f487d15d09d admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:54.580443 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485985b-de39-4b26-840b-3f487d15d09d admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:54.638304 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705f704-278a-4837-979f-3d3258475844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:54.639027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705f704-278a-4837-979f-3d3258475844 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:54.639477 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705f704-278a-4837-979f-3d3258475844 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:54.639752 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705f704-278a-4837-979f-3d3258475844 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:54.640387 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705f704-278a-4837-979f-3d3258475844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:54.642310 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705f704-278a-4837-979f-3d3258475844 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:54.666714 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1411/2820] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 05:04:54 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:04:54.671300 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831d58f-0ff4-4422-a430-9aa5bd6aa7b1 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:54.681625 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831d58f-0ff4-4422-a430-9aa5bd6aa7b1 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:54.687462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d35f46-03ad-4290-97a9-f0c89c47c4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:54.688068 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d35f46-03ad-4290-97a9-f0c89c47c4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:54.688348 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d35f46-03ad-4290-97a9-f0c89c47c4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:54.688619 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d35f46-03ad-4290-97a9-f0c89c47c4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:54.689308 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d35f46-03ad-4290-97a9-f0c89c47c4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:54.690940 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d35f46-03ad-4290-97a9-f0c89c47c4c9 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:54.701833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1410/2821] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:04:54.705853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705f704-278a-4837-979f-3d3258475844 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:54.716521 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705f704-278a-4837-979f-3d3258475844 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:54.722051 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8461925-bc7c-4e85-9c1a-a09b2dd876c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:54.722675 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8461925-bc7c-4e85-9c1a-a09b2dd876c9 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:54.722956 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8461925-bc7c-4e85-9c1a-a09b2dd876c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:54.723233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8461925-bc7c-4e85-9c1a-a09b2dd876c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:54.723892 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8461925-bc7c-4e85-9c1a-a09b2dd876c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:54.725610 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8461925-bc7c-4e85-9c1a-a09b2dd876c9 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:54.737085 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1412/2822] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:04:54.741298 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d35f46-03ad-4290-97a9-f0c89c47c4c9 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:54.752291 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d35f46-03ad-4290-97a9-f0c89c47c4c9 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:54.756933 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be95ec-ce39-46db-a614-410266304f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:54.757617 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be95ec-ce39-46db-a614-410266304f92 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:54.757898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be95ec-ce39-46db-a614-410266304f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:54.758170 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be95ec-ce39-46db-a614-410266304f92 admin admin] PATH_INFO: `/v3/projects/3b43858d265f4344978b5c44ecadbd6c/users/70fa565789354a65a1b808834e77bf5f/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:54.775514 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be95ec-ce39-46db-a614-410266304f92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b43858d265f4344978b5c44ecadbd6c, user_id=70fa565789354a65a1b808834e77bf5f, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:54.778400 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be95ec-ce39-46db-a614-410266304f92 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:54.795123 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1411/2823] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:04:54 2022] PUT /identity/v3/projects/3b43858d265f4344978b5c44ecadbd6c/users/70fa565789354a65a1b808834e77bf5f/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:54.805616 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ef2f3-074c-48a8-bf94-326c258a0ff1 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:54.805911 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ef2f3-074c-48a8-bf94-326c258a0ff1 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:54.806241 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ef2f3-074c-48a8-bf94-326c258a0ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:54.835161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-6a2ef2f3-074c-48a8-bf94-326c258a0ff1 None None] MFA Rules not processed for user `70fa565789354a65a1b808834e77bf5f`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:54.836392 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-6a2ef2f3-074c-48a8-bf94-326c258a0ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:54.900300 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1413/2824] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:04:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:54.904886 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be95ec-ce39-46db-a614-410266304f92 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:54.967306 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be95ec-ce39-46db-a614-410266304f92 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:54.971881 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f3f1f-d3df-4336-84c0-5e44f6af9957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:54.972479 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f3f1f-d3df-4336-84c0-5e44f6af9957 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:54.972754 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f3f1f-d3df-4336-84c0-5e44f6af9957 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:54.973024 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f3f1f-d3df-4336-84c0-5e44f6af9957 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:54.973673 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f3f1f-d3df-4336-84c0-5e44f6af9957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:54.975548 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f3f1f-d3df-4336-84c0-5e44f6af9957 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:55.004411 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1412/2825] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 05:04:54 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:04:55.008661 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ef2f3-074c-48a8-bf94-326c258a0ff1 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:55.021841 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ef2f3-074c-48a8-bf94-326c258a0ff1 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:55.055397 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:55.081872 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7d757-7e2e-444b-8ecf-ac3fe0dd4432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:55.082889 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7d757-7e2e-444b-8ecf-ac3fe0dd4432 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:55.083389 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7d757-7e2e-444b-8ecf-ac3fe0dd4432 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:55.083859 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7d757-7e2e-444b-8ecf-ac3fe0dd4432 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:55.085006 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7d757-7e2e-444b-8ecf-ac3fe0dd4432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:55.088774 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7d757-7e2e-444b-8ecf-ac3fe0dd4432 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:55.114204 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1414/2826] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 05:04:55 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:04:55.118449 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f3f1f-d3df-4336-84c0-5e44f6af9957 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:55.129444 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f3f1f-d3df-4336-84c0-5e44f6af9957 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:55.134335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4e2b8-9ce9-463e-a9e4-2c8c79b81db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:55.134934 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4e2b8-9ce9-463e-a9e4-2c8c79b81db6 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:55.135240 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4e2b8-9ce9-463e-a9e4-2c8c79b81db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:55.135492 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4e2b8-9ce9-463e-a9e4-2c8c79b81db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:55.136137 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4e2b8-9ce9-463e-a9e4-2c8c79b81db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:55.138086 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4e2b8-9ce9-463e-a9e4-2c8c79b81db6 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:55.149091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1413/2827] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:04:55.153280 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7d757-7e2e-444b-8ecf-ac3fe0dd4432 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:55.163425 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7d757-7e2e-444b-8ecf-ac3fe0dd4432 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:55.168147 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496874ed-ce6b-4a6b-9863-75450bedbf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:55.169493 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496874ed-ce6b-4a6b-9863-75450bedbf28 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:55.169785 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496874ed-ce6b-4a6b-9863-75450bedbf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:55.170060 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496874ed-ce6b-4a6b-9863-75450bedbf28 admin admin] PATH_INFO: `/v3/projects/8b07fa3935914ab0a12b75b95a3487b4/users/9c41983a31d9464cbcfae582e29b40f4/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:55.186171 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496874ed-ce6b-4a6b-9863-75450bedbf28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b07fa3935914ab0a12b75b95a3487b4, user_id=9c41983a31d9464cbcfae582e29b40f4, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:55.188796 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496874ed-ce6b-4a6b-9863-75450bedbf28 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:55.201904 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1415/2828] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:04:55 2022] PUT /identity/v3/projects/8b07fa3935914ab0a12b75b95a3487b4/users/9c41983a31d9464cbcfae582e29b40f4/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:55.205902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4e2b8-9ce9-463e-a9e4-2c8c79b81db6 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:55.215929 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4e2b8-9ce9-463e-a9e4-2c8c79b81db6 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:55.272415 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ef251-ea08-40bc-90e6-869feff8ec68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:55.273012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ef251-ea08-40bc-90e6-869feff8ec68 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:55.273288 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ef251-ea08-40bc-90e6-869feff8ec68 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:55.273587 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ef251-ea08-40bc-90e6-869feff8ec68 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:55.274229 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ef251-ea08-40bc-90e6-869feff8ec68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:55.275824 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ef251-ea08-40bc-90e6-869feff8ec68 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:55.285675 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1414/2829] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:04:55.289936 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496874ed-ce6b-4a6b-9863-75450bedbf28 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:55.300984 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496874ed-ce6b-4a6b-9863-75450bedbf28 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:55.305550 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35078c7-c489-4872-a3dc-ff0c0523db87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:55.306205 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35078c7-c489-4872-a3dc-ff0c0523db87 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:55.306486 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35078c7-c489-4872-a3dc-ff0c0523db87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:55.306762 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35078c7-c489-4872-a3dc-ff0c0523db87 admin admin] PATH_INFO: `/v3/projects/8b07fa3935914ab0a12b75b95a3487b4/users/9c41983a31d9464cbcfae582e29b40f4/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:55.308662 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35078c7-c489-4872-a3dc-ff0c0523db87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b07fa3935914ab0a12b75b95a3487b4, user_id=9c41983a31d9464cbcfae582e29b40f4, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:55.312019 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35078c7-c489-4872-a3dc-ff0c0523db87 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:55.322302 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1416/2830] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:04:55 2022] PUT /identity/v3/projects/8b07fa3935914ab0a12b75b95a3487b4/users/9c41983a31d9464cbcfae582e29b40f4/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:55.333058 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283fb2b-be5f-4681-b2a2-3bdb84534d07 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:55.333344 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283fb2b-be5f-4681-b2a2-3bdb84534d07 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:55.333664 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283fb2b-be5f-4681-b2a2-3bdb84534d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:55.361730 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-c283fb2b-be5f-4681-b2a2-3bdb84534d07 None None] MFA Rules not processed for user `9c41983a31d9464cbcfae582e29b40f4`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:55.362924 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-c283fb2b-be5f-4681-b2a2-3bdb84534d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:55.379992 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:55.435216 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1415/2831] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:04:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:55.446868 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35078c7-c489-4872-a3dc-ff0c0523db87 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:55.448594 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-b35078c7-c489-4872-a3dc-ff0c0523db87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:55.507533 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35078c7-c489-4872-a3dc-ff0c0523db87 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:55.511117 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a64af7-f993-412d-aa89-9fbf8efe6c5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:55.511719 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a64af7-f993-412d-aa89-9fbf8efe6c5f service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:55.511995 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a64af7-f993-412d-aa89-9fbf8efe6c5f service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:55.512808 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a64af7-f993-412d-aa89-9fbf8efe6c5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:55.521918 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a64af7-f993-412d-aa89-9fbf8efe6c5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:55.523371 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a64af7-f993-412d-aa89-9fbf8efe6c5f service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:55.532696 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1417/2832] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:04:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:04:55.608621 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283fb2b-be5f-4681-b2a2-3bdb84534d07 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:55.618480 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283fb2b-be5f-4681-b2a2-3bdb84534d07 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:55.622572 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d69940-4c4f-4bf9-856b-3a14936f6c26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:55.623160 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d69940-4c4f-4bf9-856b-3a14936f6c26 service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:55.623438 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d69940-4c4f-4bf9-856b-3a14936f6c26 service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:55.623705 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d69940-4c4f-4bf9-856b-3a14936f6c26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:55.680767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d69940-4c4f-4bf9-856b-3a14936f6c26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:55.682282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d69940-4c4f-4bf9-856b-3a14936f6c26 service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:55.692021 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1416/2833] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:04:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:05:02.494390 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a64af7-f993-412d-aa89-9fbf8efe6c5f service cinder] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:02.556144 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a64af7-f993-412d-aa89-9fbf8efe6c5f service cinder] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:02.560702 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a6ce9-afac-42b0-bca1-8ae2033e06de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:02.561326 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a6ce9-afac-42b0-bca1-8ae2033e06de admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:02.562319 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a6ce9-afac-42b0-bca1-8ae2033e06de admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:02.562673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a6ce9-afac-42b0-bca1-8ae2033e06de admin admin] PATH_INFO: `/v3/users/70fa565789354a65a1b808834e77bf5f` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:02.563826 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a6ce9-afac-42b0-bca1-8ae2033e06de admin admin] RBAC: Authorizing `identity:delete_user(user_id=70fa565789354a65a1b808834e77bf5f)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:02.565757 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a6ce9-afac-42b0-bca1-8ae2033e06de admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:02.599113 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:02.613332 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-d80a6ce9-afac-42b0-bca1-8ae2033e06de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70fa565789354a65a1b808834e77bf5f'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:02.621683 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-d80a6ce9-afac-42b0-bca1-8ae2033e06de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70fa565789354a65a1b808834e77bf5f'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:02.629434 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-d80a6ce9-afac-42b0-bca1-8ae2033e06de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70fa565789354a65a1b808834e77bf5f'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:02.630125 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-d80a6ce9-afac-42b0-bca1-8ae2033e06de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70fa565789354a65a1b808834e77bf5f'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:02.642377 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-d80a6ce9-afac-42b0-bca1-8ae2033e06de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70fa565789354a65a1b808834e77bf5f'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:02.648331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1418/2834] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 05:05:02 2022] DELETE /identity/v3/users/70fa565789354a65a1b808834e77bf5f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:05:02.652866 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b0ec3-02fb-41c1-ad4e-2da770ff7aee None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:02.653386 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b0ec3-02fb-41c1-ad4e-2da770ff7aee None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:02.653386 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b0ec3-02fb-41c1-ad4e-2da770ff7aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:02.672919 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-ea6b0ec3-02fb-41c1-ad4e-2da770ff7aee None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:02.674390 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-ea6b0ec3-02fb-41c1-ad4e-2da770ff7aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:02.735066 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1417/2835] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:05:02.744834 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a6ce9-afac-42b0-bca1-8ae2033e06de admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:02.746267 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-d80a6ce9-afac-42b0-bca1-8ae2033e06de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:02.803557 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a6ce9-afac-42b0-bca1-8ae2033e06de admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:02.807307 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584134b-555f-4349-8994-bd1c74a6aafd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:02.807947 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584134b-555f-4349-8994-bd1c74a6aafd service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:02.808229 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584134b-555f-4349-8994-bd1c74a6aafd service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:02.808503 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584134b-555f-4349-8994-bd1c74a6aafd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:02.818253 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584134b-555f-4349-8994-bd1c74a6aafd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:02.819656 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584134b-555f-4349-8994-bd1c74a6aafd service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:02.828817 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1419/2836] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:05:03.092423 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b0ec3-02fb-41c1-ad4e-2da770ff7aee None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:03.094763 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-ea6b0ec3-02fb-41c1-ad4e-2da770ff7aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:03.107250 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b0ec3-02fb-41c1-ad4e-2da770ff7aee None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:03.113125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681fd30-6d09-4f35-bedf-cbd55d305209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:03.113882 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681fd30-6d09-4f35-bedf-cbd55d305209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:03.114254 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681fd30-6d09-4f35-bedf-cbd55d305209 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:03.115067 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681fd30-6d09-4f35-bedf-cbd55d305209 admin admin] PATH_INFO: `/v3/projects/3b43858d265f4344978b5c44ecadbd6c` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:03.115811 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681fd30-6d09-4f35-bedf-cbd55d305209 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b43858d265f4344978b5c44ecadbd6c)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:03.117849 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681fd30-6d09-4f35-bedf-cbd55d305209 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:03.169391 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:03.171696 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a681fd30-6d09-4f35-bedf-cbd55d305209 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b43858d265f4344978b5c44ecadbd6c', 'request_id': 'req-a681fd30-6d09-4f35-bedf-cbd55d305209'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:03.178353 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a681fd30-6d09-4f35-bedf-cbd55d305209 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b43858d265f4344978b5c44ecadbd6c', 'request_id': 'req-a681fd30-6d09-4f35-bedf-cbd55d305209'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:03.186027 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a681fd30-6d09-4f35-bedf-cbd55d305209 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b43858d265f4344978b5c44ecadbd6c', 'request_id': 'req-a681fd30-6d09-4f35-bedf-cbd55d305209'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:03.197734 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a681fd30-6d09-4f35-bedf-cbd55d305209 admin admin] The token cache is being invalidate because project 3b43858d265f4344978b5c44ecadbd6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:05:03.198018 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a681fd30-6d09-4f35-bedf-cbd55d305209 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:03.198637 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a681fd30-6d09-4f35-bedf-cbd55d305209 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:03.200122 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1418/2837] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 05:05:03 2022] DELETE /identity/v3/projects/3b43858d265f4344978b5c44ecadbd6c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:05:03.204386 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584134b-555f-4349-8994-bd1c74a6aafd service neutron] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:03.214049 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584134b-555f-4349-8994-bd1c74a6aafd service neutron] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:03.272225 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6eea3-26f1-496f-ab86-f569012f46d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:03.272882 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6eea3-26f1-496f-ab86-f569012f46d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:03.273166 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6eea3-26f1-496f-ab86-f569012f46d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:03.273471 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6eea3-26f1-496f-ab86-f569012f46d3 admin admin] PATH_INFO: `/v3/users/9c41983a31d9464cbcfae582e29b40f4` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:03.274649 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6eea3-26f1-496f-ab86-f569012f46d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c41983a31d9464cbcfae582e29b40f4)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:03.276580 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6eea3-26f1-496f-ab86-f569012f46d3 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:03.323164 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-90b6eea3-26f1-496f-ab86-f569012f46d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c41983a31d9464cbcfae582e29b40f4'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:03.330647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-90b6eea3-26f1-496f-ab86-f569012f46d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c41983a31d9464cbcfae582e29b40f4'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:03.332171 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:03.341203 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-90b6eea3-26f1-496f-ab86-f569012f46d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c41983a31d9464cbcfae582e29b40f4'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:03.341899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-90b6eea3-26f1-496f-ab86-f569012f46d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c41983a31d9464cbcfae582e29b40f4'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:03.354015 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-90b6eea3-26f1-496f-ab86-f569012f46d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c41983a31d9464cbcfae582e29b40f4'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:03.361267 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1420/2838] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 05:05:03 2022] DELETE /identity/v3/users/9c41983a31d9464cbcfae582e29b40f4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:05:03.636962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681fd30-6d09-4f35-bedf-cbd55d305209 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:03.638658 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-a681fd30-6d09-4f35-bedf-cbd55d305209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:03.652538 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681fd30-6d09-4f35-bedf-cbd55d305209 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:03.716185 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a20be-bc85-4955-8836-0de6799fc943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:03.716836 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a20be-bc85-4955-8836-0de6799fc943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:03.717117 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a20be-bc85-4955-8836-0de6799fc943 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:03.717394 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a20be-bc85-4955-8836-0de6799fc943 admin admin] PATH_INFO: `/v3/projects/8b07fa3935914ab0a12b75b95a3487b4` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:03.719098 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a20be-bc85-4955-8836-0de6799fc943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b07fa3935914ab0a12b75b95a3487b4)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:03.720990 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a20be-bc85-4955-8836-0de6799fc943 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:03.768269 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-1c5a20be-bc85-4955-8836-0de6799fc943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b07fa3935914ab0a12b75b95a3487b4', 'request_id': 'req-1c5a20be-bc85-4955-8836-0de6799fc943'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:03.773721 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-1c5a20be-bc85-4955-8836-0de6799fc943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b07fa3935914ab0a12b75b95a3487b4', 'request_id': 'req-1c5a20be-bc85-4955-8836-0de6799fc943'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:03.781486 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-1c5a20be-bc85-4955-8836-0de6799fc943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b07fa3935914ab0a12b75b95a3487b4', 'request_id': 'req-1c5a20be-bc85-4955-8836-0de6799fc943'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:03.792759 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-1c5a20be-bc85-4955-8836-0de6799fc943 admin admin] The token cache is being invalidate because project 8b07fa3935914ab0a12b75b95a3487b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:05:03.793044 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-1c5a20be-bc85-4955-8836-0de6799fc943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:03.793711 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-1c5a20be-bc85-4955-8836-0de6799fc943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:03.795219 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1419/2839] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 05:05:03 2022] DELETE /identity/v3/projects/8b07fa3935914ab0a12b75b95a3487b4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:05:03.801751 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22d346-8475-40d2-b575-725e1f58906c None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:03.802281 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22d346-8475-40d2-b575-725e1f58906c None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:03.802382 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22d346-8475-40d2-b575-725e1f58906c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:03.822008 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-0e22d346-8475-40d2-b575-725e1f58906c None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:03.823223 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-0e22d346-8475-40d2-b575-725e1f58906c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:03.883182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1421/2840] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:03.891674 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61be3a3-2be0-485a-abc7-166233b95f9b None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:03.891959 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61be3a3-2be0-485a-abc7-166233b95f9b None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:03.892237 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61be3a3-2be0-485a-abc7-166233b95f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:03.912761 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-d61be3a3-2be0-485a-abc7-166233b95f9b None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:03.914138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-d61be3a3-2be0-485a-abc7-166233b95f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:03.923104 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1420/2841] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:03.927306 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22d346-8475-40d2-b575-725e1f58906c None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:03.936992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22d346-8475-40d2-b575-725e1f58906c None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:03.941452 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b4632-075d-4e10-ad10-03ef49d3393c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:03.942047 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b4632-075d-4e10-ad10-03ef49d3393c admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:03.942320 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b4632-075d-4e10-ad10-03ef49d3393c admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:03.942588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b4632-075d-4e10-ad10-03ef49d3393c admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:03.943228 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b4632-075d-4e10-ad10-03ef49d3393c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:05:03.943550 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b4632-075d-4e10-ad10-03ef49d3393c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:03.945200 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b4632-075d-4e10-ad10-03ef49d3393c admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:03.957133 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1422/2842] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 05:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:05:03.961478 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61be3a3-2be0-485a-abc7-166233b95f9b None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:03.971726 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61be3a3-2be0-485a-abc7-166233b95f9b None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:03.976365 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f0cf2-2d4c-4a03-8658-f7f68a6b39a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:03.976962 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f0cf2-2d4c-4a03-8658-f7f68a6b39a9 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:03.977241 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f0cf2-2d4c-4a03-8658-f7f68a6b39a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:03.977558 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f0cf2-2d4c-4a03-8658-f7f68a6b39a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:03.978204 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f0cf2-2d4c-4a03-8658-f7f68a6b39a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:03.980083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f0cf2-2d4c-4a03-8658-f7f68a6b39a9 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:04.007805 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1421/2843] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 05:05:03 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:05:04.011990 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b4632-075d-4e10-ad10-03ef49d3393c admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:04.022918 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b4632-075d-4e10-ad10-03ef49d3393c admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:04.080142 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7d4cc-62f4-4340-956b-0e76f43059ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:04.080744 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7d4cc-62f4-4340-956b-0e76f43059ce admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:04.081027 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7d4cc-62f4-4340-956b-0e76f43059ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:04.081299 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7d4cc-62f4-4340-956b-0e76f43059ce admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:04.081967 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7d4cc-62f4-4340-956b-0e76f43059ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:04.083889 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7d4cc-62f4-4340-956b-0e76f43059ce admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:04.105664 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1423/2844] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 05:05:04 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:05:04.109968 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f0cf2-2d4c-4a03-8658-f7f68a6b39a9 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:04.121321 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f0cf2-2d4c-4a03-8658-f7f68a6b39a9 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:04.127907 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f4f38-e191-4c1b-9982-ee0236a86bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:04.128671 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f4f38-e191-4c1b-9982-ee0236a86bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:04.128973 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f4f38-e191-4c1b-9982-ee0236a86bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:04.129227 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f4f38-e191-4c1b-9982-ee0236a86bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:04.129928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f4f38-e191-4c1b-9982-ee0236a86bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:04.131824 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f4f38-e191-4c1b-9982-ee0236a86bd1 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:04.143014 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1422/2845] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:05:04.147053 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7d4cc-62f4-4340-956b-0e76f43059ce admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:04.157770 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7d4cc-62f4-4340-956b-0e76f43059ce admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:04.162456 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e89fd2-9a03-468b-983b-e30d4a997d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:04.163075 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e89fd2-9a03-468b-983b-e30d4a997d79 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:04.163341 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e89fd2-9a03-468b-983b-e30d4a997d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:04.163613 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e89fd2-9a03-468b-983b-e30d4a997d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:04.164258 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e89fd2-9a03-468b-983b-e30d4a997d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:04.165874 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e89fd2-9a03-468b-983b-e30d4a997d79 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:04.176903 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1424/2846] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:05:04.181016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f4f38-e191-4c1b-9982-ee0236a86bd1 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:04.190958 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f4f38-e191-4c1b-9982-ee0236a86bd1 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:04.195487 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05f9ca-2cc3-4892-adf5-6407b591ac32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:04.196119 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05f9ca-2cc3-4892-adf5-6407b591ac32 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:04.196398 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05f9ca-2cc3-4892-adf5-6407b591ac32 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:04.196665 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05f9ca-2cc3-4892-adf5-6407b591ac32 admin admin] PATH_INFO: `/v3/projects/f71196c439b947b09f4942d69174b63c/users/1b246e15dafe4052a0c834b4b6535d09/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:04.211897 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05f9ca-2cc3-4892-adf5-6407b591ac32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f71196c439b947b09f4942d69174b63c, user_id=1b246e15dafe4052a0c834b4b6535d09, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:04.214550 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05f9ca-2cc3-4892-adf5-6407b591ac32 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:04.228653 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1423/2847] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:05:04 2022] PUT /identity/v3/projects/f71196c439b947b09f4942d69174b63c/users/1b246e15dafe4052a0c834b4b6535d09/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:05:04.239329 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584a032-4b23-4d73-83fd-e2305eff4c5c None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:04.239617 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584a032-4b23-4d73-83fd-e2305eff4c5c None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:04.239894 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584a032-4b23-4d73-83fd-e2305eff4c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:04.267744 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-1584a032-4b23-4d73-83fd-e2305eff4c5c None None] MFA Rules not processed for user `1b246e15dafe4052a0c834b4b6535d09`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:04.268951 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-1584a032-4b23-4d73-83fd-e2305eff4c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:04.295155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:04.336052 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1425/2848] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:05:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:04.340533 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05f9ca-2cc3-4892-adf5-6407b591ac32 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:04.345153 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:04.406138 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05f9ca-2cc3-4892-adf5-6407b591ac32 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:04.410757 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a8577-1797-4a8c-92e6-a280e8782dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:04.411351 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a8577-1797-4a8c-92e6-a280e8782dad admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:04.411629 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a8577-1797-4a8c-92e6-a280e8782dad admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:04.411898 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a8577-1797-4a8c-92e6-a280e8782dad admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:04.412529 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a8577-1797-4a8c-92e6-a280e8782dad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:04.414463 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a8577-1797-4a8c-92e6-a280e8782dad admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:04.440712 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1424/2849] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 05:05:04 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:05:04.444884 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584a032-4b23-4d73-83fd-e2305eff4c5c None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:04.456420 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584a032-4b23-4d73-83fd-e2305eff4c5c None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:04.513498 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7c32c-a9eb-4fe3-b133-d4f6c4a12003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:04.514032 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7c32c-a9eb-4fe3-b133-d4f6c4a12003 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:04.515255 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7c32c-a9eb-4fe3-b133-d4f6c4a12003 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:04.515738 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7c32c-a9eb-4fe3-b133-d4f6c4a12003 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:04.516467 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7c32c-a9eb-4fe3-b133-d4f6c4a12003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:04.518404 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7c32c-a9eb-4fe3-b133-d4f6c4a12003 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:04.540366 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1426/2850] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 05:05:04 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:05:04.544401 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a8577-1797-4a8c-92e6-a280e8782dad admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:04.555121 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a8577-1797-4a8c-92e6-a280e8782dad admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:04.559776 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5a7b5-9cab-4569-bad5-f28b60193185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:04.560372 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5a7b5-9cab-4569-bad5-f28b60193185 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:04.560654 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5a7b5-9cab-4569-bad5-f28b60193185 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:04.560928 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5a7b5-9cab-4569-bad5-f28b60193185 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:04.562176 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5a7b5-9cab-4569-bad5-f28b60193185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:04.563985 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5a7b5-9cab-4569-bad5-f28b60193185 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:04.574427 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1425/2851] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:05:04.579814 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7c32c-a9eb-4fe3-b133-d4f6c4a12003 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:04.589925 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7c32c-a9eb-4fe3-b133-d4f6c4a12003 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:04.594854 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb083d-065f-4915-913d-a5de3ad24664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:04.595501 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb083d-065f-4915-913d-a5de3ad24664 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:04.595784 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb083d-065f-4915-913d-a5de3ad24664 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:04.596057 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb083d-065f-4915-913d-a5de3ad24664 admin admin] PATH_INFO: `/v3/projects/7fc04da27ab1442b94fa996b68f00eb0/users/bf6fddde1bf8466fb42870eaac80be93/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:04.611298 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb083d-065f-4915-913d-a5de3ad24664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc04da27ab1442b94fa996b68f00eb0, user_id=bf6fddde1bf8466fb42870eaac80be93, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:04.613965 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb083d-065f-4915-913d-a5de3ad24664 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:04.627877 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1427/2852] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:05:04 2022] PUT /identity/v3/projects/7fc04da27ab1442b94fa996b68f00eb0/users/bf6fddde1bf8466fb42870eaac80be93/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:05:04.632769 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5a7b5-9cab-4569-bad5-f28b60193185 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:04.644763 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5a7b5-9cab-4569-bad5-f28b60193185 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:04.706522 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2362f6f-3cc6-46ce-b1d2-d4db431de6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:04.707145 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2362f6f-3cc6-46ce-b1d2-d4db431de6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:04.707420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2362f6f-3cc6-46ce-b1d2-d4db431de6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:04.707683 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2362f6f-3cc6-46ce-b1d2-d4db431de6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:04.708325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2362f6f-3cc6-46ce-b1d2-d4db431de6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:04.710041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2362f6f-3cc6-46ce-b1d2-d4db431de6f9 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:04.720632 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1426/2853] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:05:04.724772 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb083d-065f-4915-913d-a5de3ad24664 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:04.735607 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb083d-065f-4915-913d-a5de3ad24664 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:04.740570 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81435444-936a-4e8d-af3d-3074f860657b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:04.741216 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81435444-936a-4e8d-af3d-3074f860657b admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:04.741532 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81435444-936a-4e8d-af3d-3074f860657b admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:04.741811 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81435444-936a-4e8d-af3d-3074f860657b admin admin] PATH_INFO: `/v3/projects/7fc04da27ab1442b94fa996b68f00eb0/users/bf6fddde1bf8466fb42870eaac80be93/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:04.743724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81435444-936a-4e8d-af3d-3074f860657b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc04da27ab1442b94fa996b68f00eb0, user_id=bf6fddde1bf8466fb42870eaac80be93, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:04.746349 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81435444-936a-4e8d-af3d-3074f860657b admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:04.757493 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1428/2854] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:05:04 2022] PUT /identity/v3/projects/7fc04da27ab1442b94fa996b68f00eb0/users/bf6fddde1bf8466fb42870eaac80be93/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:05:04.823453 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfc194-0f1d-48a7-8d13-16b4150a637f None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:04.823762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfc194-0f1d-48a7-8d13-16b4150a637f None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:04.824030 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfc194-0f1d-48a7-8d13-16b4150a637f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:04.851710 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-64dfc194-0f1d-48a7-8d13-16b4150a637f None None] MFA Rules not processed for user `bf6fddde1bf8466fb42870eaac80be93`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:04.852911 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-64dfc194-0f1d-48a7-8d13-16b4150a637f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:04.915077 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:04.926119 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1427/2855] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:05:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:04.934154 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81435444-936a-4e8d-af3d-3074f860657b admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:04.935851 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-81435444-936a-4e8d-af3d-3074f860657b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:04.996282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81435444-936a-4e8d-af3d-3074f860657b admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:05.000502 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267e15e-e29b-4e0f-aed1-597317e3d57d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:05.001104 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267e15e-e29b-4e0f-aed1-597317e3d57d service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:05.001380 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267e15e-e29b-4e0f-aed1-597317e3d57d service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:05.001676 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267e15e-e29b-4e0f-aed1-597317e3d57d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:05.032795 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:05.059050 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267e15e-e29b-4e0f-aed1-597317e3d57d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:05.060469 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267e15e-e29b-4e0f-aed1-597317e3d57d service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:05.069963 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1429/2856] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:05:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:05:06.430167 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfc194-0f1d-48a7-8d13-16b4150a637f None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:06.431548 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-64dfc194-0f1d-48a7-8d13-16b4150a637f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:06.444967 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfc194-0f1d-48a7-8d13-16b4150a637f None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:06.448172 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333f28a-c06b-4cd6-8dbc-323cdeb05947 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:06.448764 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333f28a-c06b-4cd6-8dbc-323cdeb05947 service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:06.449045 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333f28a-c06b-4cd6-8dbc-323cdeb05947 service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:06.449318 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333f28a-c06b-4cd6-8dbc-323cdeb05947 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:06.458526 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333f28a-c06b-4cd6-8dbc-323cdeb05947 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:06.459948 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333f28a-c06b-4cd6-8dbc-323cdeb05947 service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:06.469448 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1428/2857] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:05:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:05:10.228824 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267e15e-e29b-4e0f-aed1-597317e3d57d service cinder] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:10.291022 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267e15e-e29b-4e0f-aed1-597317e3d57d service cinder] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:10.295462 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079c0f5-9a1a-4f07-a0cb-df699d9946f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:10.296232 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079c0f5-9a1a-4f07-a0cb-df699d9946f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:10.296510 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079c0f5-9a1a-4f07-a0cb-df699d9946f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:10.296784 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079c0f5-9a1a-4f07-a0cb-df699d9946f6 admin admin] PATH_INFO: `/v3/users/1b246e15dafe4052a0c834b4b6535d09` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:10.297921 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079c0f5-9a1a-4f07-a0cb-df699d9946f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b246e15dafe4052a0c834b4b6535d09)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:10.299809 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079c0f5-9a1a-4f07-a0cb-df699d9946f6 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:10.346098 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-a079c0f5-9a1a-4f07-a0cb-df699d9946f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b246e15dafe4052a0c834b4b6535d09'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:10.353853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-a079c0f5-9a1a-4f07-a0cb-df699d9946f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b246e15dafe4052a0c834b4b6535d09'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:10.360683 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-a079c0f5-9a1a-4f07-a0cb-df699d9946f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b246e15dafe4052a0c834b4b6535d09'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:10.361326 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-a079c0f5-9a1a-4f07-a0cb-df699d9946f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b246e15dafe4052a0c834b4b6535d09'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:10.372980 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-a079c0f5-9a1a-4f07-a0cb-df699d9946f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b246e15dafe4052a0c834b4b6535d09'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:10.380942 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1430/2858] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 05:05:10 2022] DELETE /identity/v3/users/1b246e15dafe4052a0c834b4b6535d09 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:05:10.385586 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7916b5-a134-4fe4-af85-196b142443b7 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:10.386085 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7916b5-a134-4fe4-af85-196b142443b7 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:10.386202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7916b5-a134-4fe4-af85-196b142443b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:10.406319 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-3a7916b5-a134-4fe4-af85-196b142443b7 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:10.407536 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-3a7916b5-a134-4fe4-af85-196b142443b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:10.470989 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1429/2859] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:10.481166 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079c0f5-9a1a-4f07-a0cb-df699d9946f6 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:10.482652 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-a079c0f5-9a1a-4f07-a0cb-df699d9946f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:10.541214 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079c0f5-9a1a-4f07-a0cb-df699d9946f6 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:10.545078 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb644c1-1594-4b70-bd05-25efa1bdd80d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:10.545767 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb644c1-1594-4b70-bd05-25efa1bdd80d service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:10.546226 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb644c1-1594-4b70-bd05-25efa1bdd80d service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:10.546702 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb644c1-1594-4b70-bd05-25efa1bdd80d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:10.554120 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:10.556890 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb644c1-1594-4b70-bd05-25efa1bdd80d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:10.558842 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb644c1-1594-4b70-bd05-25efa1bdd80d service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:10.570867 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1431/2860] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:05:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:05:10.849068 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7916b5-a134-4fe4-af85-196b142443b7 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:10.850504 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-3a7916b5-a134-4fe4-af85-196b142443b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:10.863249 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7916b5-a134-4fe4-af85-196b142443b7 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:10.868012 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44307f5e-9107-4d26-afa4-bc176a7ff0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:10.868640 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44307f5e-9107-4d26-afa4-bc176a7ff0d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:10.868917 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44307f5e-9107-4d26-afa4-bc176a7ff0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:10.869210 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44307f5e-9107-4d26-afa4-bc176a7ff0d0 admin admin] PATH_INFO: `/v3/projects/f71196c439b947b09f4942d69174b63c` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:10.870510 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44307f5e-9107-4d26-afa4-bc176a7ff0d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f71196c439b947b09f4942d69174b63c)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:10.872523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44307f5e-9107-4d26-afa4-bc176a7ff0d0 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:10.919846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-44307f5e-9107-4d26-afa4-bc176a7ff0d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f71196c439b947b09f4942d69174b63c', 'request_id': 'req-44307f5e-9107-4d26-afa4-bc176a7ff0d0'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:10.925941 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-44307f5e-9107-4d26-afa4-bc176a7ff0d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f71196c439b947b09f4942d69174b63c', 'request_id': 'req-44307f5e-9107-4d26-afa4-bc176a7ff0d0'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:10.933295 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-44307f5e-9107-4d26-afa4-bc176a7ff0d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f71196c439b947b09f4942d69174b63c', 'request_id': 'req-44307f5e-9107-4d26-afa4-bc176a7ff0d0'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:10.945116 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-44307f5e-9107-4d26-afa4-bc176a7ff0d0 admin admin] The token cache is being invalidate because project f71196c439b947b09f4942d69174b63c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:05:10.945422 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-44307f5e-9107-4d26-afa4-bc176a7ff0d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:10.946083 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-44307f5e-9107-4d26-afa4-bc176a7ff0d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:10.947573 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1430/2861] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 05:05:10 2022] DELETE /identity/v3/projects/f71196c439b947b09f4942d69174b63c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:05:10.951771 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb644c1-1594-4b70-bd05-25efa1bdd80d service neutron] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:10.961931 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb644c1-1594-4b70-bd05-25efa1bdd80d service neutron] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:11.019690 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20918488-6e57-4595-949a-ab4ecf0beebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:11.020331 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20918488-6e57-4595-949a-ab4ecf0beebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:11.020637 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20918488-6e57-4595-949a-ab4ecf0beebc admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:11.020899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20918488-6e57-4595-949a-ab4ecf0beebc admin admin] PATH_INFO: `/v3/users/bf6fddde1bf8466fb42870eaac80be93` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:11.022054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20918488-6e57-4595-949a-ab4ecf0beebc admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf6fddde1bf8466fb42870eaac80be93)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:11.023960 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20918488-6e57-4595-949a-ab4ecf0beebc admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:11.070550 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-20918488-6e57-4595-949a-ab4ecf0beebc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf6fddde1bf8466fb42870eaac80be93'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:11.077964 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-20918488-6e57-4595-949a-ab4ecf0beebc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf6fddde1bf8466fb42870eaac80be93'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:11.084888 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-20918488-6e57-4595-949a-ab4ecf0beebc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf6fddde1bf8466fb42870eaac80be93'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:11.085564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-20918488-6e57-4595-949a-ab4ecf0beebc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf6fddde1bf8466fb42870eaac80be93'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:11.098236 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-20918488-6e57-4595-949a-ab4ecf0beebc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf6fddde1bf8466fb42870eaac80be93'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:11.104092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1432/2862] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 05:05:10 2022] DELETE /identity/v3/users/bf6fddde1bf8466fb42870eaac80be93 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:05:11.394525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44307f5e-9107-4d26-afa4-bc176a7ff0d0 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:11.396135 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-44307f5e-9107-4d26-afa4-bc176a7ff0d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:11.411355 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44307f5e-9107-4d26-afa4-bc176a7ff0d0 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:11.470604 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1b3b5-bac5-4301-9574-4d66e1a08dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:11.471233 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1b3b5-bac5-4301-9574-4d66e1a08dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:11.471511 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1b3b5-bac5-4301-9574-4d66e1a08dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:11.471776 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1b3b5-bac5-4301-9574-4d66e1a08dd3 admin admin] PATH_INFO: `/v3/projects/7fc04da27ab1442b94fa996b68f00eb0` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:11.472925 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1b3b5-bac5-4301-9574-4d66e1a08dd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fc04da27ab1442b94fa996b68f00eb0)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:11.474841 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1b3b5-bac5-4301-9574-4d66e1a08dd3 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:11.485947 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:11.523998 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-f0b1b3b5-bac5-4301-9574-4d66e1a08dd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fc04da27ab1442b94fa996b68f00eb0', 'request_id': 'req-f0b1b3b5-bac5-4301-9574-4d66e1a08dd3'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:11.529287 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-f0b1b3b5-bac5-4301-9574-4d66e1a08dd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fc04da27ab1442b94fa996b68f00eb0', 'request_id': 'req-f0b1b3b5-bac5-4301-9574-4d66e1a08dd3'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:11.537434 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-f0b1b3b5-bac5-4301-9574-4d66e1a08dd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fc04da27ab1442b94fa996b68f00eb0', 'request_id': 'req-f0b1b3b5-bac5-4301-9574-4d66e1a08dd3'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:11.549679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-f0b1b3b5-bac5-4301-9574-4d66e1a08dd3 admin admin] The token cache is being invalidate because project 7fc04da27ab1442b94fa996b68f00eb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:05:11.549930 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-f0b1b3b5-bac5-4301-9574-4d66e1a08dd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:11.550585 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-f0b1b3b5-bac5-4301-9574-4d66e1a08dd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:11.552070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1431/2863] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 05:05:11 2022] DELETE /identity/v3/projects/7fc04da27ab1442b94fa996b68f00eb0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:05:11.556985 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba24dc-cc96-457e-b49d-fc43c459e85a None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:11.557514 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba24dc-cc96-457e-b49d-fc43c459e85a None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:11.557613 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba24dc-cc96-457e-b49d-fc43c459e85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:11.577800 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-6fba24dc-cc96-457e-b49d-fc43c459e85a None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:11.579020 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-6fba24dc-cc96-457e-b49d-fc43c459e85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:11.638390 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1433/2864] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:11.646627 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2049fb-c7e7-4002-8d49-bc5d21d03b8f None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:11.647016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2049fb-c7e7-4002-8d49-bc5d21d03b8f None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:11.647293 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2049fb-c7e7-4002-8d49-bc5d21d03b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:11.667895 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-9d2049fb-c7e7-4002-8d49-bc5d21d03b8f None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:11.669143 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-9d2049fb-c7e7-4002-8d49-bc5d21d03b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:11.677565 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1432/2865] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:11.681906 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba24dc-cc96-457e-b49d-fc43c459e85a None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:11.692360 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba24dc-cc96-457e-b49d-fc43c459e85a None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:11.696966 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b64bc1-096f-4a41-ade9-f2413f146dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:11.697632 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b64bc1-096f-4a41-ade9-f2413f146dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:11.697917 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b64bc1-096f-4a41-ade9-f2413f146dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:11.698193 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b64bc1-096f-4a41-ade9-f2413f146dc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:11.698843 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b64bc1-096f-4a41-ade9-f2413f146dc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:05:11.699151 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b64bc1-096f-4a41-ade9-f2413f146dc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:11.700739 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b64bc1-096f-4a41-ade9-f2413f146dc2 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:11.714160 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1434/2866] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 05:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:05:11.718583 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2049fb-c7e7-4002-8d49-bc5d21d03b8f None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:11.728047 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2049fb-c7e7-4002-8d49-bc5d21d03b8f None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:11.733647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37a0cf-0da2-4f2f-a185-4efeaf569307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:11.734325 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37a0cf-0da2-4f2f-a185-4efeaf569307 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:11.734596 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37a0cf-0da2-4f2f-a185-4efeaf569307 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:11.734876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37a0cf-0da2-4f2f-a185-4efeaf569307 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:11.735481 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37a0cf-0da2-4f2f-a185-4efeaf569307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:11.737395 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37a0cf-0da2-4f2f-a185-4efeaf569307 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:11.765678 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1433/2867] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 05:05:11 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:05:11.769860 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b64bc1-096f-4a41-ade9-f2413f146dc2 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:11.775165 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:11.781479 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b64bc1-096f-4a41-ade9-f2413f146dc2 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:11.839251 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf676bd-b493-490c-8818-daf9d4203c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:11.839853 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf676bd-b493-490c-8818-daf9d4203c94 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:11.840132 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf676bd-b493-490c-8818-daf9d4203c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:11.840404 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf676bd-b493-490c-8818-daf9d4203c94 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:11.841056 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf676bd-b493-490c-8818-daf9d4203c94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:11.843489 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf676bd-b493-490c-8818-daf9d4203c94 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:11.864214 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1435/2868] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 05:05:11 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:05:11.868399 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37a0cf-0da2-4f2f-a185-4efeaf569307 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:11.878547 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37a0cf-0da2-4f2f-a185-4efeaf569307 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:11.883091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac4203-4acc-4a75-a336-7fab54b0b951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:11.883679 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac4203-4acc-4a75-a336-7fab54b0b951 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:11.883955 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac4203-4acc-4a75-a336-7fab54b0b951 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:11.884222 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac4203-4acc-4a75-a336-7fab54b0b951 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:11.884859 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac4203-4acc-4a75-a336-7fab54b0b951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:11.886451 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac4203-4acc-4a75-a336-7fab54b0b951 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:11.897644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1434/2869] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:05:11.901674 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf676bd-b493-490c-8818-daf9d4203c94 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:11.912725 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf676bd-b493-490c-8818-daf9d4203c94 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:11.917553 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68064ddc-8035-47d4-bbe3-7e4b785e8f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:11.918218 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68064ddc-8035-47d4-bbe3-7e4b785e8f7c admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:11.918507 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68064ddc-8035-47d4-bbe3-7e4b785e8f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:11.918778 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68064ddc-8035-47d4-bbe3-7e4b785e8f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:11.919422 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68064ddc-8035-47d4-bbe3-7e4b785e8f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:11.921901 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68064ddc-8035-47d4-bbe3-7e4b785e8f7c admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:11.932899 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1436/2870] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:05:11.937644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac4203-4acc-4a75-a336-7fab54b0b951 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:11.947846 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac4203-4acc-4a75-a336-7fab54b0b951 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:11.952833 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3eb81c-317f-47cf-9006-d691077ee481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:11.953505 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3eb81c-317f-47cf-9006-d691077ee481 admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:11.953788 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3eb81c-317f-47cf-9006-d691077ee481 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:11.954062 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3eb81c-317f-47cf-9006-d691077ee481 admin admin] PATH_INFO: `/v3/projects/7c9f2120345e46ddbc97e95ab48a2d85/users/4d1112a289b145e1b9725db2e298528e/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:11.969061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3eb81c-317f-47cf-9006-d691077ee481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c9f2120345e46ddbc97e95ab48a2d85, user_id=4d1112a289b145e1b9725db2e298528e, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:11.971733 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3eb81c-317f-47cf-9006-d691077ee481 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:11.985304 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1435/2871] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:05:11 2022] PUT /identity/v3/projects/7c9f2120345e46ddbc97e95ab48a2d85/users/4d1112a289b145e1b9725db2e298528e/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:05:11.995515 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b2abc-ad17-4881-bfa0-efa829f2f7fb None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:11.995796 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b2abc-ad17-4881-bfa0-efa829f2f7fb None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:11.996065 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b2abc-ad17-4881-bfa0-efa829f2f7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:12.023493 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-bf7b2abc-ad17-4881-bfa0-efa829f2f7fb None None] MFA Rules not processed for user `4d1112a289b145e1b9725db2e298528e`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:12.024695 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-bf7b2abc-ad17-4881-bfa0-efa829f2f7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:12.090449 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1437/2872] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:05:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:12.102001 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3eb81c-317f-47cf-9006-d691077ee481 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:12.103741 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-5d3eb81c-317f-47cf-9006-d691077ee481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:12.167365 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3eb81c-317f-47cf-9006-d691077ee481 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:12.171737 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ecad8-4389-40b3-9c1b-d47fe5d831ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:12.172333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ecad8-4389-40b3-9c1b-d47fe5d831ea service cinder] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:12.172602 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ecad8-4389-40b3-9c1b-d47fe5d831ea service cinder] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:12.172868 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ecad8-4389-40b3-9c1b-d47fe5d831ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:12.181028 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ecad8-4389-40b3-9c1b-d47fe5d831ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:12.182471 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ecad8-4389-40b3-9c1b-d47fe5d831ea service cinder] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:12.191162 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1436/2873] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:05:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:05:13.550186 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24f230-449c-4a41-9fac-f1af0179a8a8 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:13.550729 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24f230-449c-4a41-9fac-f1af0179a8a8 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:13.550854 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24f230-449c-4a41-9fac-f1af0179a8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:13.569277 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-3e24f230-449c-4a41-9fac-f1af0179a8a8 None None] MFA Rules not processed for user `4d1112a289b145e1b9725db2e298528e`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:13.570500 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-3e24f230-449c-4a41-9fac-f1af0179a8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:13.577181 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1438/2874] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:05:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:13.620979 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ecad8-4389-40b3-9c1b-d47fe5d831ea service cinder] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:13.622476 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-783ecad8-4389-40b3-9c1b-d47fe5d831ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:13.667807 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:13.708435 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ecad8-4389-40b3-9c1b-d47fe5d831ea service cinder] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:13.712167 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad7df7-16f2-4e82-bd5b-69a43be12e5c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbec984d81c84035887220056b3790ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:13.712767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad7df7-16f2-4e82-bd5b-69a43be12e5c service glance] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:13.713041 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad7df7-16f2-4e82-bd5b-69a43be12e5c service glance] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:13.713308 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad7df7-16f2-4e82-bd5b-69a43be12e5c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:13.715082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-17ad7df7-16f2-4e82-bd5b-69a43be12e5c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:13.786952 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad7df7-16f2-4e82-bd5b-69a43be12e5c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:13.788405 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad7df7-16f2-4e82-bd5b-69a43be12e5c service glance] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:13.799441 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1437/2875] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:05:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:05:23.563911 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=68,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:23.794444 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=46 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:29.748534 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb223e03-1c1d-431d-8179-91ce60c4bff2 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:29.749057 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb223e03-1c1d-431d-8179-91ce60c4bff2 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:29.749057 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb223e03-1c1d-431d-8179-91ce60c4bff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:29.769422 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-cb223e03-1c1d-431d-8179-91ce60c4bff2 None None] MFA Rules not processed for user `7caa973c63e64d639cc2fb55a4955542`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:29.770599 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-cb223e03-1c1d-431d-8179-91ce60c4bff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:29.828166 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1439/2876] 10.222.0.94 () {58 vars in 1009 bytes} [Wed Aug 24 05:05:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:29.875624 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad7df7-16f2-4e82-bd5b-69a43be12e5c service glance] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:29.877701 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-17ad7df7-16f2-4e82-bd5b-69a43be12e5c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:29.948268 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad7df7-16f2-4e82-bd5b-69a43be12e5c service glance] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:29.953338 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2767b6-8036-4ce1-989e-add04f82a086 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40d2202203204b06a41e57b9d1a300fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:29.953964 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2767b6-8036-4ce1-989e-add04f82a086 service swift] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:29.954245 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2767b6-8036-4ce1-989e-add04f82a086 service swift] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:29.954517 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2767b6-8036-4ce1-989e-add04f82a086 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:29.963804 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2767b6-8036-4ce1-989e-add04f82a086 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:29.965376 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2767b6-8036-4ce1-989e-add04f82a086 service swift] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:29.973552 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1438/2877] 10.222.0.94 () {60 vars in 1384 bytes} [Wed Aug 24 05:05:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:05:30.476477 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139af22-3760-4a27-8123-f7ce19b15b2f None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:30.476765 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139af22-3760-4a27-8123-f7ce19b15b2f None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:30.477037 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139af22-3760-4a27-8123-f7ce19b15b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:30.496601 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-a139af22-3760-4a27-8123-f7ce19b15b2f None None] MFA Rules not processed for user `7caa973c63e64d639cc2fb55a4955542`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:30.497861 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-a139af22-3760-4a27-8123-f7ce19b15b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:30.505707 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1440/2878] 10.222.0.94 () {58 vars in 967 bytes} [Wed Aug 24 05:05:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:30.518446 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2767b6-8036-4ce1-989e-add04f82a086 service swift] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:30.529265 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2767b6-8036-4ce1-989e-add04f82a086 service swift] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:30.535145 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bd739-7f6e-4c9b-8d9c-082b79715c40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40d2202203204b06a41e57b9d1a300fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:30.535730 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bd739-7f6e-4c9b-8d9c-082b79715c40 service swift] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:30.536003 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bd739-7f6e-4c9b-8d9c-082b79715c40 service swift] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:30.536297 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bd739-7f6e-4c9b-8d9c-082b79715c40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:30.544661 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5bd739-7f6e-4c9b-8d9c-082b79715c40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:30.546261 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5bd739-7f6e-4c9b-8d9c-082b79715c40 service swift] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:30.555242 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1439/2879] 10.222.0.94 () {60 vars in 1384 bytes} [Wed Aug 24 05:05:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:05:30.774673 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ece87-d8e9-4926-b0e0-2ded74b98934 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:30.775180 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ece87-d8e9-4926-b0e0-2ded74b98934 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:30.775282 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ece87-d8e9-4926-b0e0-2ded74b98934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:30.794176 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-4a0ece87-d8e9-4926-b0e0-2ded74b98934 None None] MFA Rules not processed for user `7caa973c63e64d639cc2fb55a4955542`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:30.795361 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-4a0ece87-d8e9-4926-b0e0-2ded74b98934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:30.803293 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1441/2880] 10.222.0.94 () {58 vars in 1009 bytes} [Wed Aug 24 05:05:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:30.815232 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bd739-7f6e-4c9b-8d9c-082b79715c40 service swift] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:30.825936 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bd739-7f6e-4c9b-8d9c-082b79715c40 service swift] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:30.830849 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042066ee-da54-4144-81bd-880e5da257b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40d2202203204b06a41e57b9d1a300fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:30.832008 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042066ee-da54-4144-81bd-880e5da257b9 service swift] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:30.832281 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042066ee-da54-4144-81bd-880e5da257b9 service swift] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:30.832549 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042066ee-da54-4144-81bd-880e5da257b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:30.842050 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042066ee-da54-4144-81bd-880e5da257b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:30.843633 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042066ee-da54-4144-81bd-880e5da257b9 service swift] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:30.852462 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1440/2881] 10.222.0.94 () {60 vars in 1384 bytes} [Wed Aug 24 05:05:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:05:31.181163 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b12a82-fb85-4bc5-ba9f-c84a7ff34f37 None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:31.181485 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b12a82-fb85-4bc5-ba9f-c84a7ff34f37 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:31.181767 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b12a82-fb85-4bc5-ba9f-c84a7ff34f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:31.201078 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-e1b12a82-fb85-4bc5-ba9f-c84a7ff34f37 None None] MFA Rules not processed for user `7caa973c63e64d639cc2fb55a4955542`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:31.202338 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-e1b12a82-fb85-4bc5-ba9f-c84a7ff34f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:31.210789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1442/2882] 10.222.0.94 () {58 vars in 967 bytes} [Wed Aug 24 05:05:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:31.223224 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042066ee-da54-4144-81bd-880e5da257b9 service swift] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:31.233763 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042066ee-da54-4144-81bd-880e5da257b9 service swift] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:31.238734 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64ba9c-85bd-422c-87b3-a540c5cc9a34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40d2202203204b06a41e57b9d1a300fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:31.239308 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64ba9c-85bd-422c-87b3-a540c5cc9a34 service swift] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:31.239582 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64ba9c-85bd-422c-87b3-a540c5cc9a34 service swift] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:31.239849 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64ba9c-85bd-422c-87b3-a540c5cc9a34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:31.247985 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64ba9c-85bd-422c-87b3-a540c5cc9a34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:31.249567 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64ba9c-85bd-422c-87b3-a540c5cc9a34 service swift] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:31.258112 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1441/2883] 10.222.0.94 () {60 vars in 1384 bytes} [Wed Aug 24 05:05:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:05:33.344614 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b12a82-fb85-4bc5-ba9f-c84a7ff34f37 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:33.406685 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b12a82-fb85-4bc5-ba9f-c84a7ff34f37 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:33.411772 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998f4c6-97d1-436e-b80d-a06e9c35d69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:33.412385 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998f4c6-97d1-436e-b80d-a06e9c35d69f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:33.412665 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998f4c6-97d1-436e-b80d-a06e9c35d69f admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:33.412938 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998f4c6-97d1-436e-b80d-a06e9c35d69f admin admin] PATH_INFO: `/v3/users/4d1112a289b145e1b9725db2e298528e` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:33.414082 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998f4c6-97d1-436e-b80d-a06e9c35d69f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d1112a289b145e1b9725db2e298528e)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:33.415961 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998f4c6-97d1-436e-b80d-a06e9c35d69f admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:33.474313 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-8998f4c6-97d1-436e-b80d-a06e9c35d69f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d1112a289b145e1b9725db2e298528e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:33.481490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-8998f4c6-97d1-436e-b80d-a06e9c35d69f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d1112a289b145e1b9725db2e298528e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:33.488459 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-8998f4c6-97d1-436e-b80d-a06e9c35d69f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d1112a289b145e1b9725db2e298528e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:33.489091 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-8998f4c6-97d1-436e-b80d-a06e9c35d69f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d1112a289b145e1b9725db2e298528e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:33.501111 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-8998f4c6-97d1-436e-b80d-a06e9c35d69f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d1112a289b145e1b9725db2e298528e'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:33.507680 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1443/2884] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 05:05:33 2022] DELETE /identity/v3/users/4d1112a289b145e1b9725db2e298528e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:05:33.512411 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222d61a-a671-4f6d-b69d-574a44c134c3 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:33.512931 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222d61a-a671-4f6d-b69d-574a44c134c3 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:33.513125 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222d61a-a671-4f6d-b69d-574a44c134c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:33.532844 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-4222d61a-a671-4f6d-b69d-574a44c134c3 None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:33.534085 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-4222d61a-a671-4f6d-b69d-574a44c134c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:33.593989 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1442/2885] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:33.603935 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998f4c6-97d1-436e-b80d-a06e9c35d69f admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:33.605420 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-8998f4c6-97d1-436e-b80d-a06e9c35d69f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:33.611887 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:33.665506 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998f4c6-97d1-436e-b80d-a06e9c35d69f admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:33.669531 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18620827-2f92-481e-b32b-dae6f69ff54e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:33.670142 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18620827-2f92-481e-b32b-dae6f69ff54e service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:33.670423 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18620827-2f92-481e-b32b-dae6f69ff54e service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:33.670696 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18620827-2f92-481e-b32b-dae6f69ff54e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:33.680671 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18620827-2f92-481e-b32b-dae6f69ff54e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:33.682124 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18620827-2f92-481e-b32b-dae6f69ff54e service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:33.692065 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1444/2886] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:05:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:05:33.861715 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222d61a-a671-4f6d-b69d-574a44c134c3 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:33.863146 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-4222d61a-a671-4f6d-b69d-574a44c134c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:33.876562 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222d61a-a671-4f6d-b69d-574a44c134c3 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:33.882082 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95672bf1-7e87-4fd1-8443-f658f901c636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:33.882726 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95672bf1-7e87-4fd1-8443-f658f901c636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:33.883007 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95672bf1-7e87-4fd1-8443-f658f901c636 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:33.883279 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95672bf1-7e87-4fd1-8443-f658f901c636 admin admin] PATH_INFO: `/v3/projects/7c9f2120345e46ddbc97e95ab48a2d85` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:33.884426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95672bf1-7e87-4fd1-8443-f658f901c636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c9f2120345e46ddbc97e95ab48a2d85)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:33.886370 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95672bf1-7e87-4fd1-8443-f658f901c636 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:33.932728 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:33.935877 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-95672bf1-7e87-4fd1-8443-f658f901c636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c9f2120345e46ddbc97e95ab48a2d85', 'request_id': 'req-95672bf1-7e87-4fd1-8443-f658f901c636'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:33.941907 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-95672bf1-7e87-4fd1-8443-f658f901c636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c9f2120345e46ddbc97e95ab48a2d85', 'request_id': 'req-95672bf1-7e87-4fd1-8443-f658f901c636'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:33.949335 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-95672bf1-7e87-4fd1-8443-f658f901c636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c9f2120345e46ddbc97e95ab48a2d85', 'request_id': 'req-95672bf1-7e87-4fd1-8443-f658f901c636'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:33.961605 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-95672bf1-7e87-4fd1-8443-f658f901c636 admin admin] The token cache is being invalidate because project 7c9f2120345e46ddbc97e95ab48a2d85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:05:33.961997 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-95672bf1-7e87-4fd1-8443-f658f901c636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:33.962681 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-95672bf1-7e87-4fd1-8443-f658f901c636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:33.964183 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1443/2887] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 05:05:33 2022] DELETE /identity/v3/projects/7c9f2120345e46ddbc97e95ab48a2d85 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:05:33.969226 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924b0bd-993f-4af2-a776-b1b717233b2b None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:33.969559 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924b0bd-993f-4af2-a776-b1b717233b2b None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:33.969838 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924b0bd-993f-4af2-a776-b1b717233b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:33.989564 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-4924b0bd-993f-4af2-a776-b1b717233b2b None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:33.990951 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-4924b0bd-993f-4af2-a776-b1b717233b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:34.050156 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1445/2888] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:34.058319 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea818a2-4273-4cab-b90e-ace4f473123b None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:34.058606 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea818a2-4273-4cab-b90e-ace4f473123b None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:34.058923 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea818a2-4273-4cab-b90e-ace4f473123b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:34.079039 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-eea818a2-4273-4cab-b90e-ace4f473123b None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:34.080247 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-eea818a2-4273-4cab-b90e-ace4f473123b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:34.088771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1444/2889] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:34.092981 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924b0bd-993f-4af2-a776-b1b717233b2b None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:34.103393 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924b0bd-993f-4af2-a776-b1b717233b2b None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:34.107944 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceba04-f4e0-4a31-98ba-42068ac3c26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:34.108463 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceba04-f4e0-4a31-98ba-42068ac3c26b admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:34.108741 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceba04-f4e0-4a31-98ba-42068ac3c26b admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:34.109012 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceba04-f4e0-4a31-98ba-42068ac3c26b admin admin] PATH_INFO: `/v3/domains` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:34.109686 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceba04-f4e0-4a31-98ba-42068ac3c26b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:05:34.109983 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceba04-f4e0-4a31-98ba-42068ac3c26b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:34.111547 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceba04-f4e0-4a31-98ba-42068ac3c26b admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:34.123277 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1446/2890] 10.222.0.94 () {58 vars in 1153 bytes} [Wed Aug 24 05:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:05:34.127536 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea818a2-4273-4cab-b90e-ace4f473123b None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:34.137713 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea818a2-4273-4cab-b90e-ace4f473123b None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:34.142624 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2b7d7-ff45-4bad-bd79-5fac4acac32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:34.143223 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2b7d7-ff45-4bad-bd79-5fac4acac32b admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:34.143502 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2b7d7-ff45-4bad-bd79-5fac4acac32b admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:34.143771 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2b7d7-ff45-4bad-bd79-5fac4acac32b admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:34.144408 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2b7d7-ff45-4bad-bd79-5fac4acac32b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:34.146982 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2b7d7-ff45-4bad-bd79-5fac4acac32b admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:34.174757 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1445/2891] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 05:05:34 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:05:34.179034 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceba04-f4e0-4a31-98ba-42068ac3c26b admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:34.189057 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceba04-f4e0-4a31-98ba-42068ac3c26b admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:34.244248 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416dbe3-c759-4e4b-9ac7-d6f862155077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:34.244876 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416dbe3-c759-4e4b-9ac7-d6f862155077 admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:34.245153 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416dbe3-c759-4e4b-9ac7-d6f862155077 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:34.245446 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416dbe3-c759-4e4b-9ac7-d6f862155077 admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:34.246084 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416dbe3-c759-4e4b-9ac7-d6f862155077 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:34.247976 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416dbe3-c759-4e4b-9ac7-d6f862155077 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:34.270369 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1447/2892] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 05:05:34 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:05:34.275222 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2b7d7-ff45-4bad-bd79-5fac4acac32b admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:34.285324 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2b7d7-ff45-4bad-bd79-5fac4acac32b admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:34.289982 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b45f4-82b5-4e5a-90a3-e9612c55a71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:34.290566 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b45f4-82b5-4e5a-90a3-e9612c55a71c admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:34.290840 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b45f4-82b5-4e5a-90a3-e9612c55a71c admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:34.291108 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b45f4-82b5-4e5a-90a3-e9612c55a71c admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:34.291762 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b45f4-82b5-4e5a-90a3-e9612c55a71c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:34.293310 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b45f4-82b5-4e5a-90a3-e9612c55a71c admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:34.303189 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1446/2893] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:05:34.307211 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416dbe3-c759-4e4b-9ac7-d6f862155077 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:34.317019 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416dbe3-c759-4e4b-9ac7-d6f862155077 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:34.322196 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58af95-a717-4a5b-9845-1192c84b1861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:34.322789 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58af95-a717-4a5b-9845-1192c84b1861 admin admin] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:34.323070 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58af95-a717-4a5b-9845-1192c84b1861 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:34.323338 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58af95-a717-4a5b-9845-1192c84b1861 admin admin] PATH_INFO: `/v3/roles` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:34.323971 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58af95-a717-4a5b-9845-1192c84b1861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:34.325571 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58af95-a717-4a5b-9845-1192c84b1861 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:34.336622 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1448/2894] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:05:34.340857 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b45f4-82b5-4e5a-90a3-e9612c55a71c admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:34.351019 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b45f4-82b5-4e5a-90a3-e9612c55a71c admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:34.355634 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16074b0-1489-4b8b-bca3-8597f178780b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:34.356304 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16074b0-1489-4b8b-bca3-8597f178780b admin admin] REQUEST_METHOD: `PUT` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:34.356578 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16074b0-1489-4b8b-bca3-8597f178780b admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:34.356850 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16074b0-1489-4b8b-bca3-8597f178780b admin admin] PATH_INFO: `/v3/projects/d3447ff89eea42208eeac6b2f2f953e0/users/85896f6c47fc4a768a210d715f463339/roles/1a586b803a1e429f82b85f386d7564fb` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:34.371823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16074b0-1489-4b8b-bca3-8597f178780b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3447ff89eea42208eeac6b2f2f953e0, user_id=85896f6c47fc4a768a210d715f463339, role_id=1a586b803a1e429f82b85f386d7564fb)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:34.374409 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16074b0-1489-4b8b-bca3-8597f178780b admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:34.387933 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1447/2895] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:05:34 2022] PUT /identity/v3/projects/d3447ff89eea42208eeac6b2f2f953e0/users/85896f6c47fc4a768a210d715f463339/roles/1a586b803a1e429f82b85f386d7564fb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:05:34.393340 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada4449-d547-4e89-bd0d-4254dd24405b None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:34.393873 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada4449-d547-4e89-bd0d-4254dd24405b None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:34.394014 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada4449-d547-4e89-bd0d-4254dd24405b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:34.413258 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-aada4449-d547-4e89-bd0d-4254dd24405b None None] MFA Rules not processed for user `4df458c2526a46c5a13d982659afe50c`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:34.414476 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-aada4449-d547-4e89-bd0d-4254dd24405b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:34.422606 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:34.474415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1449/2896] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:34.484106 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16074b0-1489-4b8b-bca3-8597f178780b admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:34.485867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e16074b0-1489-4b8b-bca3-8597f178780b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:34.543680 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16074b0-1489-4b8b-bca3-8597f178780b admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:34.547519 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93872e-75ab-48df-ac30-7c26642c98e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:34.548120 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93872e-75ab-48df-ac30-7c26642c98e2 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:34.548401 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93872e-75ab-48df-ac30-7c26642c98e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:34.548693 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93872e-75ab-48df-ac30-7c26642c98e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:34.558452 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93872e-75ab-48df-ac30-7c26642c98e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:34.559868 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93872e-75ab-48df-ac30-7c26642c98e2 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:34.569767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1448/2897] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:05:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:05:38.531845 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44b0a5-6506-4052-8ff6-f656f061d5bf None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:38.532382 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44b0a5-6506-4052-8ff6-f656f061d5bf None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:38.532481 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44b0a5-6506-4052-8ff6-f656f061d5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:38.564660 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-3d44b0a5-6506-4052-8ff6-f656f061d5bf None None] MFA Rules not processed for user `85896f6c47fc4a768a210d715f463339`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:38.565941 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-3d44b0a5-6506-4052-8ff6-f656f061d5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:38.646348 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1450/2898] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:05:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:38.651296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93872e-75ab-48df-ac30-7c26642c98e2 service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:38.661865 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93872e-75ab-48df-ac30-7c26642c98e2 service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:38.667922 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ade01-28a7-4c96-a342-7e1f7e61d5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:38.668595 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ade01-28a7-4c96-a342-7e1f7e61d5c9 admin admin] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:38.668878 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ade01-28a7-4c96-a342-7e1f7e61d5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:38.669149 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ade01-28a7-4c96-a342-7e1f7e61d5c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:38.669849 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ade01-28a7-4c96-a342-7e1f7e61d5c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:38.671894 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ade01-28a7-4c96-a342-7e1f7e61d5c9 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:38.702009 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1449/2899] 10.222.0.94 () {60 vars in 1153 bytes} [Wed Aug 24 05:05:38 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:05:38.706127 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44b0a5-6506-4052-8ff6-f656f061d5bf None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:38.718571 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44b0a5-6506-4052-8ff6-f656f061d5bf None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:38.780389 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd30e2-793e-46c9-946d-88d2e38a395a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:38.781017 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd30e2-793e-46c9-946d-88d2e38a395a admin admin] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:38.781300 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd30e2-793e-46c9-946d-88d2e38a395a admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:38.781736 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd30e2-793e-46c9-946d-88d2e38a395a admin admin] PATH_INFO: `/v3/users` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:38.782386 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd30e2-793e-46c9-946d-88d2e38a395a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:38.784325 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd30e2-793e-46c9-946d-88d2e38a395a admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:38.808647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1451/2900] 10.222.0.94 () {60 vars in 1144 bytes} [Wed Aug 24 05:05:38 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:05:38.812755 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ade01-28a7-4c96-a342-7e1f7e61d5c9 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:38.824197 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ade01-28a7-4c96-a342-7e1f7e61d5c9 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:38.828884 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177924d7-4ddc-4447-b26c-9e67ec8dd2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:38.829524 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177924d7-4ddc-4447-b26c-9e67ec8dd2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:38.829803 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177924d7-4ddc-4447-b26c-9e67ec8dd2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:38.830070 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177924d7-4ddc-4447-b26c-9e67ec8dd2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:38.830707 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177924d7-4ddc-4447-b26c-9e67ec8dd2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:38.832296 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177924d7-4ddc-4447-b26c-9e67ec8dd2c1 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:38.844420 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1450/2901] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:05:38.848609 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd30e2-793e-46c9-946d-88d2e38a395a admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:38.859624 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd30e2-793e-46c9-946d-88d2e38a395a admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:38.865012 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1839a4-3f38-49d4-a735-80cae79892df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:38.865721 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1839a4-3f38-49d4-a735-80cae79892df admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:38.866029 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1839a4-3f38-49d4-a735-80cae79892df admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:38.866309 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1839a4-3f38-49d4-a735-80cae79892df admin admin] PATH_INFO: `/v3/projects/2a257028282e449e9418713e7306e3bf/users/ffe08008d91d4673a6107bc2a6ed4614/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:38.882539 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1839a4-3f38-49d4-a735-80cae79892df admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a257028282e449e9418713e7306e3bf, user_id=ffe08008d91d4673a6107bc2a6ed4614, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:38.885523 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1839a4-3f38-49d4-a735-80cae79892df admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:38.899837 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1452/2902] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:05:38 2022] PUT /identity/v3/projects/2a257028282e449e9418713e7306e3bf/users/ffe08008d91d4673a6107bc2a6ed4614/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:05:38.905603 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177924d7-4ddc-4447-b26c-9e67ec8dd2c1 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:38.917787 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177924d7-4ddc-4447-b26c-9e67ec8dd2c1 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:38.959644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:38.981593 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b7cf9-c5f1-407b-b68f-fdf0e6a612c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:38.982232 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b7cf9-c5f1-407b-b68f-fdf0e6a612c4 admin admin] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:38.982512 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b7cf9-c5f1-407b-b68f-fdf0e6a612c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:38.982785 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b7cf9-c5f1-407b-b68f-fdf0e6a612c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:38.983424 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b7cf9-c5f1-407b-b68f-fdf0e6a612c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:38.985015 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b7cf9-c5f1-407b-b68f-fdf0e6a612c4 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:38.995490 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1451/2903] 10.222.0.94 () {58 vars in 1122 bytes} [Wed Aug 24 05:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:05:38.999681 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1839a4-3f38-49d4-a735-80cae79892df admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:39.010431 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1839a4-3f38-49d4-a735-80cae79892df admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:39.015460 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe7392-4e6c-40ce-b82a-b95b63752ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:39.016163 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe7392-4e6c-40ce-b82a-b95b63752ad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:39.016421 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe7392-4e6c-40ce-b82a-b95b63752ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:39.016693 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe7392-4e6c-40ce-b82a-b95b63752ad1 admin admin] PATH_INFO: `/v3/projects/2a257028282e449e9418713e7306e3bf/users/ffe08008d91d4673a6107bc2a6ed4614/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:39.018630 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe7392-4e6c-40ce-b82a-b95b63752ad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a257028282e449e9418713e7306e3bf, user_id=ffe08008d91d4673a6107bc2a6ed4614, role_id=4ef30b7a34a14e2cbd9bfd98bbd427c2)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:39.022164 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe7392-4e6c-40ce-b82a-b95b63752ad1 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:39.025304 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:39.033663 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1453/2904] 10.222.0.94 () {60 vars in 1483 bytes} [Wed Aug 24 05:05:38 2022] PUT /identity/v3/projects/2a257028282e449e9418713e7306e3bf/users/ffe08008d91d4673a6107bc2a6ed4614/roles/4ef30b7a34a14e2cbd9bfd98bbd427c2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:05:43.685333 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c9e2c-5b41-433e-9e51-7232f49d19d7 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:43.685801 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c9e2c-5b41-433e-9e51-7232f49d19d7 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:43.685801 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c9e2c-5b41-433e-9e51-7232f49d19d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:43.746990 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-168c9e2c-5b41-433e-9e51-7232f49d19d7 None None] MFA Rules not processed for user `ffe08008d91d4673a6107bc2a6ed4614`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:43.748332 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-168c9e2c-5b41-433e-9e51-7232f49d19d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:43.856680 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1452/2905] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:05:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:43.873028 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe7392-4e6c-40ce-b82a-b95b63752ad1 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:43.875051 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-ccfe7392-4e6c-40ce-b82a-b95b63752ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:43.976696 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe7392-4e6c-40ce-b82a-b95b63752ad1 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:43.983092 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106c298-2f98-4079-946f-eeea1f40c1f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:43.983796 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106c298-2f98-4079-946f-eeea1f40c1f9 service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:43.984154 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106c298-2f98-4079-946f-eeea1f40c1f9 service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:43.984493 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106c298-2f98-4079-946f-eeea1f40c1f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:44.073495 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106c298-2f98-4079-946f-eeea1f40c1f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:44.075160 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106c298-2f98-4079-946f-eeea1f40c1f9 service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:44.087199 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1454/2906] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:05:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:05:45.132218 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc62b21-c9e3-40a5-82f9-7b41ba5f3125 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:45.132742 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc62b21-c9e3-40a5-82f9-7b41ba5f3125 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:45.132842 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc62b21-c9e3-40a5-82f9-7b41ba5f3125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:45.152067 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-8dc62b21-c9e3-40a5-82f9-7b41ba5f3125 None None] MFA Rules not processed for user `85896f6c47fc4a768a210d715f463339`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:45.153280 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-8dc62b21-c9e3-40a5-82f9-7b41ba5f3125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:45.160168 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1453/2907] 10.222.0.94 () {58 vars in 958 bytes} [Wed Aug 24 05:05:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:54.080992 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=58 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:55.146523 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=48 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:06:02.712033 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106c298-2f98-4079-946f-eeea1f40c1f9 service nova] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:06:02.714351 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-2106c298-2f98-4079-946f-eeea1f40c1f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:06:02.772076 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106c298-2f98-4079-946f-eeea1f40c1f9 service nova] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:06:02.775695 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74814335-0217-4982-85cd-cfeeb84c0952 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d36675e4e6045158add36ac528d6c7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:06:02.776304 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74814335-0217-4982-85cd-cfeeb84c0952 service cinder] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:06:02.776583 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74814335-0217-4982-85cd-cfeeb84c0952 service cinder] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:06:02.776858 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74814335-0217-4982-85cd-cfeeb84c0952 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:06:02.779435 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-74814335-0217-4982-85cd-cfeeb84c0952 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:06:02.792794 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74814335-0217-4982-85cd-cfeeb84c0952 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:06:02.794357 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74814335-0217-4982-85cd-cfeeb84c0952 service cinder] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:06:02.805306 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1455/2908] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:06:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:06:03.087169 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc62b21-c9e3-40a5-82f9-7b41ba5f3125 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:06:03.088639 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-8dc62b21-c9e3-40a5-82f9-7b41ba5f3125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:06:03.151424 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc62b21-c9e3-40a5-82f9-7b41ba5f3125 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:06:03.155058 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3164e5f-dcfa-49cc-b12b-adfb9471662a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:06:03.155659 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3164e5f-dcfa-49cc-b12b-adfb9471662a service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:06:03.155934 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3164e5f-dcfa-49cc-b12b-adfb9471662a service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:06:03.156202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3164e5f-dcfa-49cc-b12b-adfb9471662a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:06:03.158045 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-e3164e5f-dcfa-49cc-b12b-adfb9471662a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:06:03.167725 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3164e5f-dcfa-49cc-b12b-adfb9471662a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:06:03.169167 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3164e5f-dcfa-49cc-b12b-adfb9471662a service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:06:03.178206 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1454/2909] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:06:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:06:03.634158 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74814335-0217-4982-85cd-cfeeb84c0952 service cinder] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:06:03.635592 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-74814335-0217-4982-85cd-cfeeb84c0952 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:06:03.717353 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74814335-0217-4982-85cd-cfeeb84c0952 service cinder] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:06:03.722536 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf50ed6-ea90-441f-87f6-8e0bfc0b8b2b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3274d404cb403bbf272ce023aa5e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:06:03.723163 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf50ed6-ea90-441f-87f6-8e0bfc0b8b2b service placement] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:06:03.723448 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf50ed6-ea90-441f-87f6-8e0bfc0b8b2b service placement] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:06:03.723725 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf50ed6-ea90-441f-87f6-8e0bfc0b8b2b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:06:03.725518 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-1bf50ed6-ea90-441f-87f6-8e0bfc0b8b2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:06:03.737982 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf50ed6-ea90-441f-87f6-8e0bfc0b8b2b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:06:03.739550 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf50ed6-ea90-441f-87f6-8e0bfc0b8b2b service placement] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:06:03.749652 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1456/2910] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:06:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:06:05.736576 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3164e5f-dcfa-49cc-b12b-adfb9471662a service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:06:05.745848 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3164e5f-dcfa-49cc-b12b-adfb9471662a service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:06:05.749952 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d93a4-fc1f-4c4c-9eb3-29719cf54e45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:06:05.750634 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d93a4-fc1f-4c4c-9eb3-29719cf54e45 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:06:05.750992 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d93a4-fc1f-4c4c-9eb3-29719cf54e45 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:06:05.751467 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d93a4-fc1f-4c4c-9eb3-29719cf54e45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:06:05.753266 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-1a0d93a4-fc1f-4c4c-9eb3-29719cf54e45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:06:05.765748 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d93a4-fc1f-4c4c-9eb3-29719cf54e45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:06:05.767186 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d93a4-fc1f-4c4c-9eb3-29719cf54e45 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:06:05.776283 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1455/2911] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:06:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:06:06.357919 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf50ed6-ea90-441f-87f6-8e0bfc0b8b2b service placement] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:06:06.359466 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-1bf50ed6-ea90-441f-87f6-8e0bfc0b8b2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:06:06.379794 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf50ed6-ea90-441f-87f6-8e0bfc0b8b2b service placement] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:06:06.385286 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cd764-6cfa-4e48-815e-d86417fe8b9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:06:06.385927 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cd764-6cfa-4e48-815e-d86417fe8b9c service nova] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:06:06.386215 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cd764-6cfa-4e48-815e-d86417fe8b9c service nova] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:06:06.386490 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cd764-6cfa-4e48-815e-d86417fe8b9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:06:06.388720 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-3f6cd764-6cfa-4e48-815e-d86417fe8b9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:06:06.402107 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cd764-6cfa-4e48-815e-d86417fe8b9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:06:06.403888 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cd764-6cfa-4e48-815e-d86417fe8b9c service nova] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:06:06.415832 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1457/2912] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:06:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:06:12.940907 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d93a4-fc1f-4c4c-9eb3-29719cf54e45 service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:06:12.957302 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d93a4-fc1f-4c4c-9eb3-29719cf54e45 service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:06:12.962181 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8decf5a-c571-433e-a4d3-adac4677443f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:06:12.962802 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8decf5a-c571-433e-a4d3-adac4677443f service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:06:12.963234 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8decf5a-c571-433e-a4d3-adac4677443f service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:06:12.963432 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8decf5a-c571-433e-a4d3-adac4677443f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:06:12.965823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-a8decf5a-c571-433e-a4d3-adac4677443f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:06:12.980104 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8decf5a-c571-433e-a4d3-adac4677443f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:06:12.981761 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8decf5a-c571-433e-a4d3-adac4677443f service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:06:12.994089 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1456/2913] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:06:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:06:15.602769 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cd764-6cfa-4e48-815e-d86417fe8b9c service nova] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:06:15.612946 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cd764-6cfa-4e48-815e-d86417fe8b9c service nova] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:06:15.616522 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1261863-39a9-4e68-95a6-05f4a148ca29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:06:15.617123 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1261863-39a9-4e68-95a6-05f4a148ca29 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:06:15.617429 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1261863-39a9-4e68-95a6-05f4a148ca29 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:06:15.617710 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1261863-39a9-4e68-95a6-05f4a148ca29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:06:15.627352 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1261863-39a9-4e68-95a6-05f4a148ca29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:06:15.628836 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1261863-39a9-4e68-95a6-05f4a148ca29 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:06:15.638409 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1458/2914] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:06:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:06:17.211188 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8decf5a-c571-433e-a4d3-adac4677443f service nova] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:06:17.224277 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8decf5a-c571-433e-a4d3-adac4677443f service nova] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:06:17.231647 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242f0f7-d2bb-4260-a6d3-091b9221c471 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bdbda2b9c8f48338c5117585a229cb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:06:17.233091 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242f0f7-d2bb-4260-a6d3-091b9221c471 service nova] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:06:17.233636 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242f0f7-d2bb-4260-a6d3-091b9221c471 service nova] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:06:17.233987 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242f0f7-d2bb-4260-a6d3-091b9221c471 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:06:17.235827 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-2242f0f7-d2bb-4260-a6d3-091b9221c471 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:06:17.249362 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242f0f7-d2bb-4260-a6d3-091b9221c471 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:06:17.251016 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242f0f7-d2bb-4260-a6d3-091b9221c471 service nova] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:06:17.262926 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1457/2915] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:06:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:06:25.634139 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=70 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:06:27.258244 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=44 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:58.492030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda3d85-3eb6-4840-ad7b-789ce5495457 None None] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:58.492633 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda3d85-3eb6-4840-ad7b-789ce5495457 None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:58.492746 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda3d85-3eb6-4840-ad7b-789ce5495457 None None] PATH_INFO: `/` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:58.494050 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1459/2916] 10.222.0.94 () {54 vars in 921 bytes} [Wed Aug 24 05:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:08:58.500500 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73035564-8ee8-47ab-9de3-73f373e45d17 None None] REQUEST_METHOD: `POST` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:58.501037 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73035564-8ee8-47ab-9de3-73f373e45d17 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:58.501037 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73035564-8ee8-47ab-9de3-73f373e45d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:58.591056 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.auth.core [None req-73035564-8ee8-47ab-9de3-73f373e45d17 None None] MFA Rules not processed for user `0742c7ecf68d40a38c8947a05eee2797`. Rule list: `[]` (Enabled: `True`). {{(pid=93411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:08:58.592307 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-73035564-8ee8-47ab-9de3-73f373e45d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:58.632894 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1458/2917] 10.222.0.94 () {58 vars in 1018 bytes} [Wed Aug 24 05:08:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:08:58.646155 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda3d85-3eb6-4840-ad7b-789ce5495457 None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:58.657363 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda3d85-3eb6-4840-ad7b-789ce5495457 None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:58.660994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f1b25-d150-41ba-ac01-218c83e6e81b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:58.661629 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f1b25-d150-41ba-ac01-218c83e6e81b service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:58.661910 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f1b25-d150-41ba-ac01-218c83e6e81b service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:58.662182 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f1b25-d150-41ba-ac01-218c83e6e81b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:58.669492 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f1b25-d150-41ba-ac01-218c83e6e81b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:58.670901 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f1b25-d150-41ba-ac01-218c83e6e81b service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:58.678974 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1460/2918] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:08:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:08:58.765473 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e036ec3-fcc6-44f3-b05a-2b3de3b0f2e0 None None] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:58.765767 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e036ec3-fcc6-44f3-b05a-2b3de3b0f2e0 None None] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:58.766067 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e036ec3-fcc6-44f3-b05a-2b3de3b0f2e0 None None] PATH_INFO: `/` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:58.767475 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1459/2919] 10.222.0.94 () {54 vars in 921 bytes} [Wed Aug 24 05:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:08:58.773030 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b6b08-ad27-4305-a31f-6d598b74650f None None] REQUEST_METHOD: `POST` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:58.773491 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b6b08-ad27-4305-a31f-6d598b74650f None None] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:58.773778 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b6b08-ad27-4305-a31f-6d598b74650f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:58.811411 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.auth.core [None req-df8b6b08-ad27-4305-a31f-6d598b74650f None None] MFA Rules not processed for user `5bdbda2b9c8f48338c5117585a229cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=93412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:08:58.812624 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-df8b6b08-ad27-4305-a31f-6d598b74650f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:58.849077 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1461/2920] 10.222.0.94 () {58 vars in 1018 bytes} [Wed Aug 24 05:08:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:08:58.859644 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e036ec3-fcc6-44f3-b05a-2b3de3b0f2e0 None None] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:58.871673 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e036ec3-fcc6-44f3-b05a-2b3de3b0f2e0 None None] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:58.875208 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e63a2d-6966-4146-8cee-604599dcbca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:58.875798 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e63a2d-6966-4146-8cee-604599dcbca5 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:58.876075 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e63a2d-6966-4146-8cee-604599dcbca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:58.876949 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e63a2d-6966-4146-8cee-604599dcbca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:58.887415 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e63a2d-6966-4146-8cee-604599dcbca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:58.888828 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e63a2d-6966-4146-8cee-604599dcbca5 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:58.900000 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1460/2921] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:08:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:09:05.225233 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b6b08-ad27-4305-a31f-6d598b74650f None None] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:09:05.226672 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-df8b6b08-ad27-4305-a31f-6d598b74650f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:09:05.263242 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b6b08-ad27-4305-a31f-6d598b74650f None None] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:09:05.269065 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a9448-387e-4d33-9f78-1e04e4f376c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3274d404cb403bbf272ce023aa5e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:09:05.269709 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a9448-387e-4d33-9f78-1e04e4f376c1 service placement] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:09:05.269994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a9448-387e-4d33-9f78-1e04e4f376c1 service placement] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:09:05.270268 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a9448-387e-4d33-9f78-1e04e4f376c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:09:05.272009 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-5c9a9448-387e-4d33-9f78-1e04e4f376c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:09:05.284148 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a9448-387e-4d33-9f78-1e04e4f376c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:09:05.285780 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a9448-387e-4d33-9f78-1e04e4f376c1 service placement] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:09:05.295913 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1462/2922] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:09:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:09:08.895131 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=45 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:09:15.291616 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=42 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:53.059530 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e63a2d-6966-4146-8cee-604599dcbca5 service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:10:53.068341 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e63a2d-6966-4146-8cee-604599dcbca5 service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:10:53.072603 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b2c9c-fc63-4996-bc23-dee363a27372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:10:53.073189 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b2c9c-fc63-4996-bc23-dee363a27372 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:10:53.073504 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b2c9c-fc63-4996-bc23-dee363a27372 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:10:53.073777 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b2c9c-fc63-4996-bc23-dee363a27372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:10:53.081871 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b2c9c-fc63-4996-bc23-dee363a27372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:10:53.083276 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b2c9c-fc63-4996-bc23-dee363a27372 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:10:53.092985 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1461/2923] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:10:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:10:54.146143 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a9448-387e-4d33-9f78-1e04e4f376c1 service placement] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:10:54.156724 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a9448-387e-4d33-9f78-1e04e4f376c1 service placement] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:10:54.160248 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353dd91-8cf9-4d05-8f76-ff476b9e5a17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:10:54.160852 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353dd91-8cf9-4d05-8f76-ff476b9e5a17 service neutron] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:10:54.161129 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353dd91-8cf9-4d05-8f76-ff476b9e5a17 service neutron] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:10:54.161397 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353dd91-8cf9-4d05-8f76-ff476b9e5a17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:10:54.165542 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-7353dd91-8cf9-4d05-8f76-ff476b9e5a17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:10:54.194489 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353dd91-8cf9-4d05-8f76-ff476b9e5a17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:10:54.196023 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353dd91-8cf9-4d05-8f76-ff476b9e5a17 service neutron] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:10:54.217415 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1463/2924] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:10:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:10:57.891341 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b2c9c-fc63-4996-bc23-dee363a27372 service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:10:57.900593 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b2c9c-fc63-4996-bc23-dee363a27372 service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:10:57.904202 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e6fa9-2ad7-4720-a6d8-7ac7c1a85a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0742c7ecf68d40a38c8947a05eee2797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:10:57.904786 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e6fa9-2ad7-4720-a6d8-7ac7c1a85a90 service neutron] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:10:57.905061 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e6fa9-2ad7-4720-a6d8-7ac7c1a85a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:10:57.905328 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e6fa9-2ad7-4720-a6d8-7ac7c1a85a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:10:57.973978 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e6fa9-2ad7-4720-a6d8-7ac7c1a85a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:10:57.975435 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e6fa9-2ad7-4720-a6d8-7ac7c1a85a90 service neutron] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:10:57.994636 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1462/2925] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:10:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:11:00.829536 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353dd91-8cf9-4d05-8f76-ff476b9e5a17 service neutron] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:11:00.843575 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353dd91-8cf9-4d05-8f76-ff476b9e5a17 service neutron] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:11:00.849548 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b8f1e-24a5-4b58-a445-77b9e5b34992 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3274d404cb403bbf272ce023aa5e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:11:00.850050 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b8f1e-24a5-4b58-a445-77b9e5b34992 service placement] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:11:00.850498 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b8f1e-24a5-4b58-a445-77b9e5b34992 service placement] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:11:00.851596 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b8f1e-24a5-4b58-a445-77b9e5b34992 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:11:00.853922 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-a55b8f1e-24a5-4b58-a445-77b9e5b34992 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:11:00.868994 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b8f1e-24a5-4b58-a445-77b9e5b34992 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:11:00.870902 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b8f1e-24a5-4b58-a445-77b9e5b34992 service placement] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:11:00.887764 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1464/2926] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:11:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:11:04.000499 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e6fa9-2ad7-4720-a6d8-7ac7c1a85a90 service neutron] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:11:04.018794 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e6fa9-2ad7-4720-a6d8-7ac7c1a85a90 service neutron] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:11:04.026226 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572df46c-93f1-420c-be1d-6fd4a0cd2cd7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3274d404cb403bbf272ce023aa5e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:11:04.026867 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572df46c-93f1-420c-be1d-6fd4a0cd2cd7 service placement] REQUEST_METHOD: `GET` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:11:04.027150 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572df46c-93f1-420c-be1d-6fd4a0cd2cd7 service placement] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:11:04.027426 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572df46c-93f1-420c-be1d-6fd4a0cd2cd7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:11:04.029276 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-572df46c-93f1-420c-be1d-6fd4a0cd2cd7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:11:04.048625 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572df46c-93f1-420c-be1d-6fd4a0cd2cd7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:11:04.050543 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572df46c-93f1-420c-be1d-6fd4a0cd2cd7 service placement] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:11:04.071912 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1463/2927] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:11:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:11:04.073821 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b8f1e-24a5-4b58-a445-77b9e5b34992 service placement] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:11:04.086078 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b8f1e-24a5-4b58-a445-77b9e5b34992 service placement] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:11:04.091250 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe36b3f-1cec-4a4a-9e1a-af6cf2563ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:11:04.092241 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe36b3f-1cec-4a4a-9e1a-af6cf2563ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:11:04.092241 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe36b3f-1cec-4a4a-9e1a-af6cf2563ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:11:04.094054 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe36b3f-1cec-4a4a-9e1a-af6cf2563ebd admin admin] PATH_INFO: `/v3/users/85896f6c47fc4a768a210d715f463339` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:11:04.095075 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe36b3f-1cec-4a4a-9e1a-af6cf2563ebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=85896f6c47fc4a768a210d715f463339)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:11:04.097065 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe36b3f-1cec-4a4a-9e1a-af6cf2563ebd admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:11:04.146776 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6fe36b3f-1cec-4a4a-9e1a-af6cf2563ebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85896f6c47fc4a768a210d715f463339'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:11:04.154876 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6fe36b3f-1cec-4a4a-9e1a-af6cf2563ebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85896f6c47fc4a768a210d715f463339'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:11:04.162035 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6fe36b3f-1cec-4a4a-9e1a-af6cf2563ebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85896f6c47fc4a768a210d715f463339'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:11:04.162794 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6fe36b3f-1cec-4a4a-9e1a-af6cf2563ebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85896f6c47fc4a768a210d715f463339'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:11:04.175517 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6fe36b3f-1cec-4a4a-9e1a-af6cf2563ebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85896f6c47fc4a768a210d715f463339'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:11:04.183608 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1465/2928] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 05:11:04 2022] DELETE /identity/v3/users/85896f6c47fc4a768a210d715f463339 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:11:04.353947 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572df46c-93f1-420c-be1d-6fd4a0cd2cd7 service placement] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:11:04.370282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572df46c-93f1-420c-be1d-6fd4a0cd2cd7 service placement] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:11:04.429608 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642d86a-4102-4b96-a6f4-992fcb27d6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:11:04.430235 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642d86a-4102-4b96-a6f4-992fcb27d6b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:11:04.430516 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642d86a-4102-4b96-a6f4-992fcb27d6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:11:04.430789 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642d86a-4102-4b96-a6f4-992fcb27d6b0 admin admin] PATH_INFO: `/v3/projects/d3447ff89eea42208eeac6b2f2f953e0` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:11:04.431902 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642d86a-4102-4b96-a6f4-992fcb27d6b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3447ff89eea42208eeac6b2f2f953e0)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:11:04.433823 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642d86a-4102-4b96-a6f4-992fcb27d6b0 admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:11:04.478884 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a642d86a-4102-4b96-a6f4-992fcb27d6b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3447ff89eea42208eeac6b2f2f953e0', 'request_id': 'req-a642d86a-4102-4b96-a6f4-992fcb27d6b0'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:11:04.480747 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:04.484835 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a642d86a-4102-4b96-a6f4-992fcb27d6b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3447ff89eea42208eeac6b2f2f953e0', 'request_id': 'req-a642d86a-4102-4b96-a6f4-992fcb27d6b0'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:11:04.493184 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a642d86a-4102-4b96-a6f4-992fcb27d6b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3447ff89eea42208eeac6b2f2f953e0', 'request_id': 'req-a642d86a-4102-4b96-a6f4-992fcb27d6b0'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:11:04.517876 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a642d86a-4102-4b96-a6f4-992fcb27d6b0 admin admin] The token cache is being invalidate because project d3447ff89eea42208eeac6b2f2f953e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:11:04.518163 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a642d86a-4102-4b96-a6f4-992fcb27d6b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:11:04.518805 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-a642d86a-4102-4b96-a6f4-992fcb27d6b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:11:04.520253 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1464/2929] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 05:11:04 2022] DELETE /identity/v3/projects/d3447ff89eea42208eeac6b2f2f953e0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:11:04.524289 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe36b3f-1cec-4a4a-9e1a-af6cf2563ebd admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:11:04.525747 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-6fe36b3f-1cec-4a4a-9e1a-af6cf2563ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:11:04.538446 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe36b3f-1cec-4a4a-9e1a-af6cf2563ebd admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:11:04.594701 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113c278-4681-40ce-86ba-bcf9a73844a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:11:04.595343 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113c278-4681-40ce-86ba-bcf9a73844a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:11:04.595627 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113c278-4681-40ce-86ba-bcf9a73844a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:11:04.595930 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113c278-4681-40ce-86ba-bcf9a73844a2 admin admin] PATH_INFO: `/v3/users/ffe08008d91d4673a6107bc2a6ed4614` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:11:04.597067 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113c278-4681-40ce-86ba-bcf9a73844a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffe08008d91d4673a6107bc2a6ed4614)` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:11:04.599035 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113c278-4681-40ce-86ba-bcf9a73844a2 admin admin] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:11:04.627588 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:04.648409 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6113c278-4681-40ce-86ba-bcf9a73844a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffe08008d91d4673a6107bc2a6ed4614'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:11:04.655768 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6113c278-4681-40ce-86ba-bcf9a73844a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffe08008d91d4673a6107bc2a6ed4614'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:11:04.662665 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6113c278-4681-40ce-86ba-bcf9a73844a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffe08008d91d4673a6107bc2a6ed4614'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:11:04.663288 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6113c278-4681-40ce-86ba-bcf9a73844a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffe08008d91d4673a6107bc2a6ed4614'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:11:04.674943 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.notifications [None req-6113c278-4681-40ce-86ba-bcf9a73844a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffe08008d91d4673a6107bc2a6ed4614'} {{(pid=93412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:11:04.681161 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1466/2930] 10.222.0.94 () {58 vars in 1224 bytes} [Wed Aug 24 05:11:04 2022] DELETE /identity/v3/users/ffe08008d91d4673a6107bc2a6ed4614 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:11:04.862460 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642d86a-4102-4b96-a6f4-992fcb27d6b0 admin admin] Authenticating user token {{(pid=93411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:11:04.863942 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.fernet_utils [None req-a642d86a-4102-4b96-a6f4-992fcb27d6b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:11:04.877280 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642d86a-4102-4b96-a6f4-992fcb27d6b0 admin admin] Validating token access rules against request {{(pid=93411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:11:04.936068 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35991a8a-aebb-4f81-9972-79dfbde9981b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4df458c2526a46c5a13d982659afe50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dde3279595394b269fd2ccc96531ea28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:11:04.936695 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35991a8a-aebb-4f81-9972-79dfbde9981b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:11:04.936974 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35991a8a-aebb-4f81-9972-79dfbde9981b admin admin] SCRIPT_NAME: `/identity` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:11:04.937246 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35991a8a-aebb-4f81-9972-79dfbde9981b admin admin] PATH_INFO: `/v3/projects/2a257028282e449e9418713e7306e3bf` {{(pid=93411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:11:04.938403 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35991a8a-aebb-4f81-9972-79dfbde9981b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a257028282e449e9418713e7306e3bf)` {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:11:04.940281 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35991a8a-aebb-4f81-9972-79dfbde9981b admin admin] RBAC: Authorization granted {{(pid=93411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:11:04.986282 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-35991a8a-aebb-4f81-9972-79dfbde9981b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a257028282e449e9418713e7306e3bf', 'request_id': 'req-35991a8a-aebb-4f81-9972-79dfbde9981b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:11:04.992433 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-35991a8a-aebb-4f81-9972-79dfbde9981b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a257028282e449e9418713e7306e3bf', 'request_id': 'req-35991a8a-aebb-4f81-9972-79dfbde9981b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:11:05.000283 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-35991a8a-aebb-4f81-9972-79dfbde9981b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a257028282e449e9418713e7306e3bf', 'request_id': 'req-35991a8a-aebb-4f81-9972-79dfbde9981b'} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:11:05.011950 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-35991a8a-aebb-4f81-9972-79dfbde9981b admin admin] The token cache is being invalidate because project 2a257028282e449e9418713e7306e3bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:11:05.012525 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-35991a8a-aebb-4f81-9972-79dfbde9981b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:11:05.012847 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG keystone.notifications [None req-35991a8a-aebb-4f81-9972-79dfbde9981b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:11:05.014354 dv-cinder-854264-1-smb devstack@keystone.service[93411]: [pid: 93411|app: 0|req: 1465/2931] 10.222.0.94 () {58 vars in 1233 bytes} [Wed Aug 24 05:11:04 2022] DELETE /identity/v3/projects/2a257028282e449e9418713e7306e3bf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:11:14.677373 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=19,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:15.008996 dv-cinder-854264-1-smb devstack@keystone.service[93411]: DEBUG dbcounter [-] [93411] Writing DB stats keystone:SELECT=62,keystone:DELETE=9,keystone:INSERT=2 {{(pid=93411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:09.208208 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113c278-4681-40ce-86ba-bcf9a73844a2 admin admin] Authenticating user token {{(pid=93412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:14:09.209647 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-6113c278-4681-40ce-86ba-bcf9a73844a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:14:09.277668 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113c278-4681-40ce-86ba-bcf9a73844a2 admin admin] Validating token access rules against request {{(pid=93412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:14:09.335522 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44f3fe-ec4b-48e2-ad42-d8d74ffcdec8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3274d404cb403bbf272ce023aa5e0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4416325d266642f3a786ff9f16c827aa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:14:09.336162 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44f3fe-ec4b-48e2-ad42-d8d74ffcdec8 service placement] REQUEST_METHOD: `GET` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:14:09.336446 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44f3fe-ec4b-48e2-ad42-d8d74ffcdec8 service placement] SCRIPT_NAME: `/identity` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:14:09.336772 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44f3fe-ec4b-48e2-ad42-d8d74ffcdec8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:14:09.338512 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.fernet_utils [None req-be44f3fe-ec4b-48e2-ad42-d8d74ffcdec8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:14:09.349447 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44f3fe-ec4b-48e2-ad42-d8d74ffcdec8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:14:09.351013 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44f3fe-ec4b-48e2-ad42-d8d74ffcdec8 service placement] RBAC: Authorization granted {{(pid=93412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:14:09.361284 dv-cinder-854264-1-smb devstack@keystone.service[93412]: [pid: 93412|app: 0|req: 1467/2932] 10.222.0.94 () {60 vars in 1365 bytes} [Wed Aug 24 05:14:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:14:19.357194 dv-cinder-854264-1-smb devstack@keystone.service[93412]: DEBUG dbcounter [-] [93412] Writing DB stats keystone:SELECT=58 {{(pid=93412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}